Search

This article describes the development of the Writing Readiness Inventory Tool in Context (WRITIC), a measurement evaluating writing readiness in Dutch kindergarten children (5 and 6 years old). Content validity was established through 10 expert evaluations in three rounds. Construct validity was established with 251 children following regular education. To identify scale constructs, factor analysis was performed. Discriminative validity was established by examining contrast groups with good ( n = 142) and poor ( n = 109) performers in paper-and-pencil tasks. Content validity was high with 94.4% agreement among the experts. Two reliable factors were found in the performance of paper-and-pencil tasks with Cronbach's alphas of 0.82 and 0.69 respectively. The contrast groups differed significantly in two WRITIC subdomains: 'Sustained attention' and 'Task performance'. Our findings indicated that the WRITIC is feasible for use in the classroom. [ABSTRACT FROM AUTHOR]

Speech intelligibility is an essential though complex construct in speech pathology. In this paper, we investigated the interrater reliability and validity of two types of intelligibility measures: a rating-based measure, through Visual Analogue Scales (VAS), and a transcription-based measure called Accuracy of Words (AcW), through two forms of orthographic transcriptions, one containing only existing words (EWTrans) and one allowing all sorts of words, including both existing words and pseudowords (AWTrans). Both VAS and AcW scores were collected from five expert raters. We selected speakers with various severity levels of dysarthria (SevL) and employed two types of speech materials, i.e. meaningful sentences and word lists. To measure reliability, we applied Generalizability Theory, which is relatively unknown in the field of pathological speech and language research but enables more comprehensive analyses than traditional methods, e.g., the intraclass correlation coefficient. The results convincingly indicate that five expert raters were sufficient to provide reliable rating-based (VAS) and transcription-based (AcW) measures, and that reliability increased as the number of raters or utterances increased. Generalizability Theory has proved effective in systematically dealing with reliability issues in our experimental design. We also investigated construct and concurrent validity. Construct validity was addressed by exploring the correlations between VAS and AcW within and across speech materials. Concurrent validity was addressed by exploring the correlations between our measures, i.e. VAS and AcW, and two external measures, i.e. phoneme intelligibility and SevL. The correlations corroborate the validity of VAS and AcW to assess speech intelligibility, both in sentences and word lists. [ABSTRACT FROM AUTHOR]

Purpose:The construct validity, test–retest reliability, and measurement error of the Arm Function in Multiple Sclerosis Questionnaire (AMSQ) were examined. Additionally, the influence of administration-method on reliability and measurement error was investigated. Method:112 Dutch adult MS-patients from an academic- and a residential care-facility participated. Questionnaires were administered on paper, online or as interview, and patients performed several performance tests. Construct validity was assessed by testing pre-defined hypotheses. Reliability was assessed using Intraclass Correlation Coefficients (ICCs), Standard Error of Measurements (SEMs) and Smallest Detectable Changes (SDCs). Results:For construct validity (N = 105) 9 of 13 hypotheses were confirmed (69%). As expected, the AMSQ showed moderate to strong relationships with the instruments measuring similar constructs. The test–retest reliability coefficient was 0.96 (95% Confidence Interval 0.94–0.97); SEM was 6.3 (6.3% of scale range); SDC was 17.5 (on a sale from 0 to 100). Different administration-methods showed good reliability (ICC 0.88–0.94) and small standard errors (SEM 5.6–7.2). Conclusion:The AMSQ shows satisfying results for validity and excellent reliability; allowing for proper use in research. Due to a large SDC value, caution is needed when using the AMSQ in individual patient care. Further research should determine whether the SDC is smaller than the minimal important change.Implications for RehabilitationThe Arm Function in Multiple Sclerosis Questionnaire (AMSQ) measures activity limitations due to hand and arm functioning in patients with Multiple Sclerosis (MS).Results of this study confirm adequate validity and reliability of the AMSQ in patient with MS.The equivalence of scores from online, paper or interview administration is supported.A change score of ≥18 points on the scale of the AMSQ (on a scale 0–100) needs to occur to be certain a change beyond measurement error has occurred in an individual patient. [ABSTRACT FROM AUTHOR]

To develop and explore underlying dimensions of the Self-Regulation Assessment (SeRA) and psychometric features of potential components. Further, to identify associations between the SeRA and disability-management self-efficacy, type of diagnosis, and type of rehabilitation. Based on a previously developed model of self-regulation, expert and patient opinions, and cognitive interviews, a list of 22 items on self-regulation (the SeRA) was constructed. The SeRA was included in a cross-sectional survey among a multi-diagnostic group of 563 former rehabilitation patients. Exploratory analyses were conducted. Respondents had a mean age of 56.5 (SD 12.7) years. The largest diagnostic groups were chronic pain disorder and brain injury. Four components were found within the SeRA, labelled as "insight into own health condition," "insight into own capabilities," "apply self-regulation," and "organization of help." Cronbach's alpha was high (total scale: 0.93, subscales: range 0.85–0.89). Only scores on the first subscale showed a ceiling effect. Subscale three showed the highest correlation with a self-efficacy measure. Small differences in SeRA total scores (range 71.6–78.1) were found between different diagnostic groups. The SeRA is a new self-regulation measure with four subscales. Further research is needed to establish the validity and reliability of the SeRA. The Self-Regulation Assessment (SeRA) was developed to provide a comprehensive measurement of self-regulation among rehabilitation populations. The SeRA could potentially be used to identify persons with self-regulation problems at the start of rehabilitation treatment and measure outcomes of rehabilitation for self-regulation. The SeRA could potentially be used to help analyse outcomes of rehabilitation practice as well as evaluate interventions on self-regulation. [ABSTRACT FROM AUTHOR]

Global rating scales (GRSs) such as the Objective Structured Assessment of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Surgery (GOALS) are assessment methods for surgical procedures. The aim of this study was to establish construct validity of Procedure-Based Assessment (PBA) and to compare PBA with GRSs for laparoscopic cholecystectomy. OSATS and GOALS GRSs were compared with PBA in their ability to discriminate between levels of performance between trainees who can perform the procedure independently and those who cannot. Three groups were formed based on the number of procedures performed by the trainee: novice (1–10), intermediate (11–20) and experienced (>20). Differences between groups were assessed using the Kruskal–Wallis and Mann–Whitney U tests. Increasing experience correlated significantly with higher GRSs and PBA scores (all p <.001). Scores of novice and intermediate groups overlapped substantially on the OSATS (p =.1) and GOALS (p =.1), while the PBA discriminated between these groups (p =.03). The median score in the experienced group was higher with less dispersion for PBA (97.2[85.3–100]) compared to OSATS (82.1[60.7–100]) and GOALS (80[60–100]). For assessing skill level or the capability of performing a laparoscopic cholecystectomy independently, PBA has a higher discriminative ability compared to the GRSs. [ABSTRACT FROM AUTHOR]

We translated and modified an ambiance scale for use by (in)formal caregivers in Dutch nursing homes. We tested validity and reliability of the modified Ambiance Scale. Convenience sampling was used to enrol (in)formal caregivers in three nursing homes in the Netherlands. 104 questionnaires were filled in; 45 by informal caregivers, 46 by formal caregivers. Ten caregivers filled in the questionnaire twice for test-retest purposes. Three original items were used, and seven newly were added to form the modified Ambiance Scale. Each item consisted of an adjective pair assessing an aspect of ambiance on a scale of 1 (homelike) to 5 (institutional). Caregivers filled in the questionnaire on two different days to assess intra rater reliability. Differences in scoring between formal and informal caregivers and between original and new items were analyzed. The questionnaire was easy to comprehend and fill in. Internal consistency was good (a = 0.93). Validity was found to be good. Factor analysis demonstrated that eight items identified as one factor. No differences in scoring between the first and second assessment were found (p<.001). Formal caregivers scored ambiance more chaotic than informal caregivers did (p<.01). No differences in scoring between original and new items were found (p =.06). This study demonstrated that the modified Ambiance Scale had good internal consistency, moderate replicability and both informal and formal caregivers' overall ratings were comparable. The modified Ambiance Scale is a valid, reliable and easy to use tool to assess ambiance in nursing home settings. [ABSTRACT FROM AUTHOR]

Mental health problems are highly prevalent in primary care. Validated tools to detect mental disorders in general practice are needed. The Four-Dimensional Symptom Questionnaire (4DSQ) was designed to help GPs differentiating between psychological distress and psychopathological conditions (depression, anxiety, somatization). The aim of the current study was to examine psychometric properties of the 4DSQ in a mental health setting. Reliability, factorial, construct, and criterion validity of the English translation of the 4DSQ were analyzed in an American sample of 159 patients attending a psychotherapy outpatient clinic. Measurement equivalence across languages was determined by analyzing differential item functioning (DIF) and differential test functioning (DTF) in the American sample and a Dutch mental health sample, matched by age and sex. A confirmatory factor analysis confirmed all 4DSQ subscales to be unidimensional. All 4DSQ subscales revealed excellent reliability (Cronbach's alpha and McDonald omega =.90) and high correlations with a symptom distress subscale of an instrument that is commonly used to monitor psychotherapy progress, the Outcome Questionnaire-45. Eight items were flagged with DIF. The Depression subscale was free of DIF. DTF analyses showed an impact of DIF on scale level for the lower cutoff score of the Distress scale. The 4DSQ Distress score was the best predictor of a mood disorder diagnosis and the Anxiety score outperformed other 4DSQ scales to predict an anxiety disorder. In conclusion, the 4DSQ demonstrates excellent reliability and validity in a mental health setting. Further research is needed to determine reliable cutoff values on 4DSQ subscales to predict psychiatric diagnoses. [ABSTRACT FROM AUTHOR]

Diagnosing symptoms of psychological distress can be challenging in migrants living with HIV (MLWH) living in Western Europe. We evaluated the Hospital Anxiety and Depression Scale (HADS) as a screening tool for psychological distress. Additionally, the association between psychological distress and adherence to combination Antiretroviral Therapy (cART) was determined. Socio-demographic and clinical characteristics, psychosocial variables, and self-reported adherence to cART data were collected. 306/352 participants completed the HADS. A HADS+ (≥15, at risk for psychological distress) was found in 106/306. The Composite International Diagnostic Interview (CIDI) was completed by 60/106. The HADS was repeated in 58 participants as the time between the first HADS and the CIDI was more than three months. In 21/37 participants with a HADS+ (57%) within three months before the CIDI a diagnosis of depression or anxiety disorder based on the CIDI was found. Participants with a HADS+ were more likely to be non-adherent (71.3% vs. 43.6%). In a large group of MLWH in the Netherlands, 35% were at risk for symptoms of psychological distress. The HADS seems to be a suitable screening tool for MLWH. [ABSTRACT FROM AUTHOR]

The standardized Mensendieck test (SMT) was developed to quantify posture, movement, gait, and respiration. In the hands of an experienced therapist, the SMT is proven to be a reliable tool. It is unclear whether posture, movement, gait, and respiration are related to the degree of functional disability in patients with chronic pain. The objective of this study was to assess the reliability and convergent validity of the SMT in a heterogeneous sample of 50 patients with chronic pain. Methods: Internal consistency was determined by Cronbach’s α and interrater reliability by the intraclass correlation coefficient (ICC). Convergent validity was assessed by determining the Spearman rank correlation coefficient between the movement quality measured in the SMT and functional limitation measured on the disability rating index (DRI). Results: The internal consistency was Cronbach’s α 0.91. Substantial reliability was found for the items: movement (ICC = 0.68), gait (ICC = 0.69), sitting posture (ICC = 0.63), and respiration (ICC = 0.64). Insufficient reliability was found for standing posture (ICC = 0.23). A moderate correlation was found between average test score SMT and the DRI (r = −0.37) and respiration and DRI (r = −0.45). Discussion: The SMT is a reasonably reliable tool to assess movement, gait, sitting posture, and respiration. None of the items in the domain standing posture has sufficient reliability. A thorough study of this domain should be considered. The results show little evidence for convergent validity. Several items of the SMT correlated moderately with functional limitation with the DRI. These items were global movement, hip flexion, pelvis rotation, and all respiration items. [ABSTRACT FROM AUTHOR]

Background:Portfolios are used as tools to coach and assess students in the workplace. This study sought to evaluate the content validity of portfolios as reflected in their capacity to adequately assess achieved competences of medical students during clerkships. Methods: We reviewed 120 workplace portfolios at three medical universities (Belgium and the Netherlands). To validate their content, we developed a Validity Inventory for Portfolio Assessment (VIPA) based on the CanMEDS roles. Two raters evaluated each portfolio and indicated for each VIPA item whether the portfolio provided sufficient information to enable satisfactory assessment of the item. We ran a descriptive analysis on the validation data and computed Cohen’s Kappa to investigate interrater agreement. Results:The portfolios adequately covered the items pertaining to the communicator (90%) and professional (87%) roles. Coverage of the medical expert, collaborator, scholar and manager roles ranged between 75% and 85%. The health advocate role, covering 59%, was clearly less well represented. This role also exhibited little interrater agreement (Kappa < 0.4). Conclusions:This study lends further credence to the evidence that portfolios can indeed adequately assess the different CanMEDS roles during clerkships, the health advocate role, which was less well represented in the portfolio content, excepted. [ABSTRACT FROM PUBLISHER]

Purpose: We developed the Arm Function in Multiple Sclerosis Questionnaire (AMSQ) to measure arm and hand function in MS, based on existing scales. We aimed at developing a unidimensional scale containing enough items to be used as an itembank. In this study, we investigated reliability and differential item functioning of the Dutch version.Method: Patients were recruited from two MS Centers and a Dutch website for MS patients. We performed item factor analysis on the polychoric correlation matrix, using multiple fit-indices to investigate model fit. The graded response model, an item response theory model, was used to investigate item goodness-of-fit, reliability of the estimated trait levels (θ), differential item functioning, and total information. Differential item functioning was investigated for type of MS, gender, administration version, and test length.Results: Factor analysis results suggested one factor. All items showedp-values of the item goodness-of-fit statistic above 0.0016. The reliability was 0.95, and no items showed differential item functioning on any of the investigated variables.Conclusion: AMSQ is a unidimensional 31-item questionnaire for measuring arm function in MS. Because of a well fit in a graded response model, it is suitable for further development as a computer adaptive test.Implications for RehabilitationA new questionnaire for arm and hand function recommended in people with multiple sclerosis (AMSQ).Scale characteristics make the questionnaire suitable for use in clinical practice and research.Good reliability.Further development as a computer adaptive test to reduce burden of (repetitive) testing in patients is feasible. [ABSTRACT FROM PUBLISHER]

Children vary hugely in how demanding of their caregivers they are. This creates differences in demands on parents during observation, making the comparison of sensitivity between parents difficult. It would therefore be of interest to create standard situations in which all caregivers are faced with the same level of demand. This study developed an ecologically valid but standardized setting using an infant simulator with interactive features, the Leiden Infant Simulator Sensitivity Assessment (LISSA). The infant simulator resembles a real infant in appearance and it produces crying sounds that are life-like. The simulator begins with fussing and progresses to more intense crying in case of no care or inappropriate care. It responds by being calm again if appropriate care is given. One hundred and eighty-one female participants took care of the infant simulator for two evenings and in a 30 min lab session with increasing competing demands. Sensitive parenting behavior during the lab session was coded with the Ainsworth Sensitivity Scale. Sensitivity ratings covered the whole range of the scale (1–9), and were stable across settings (free play, competing demands). Sensitivity was related to an increase of positive affect during caretaking, and insensitivity was related to intended harsh caregiving response during a computerized cry paradigm. Sensitivity was unrelated to social desirability and self-reported quality of care given to the infant simulator. We discuss the potentials of the infant simulator for research on sensitive parenting, for preventive interventions, and for clinical practices. [ABSTRACT FROM AUTHOR]

Socioemotional guidance of students has recently become an integral part of education, however no instrument exists to measure integrated socioemotional guidance. This study therefore examines the factor structure and reliability of the Socioemotional Guidance Questionnaire. Psychometric properties of the Socioemotional Guidance Questionnaire and implications for schools, educators, and counselors are discussed. [ABSTRACT FROM PUBLISHER]

Background: Internationally, postgraduate medical education (PGME) has shifted to competency-based training. To evaluate the effects of this shift on the outcomes of PGME appropriate instruments are needed. Aim: To provide an inventory of tasks specialists perform in practice, which can be used as an instrument to evaluate the outcomes of PGME across disciplines. Methods: Following methodology from job analysis in human resource management, we used document analyses, observations, interviews and questionnaires. Two thousand seven hundred and twenty eight specialists were then asked to indicate how frequently they performed each task in the inventory, and to suggest additional tasks. Face and content validity was evaluated using interviews and the questionnaire. Tasks with similar content were combined in a total of 12 clusters. Internal consistency was evaluated by calculating Cronbach's alpha. Construct validity was determined by examining predefined differences in task performance between medical, surgical and supportive disciplines. Results: Seven hundred and six specialists (36%) returned the questionnaire. The resulting inventory of 91 tasks showed adequate face and content validity. Internal consistency of clusters of tasks was adequate. Significant differences in task performance between medical, surgical and supportive disciplines indicated construct validity. Conclusion: We established a comprehensive, generic and valid inventory of tasks of specialists which appears to be applicable across medical, surgical and supportive disciplines. [ABSTRACT FROM AUTHOR]

Background: The Dutch Radiology Progress Test (DRPT) monitors the acquisition of knowledge and visual skills of radiology residents in the Netherlands. Aim: We aimed to evaluate the quality of progress testing in postgraduate radiology training by studying the reliability of the DRPT and finding an indication for its construct validity. We expected that knowledge would increase rapidly in the first years of residency, leveling-off in later years, to allow for the development of visual skills. We hypothesized that scores on the DRPT reflect this pattern. Methods: Internal consistencies were estimated with Cronbach's alpha. Performance increase over program years were tested using one-way analysis of variance. Results: Data were available for 498 residents (2281 test results). Reliabilities were around Cronbach's alpha 0.90. There was a significant difference in the mean test results between the first three years of residency. After the fourth year no significant increase in test scores on knowledge could be measured on eight tests. The same pattern occurred for scores on visual skills. However, visual skills scores tend to increase more sharply than knowledge scores. Conclusion: We found support for the reliability and construct validity of the DRPT. However, assessment on visual skill development needs further exploration. [ABSTRACT FROM AUTHOR]

Background: Conceptions of medical teachers regarding learning and teaching affect their teaching practice. Therefore conceptions should be addressed in faculty development. Aim: To facilitate this, we constructed the Conceptions Of Learning and Teaching (COLT) instrument. Method: The COLT was adapted based on experts' comments during a meeting and interviews, followed by a Delphi procedure (Part I). It was administered to teachers from two Dutch medical schools with different traditions in student-centred education (Part II; N = 646). The data were analyzed using confirmatory factor analysis and reliability analysis. Results: 324 Teachers (50.2%) completed the questionnaire. Confirmatory factor analysis did not confirm the underlying theoretical model, but an alternative model demonstrated a good fit. This led to an instrument with eighteen items reflecting three underlying factors: 'teacher centredness', 'appreciation of active learning', and 'orientation to professional practice'. We found significant differences in COLT scores between the faculty of the two medical schools. Conclusions: The COLT appears to be a construct valid tool resulting in reliable scores of teachers' conceptions of learning and teaching, in student-centred medical education. Two of the three factors are new and may be specific for student-centred medical education. The COLT may be a promising tool to improve faculty development. [ABSTRACT FROM AUTHOR]

Background Physical fitness is relevant for wellbeing and health, but knowledge on the feasibility and reliability of instruments to measure physical fitness for older adults with intellectual disability is lacking. Methods Feasibility and test-retest reliability of a physical fitness test battery (Box and Block Test, Response Time Test, walking speed, grip strength, 30-s chair stand, 10-m Incremental Shuttle Walking Test and the Extended Modified Back-Saver Sit-and-Reach Test) were investigated in older adults with ID in a convenience sample of 36 older adults (mean 65.9, range 50-89 years), with differing levels of intellectual disability and mobility. Results and conclusion All tests to measure physical fitness in older adults with ID had moderate to excellent feasibility and had sufficient test-retest reliability (ICCs .63-.96). No statistically significant learning effects were found. [ABSTRACT FROM AUTHOR]

Many cancer patients experience spirituality as highly supportive while coping with their disease. Most research as well as most questionnaires in this field is religious orientated. The Spiritual Attitude and Involvement List was developed to enable research on spirituality among religious and nonreligious people. It consists of seven subscales that measure connectedness with oneself, with others and nature, and with the transcendent. Among a student, a healthy population, a healthy interested, a curative cancer, and a palliative cancer sample factorial, convergent and discriminant validity were demonstrated, as well as adequate internal consistency and test–retest reliability. [ABSTRACT FROM PUBLISHER]