Search

Background: Chronic fatigue, depression, burnout syndrome, and alcohol addiction have been identified as significant mental health problems in young medical doctors. Given the lack of prospective studies in this area in Poland, the POLski LEKarz (POLLEK) cohort study was created. The goal of the POLLEK study is to assess the quality of life and health status (including mental health) of medical students and young physicians. The aim of the presented paper was to assess the reliability and compatibility of paper and electronic versions of the POLLEK questionnaire. Methods: Between 1 October 2019 and 28 February 2020, all medical students (N = 638) of the first year in the Medical University of Silesia were invited to participate in a cross-sectional study. Three hundred and fifty-three students (55.3%) who accomplished both versions were included in the current analysis. Results: Values of Cronbach&rsquo, s alpha &gt, 0.7 proved both modes of delivery to have good internal consistency, except for the individual Alcohol Use Disorder Identification Test (AUDIT) domains and the Environmental domain of the WHOQOL-BREF (paper version). Similarly, interclass correlation coefficients equal to or greater than 0.9 denoted an excellent reproducibility. Conclusions: We documented very good accordance and reproducibility of POLLEK questionnaire (both paper and electronic versions). These findings legitimize the use of the questionnaire interchangeably.

Current advances in technology have enabled the development of a computer-based questionnaire that provides advantages over the paper-based mode of administration, such as automatic data entry, storage and calculations. However, before implementing a computer-based questionnaire, its equivalence with the original paper-based questionnaire must first be demonstrated. The purpose of this study was to evaluate the measurement equivalence of the computerized Diabetes-Specific Quality-of-Life questionnaire (cD-QOL) with its original paper-based counterpart. A two-period crossover design was used in this study. The measurement equivalence was evaluated using quadratic weighted kappa coefficients, intraclass correlations and Cronbach's alpha comparisons. The cD-QOL was equivalent to its original paper-based counterpart. Participants preferred the cD-QOL over the paper-based questionnaire and reported that it was easy to use.

Purpose This trial assessed the ability to enhance healthrelated quality of life (HRQL) and patient-reported outcome (PRO) evaluation in trials and patient management using computer assistance with a handheld device, called a personal digital assistant. The study assessed ease of use and psychometric properties of this approach, comparing the Lung Cancer Symptom Scale (LCSS) paper form with the electronic (eLCSS-QL). Objectives were to: (1) measure completion times; (2) evaluate acceptability by patients, nurses, and physicians; (3) determine the correlation of the eLCSS-QL with the paper version; and (4) determine the feasibility of using a shorter visual analogue scale (VAS) in the electronic version. Patients and methods Patients were entered at 12 COMET clinics. All had: (a) stage III or IV non-small cell lung cancer, (b) Karnofsky performance status (KPS)≥60, (c) no prior chemotherapy, and (d) received initial courses of docetaxel + platinum. Of the148 patients enrolled, characteristics were: men, 57 %; median, KPS 80 %; and median age, 67 years. Of these, 131 patients completed the evaluation form. Results The eLCSS-QL had excellent acceptance by patients, nurses, and physicians. Patients required 2.2 min (mean) to complete the eLCSS-QL. Reliability coefficients using Cronbach’s alpha were high for the paper (0.84) and electronic (0.88) versions. The correlation coefficient between forms was high (0.92). The length of the VAS on the handheld pc (53 mm versus 100 mm on the paper format) resulted in nearly identical scores. Conclusions The high acceptance rate by patients and professionals, the rapid completion time, ease of use, and strong psychometric properties confirm that the electronic LCSS (eLCSS-QL) is practical for use in trials and patient management. This study indicates that computer assistance helps overcome barriers associated with evaluating HRQL and PROs.

Background: Patients’ perspectives provide valuable information on quality of care. This study evaluates the feasibility and validity of Internet administration of Service Satisfaction Scale for Cancer Care (SCA) to assess patient satisfaction with outcome, practitioner manner/skill, information, and waiting/access. Patients and methods: Primary data collected from November 2007 to April 2008. Patients receiving cancer care within 1 year were recruited from oncology, surgery, and radiation clinics at a tertiary care hospital. An Internet-based version of the 16-item SCA was developed. Participants were randomised to Internet SCA followed by paper SCA 2 weeks later or vice versa. Seven-point Likert scale responses were converted to a 0–100 scale (minimum–maximum satisfaction). Response distribution, Cronbach’s alpha, and test–retest correlations were calculated. Results: Among 122 consenting participants, 78 responded to initial SCA. Mean satisfaction scores for paper/Internet were 91/90 (outcome), 95/94 (practitioner manner/skill), 89/90 (information), and 86/86 (waiting/access). Response rate and item missingness were similar for Internet and paper. Except for practitioner manner/skill, test–retest correlations were robust r = 0.77 (outcome), 0.74 (information), and 0.75 (waiting/access) (all P < 0.001). Conclusions: Internet SCA administration is a feasible and a valid measurement of cancer care satisfaction for a wide range of cancer diagnoses, treatment modalities, and clinic settings.

ObjectiveTo compare online and paper-based screening for depression and anxiety in adults with cystic fibrosis (CF).Design and settingCross-sectional study in CF clinics in Ireland and through the Cystic Fibrosis Ireland online community.Participants160 adult patients aged 18 or above were recruited. Of these, 147 were included in the analysis; 83 online and 64 paper-based. The remaining 13 were excluded because of incomplete data.MeasuresDepression and anxiety were measured using the Hospital Anxiety and Depression Scale (HADS). Data on pulmonary function (forced expiratory volume in 1 s %) and body mass index were self-reported based on clinical assessments. Sociodemographic data were collected.ResultsCompared with the paper-based participants, the online participants were more likely to be female (61.7% vs 48.4%), older (mean 32.2 vs 28.2 years) and were more likely to be married (32.5% vs 15.6%), living with their spouse or partner (42.5% vs 22.6%) and working either full time (33.7% vs 15.9%) or part time (30.1%vs 17.5%). The prevalence rates of elevated anxiety and depression were not significantly different (P=0.71 and P=0.56). HADS anxiety and depression scores were not statistically different between online (P=0.83) and paper-based (P=0.92) participants based on Mann-Whitney U test. A significant negative correlation was found between depression and pulmonary function (r=−0.39, P=0.01) and anxiety and pulmonary function (r=−0.36, P=0.02). Based on Cronbach’s alpha, there were no statistically significant differences between the online and paper-based participants on the internal consistency of the HADS anxiety (P=0.073) and depression (P=0.378) scales.ConclusionsOur findings suggest that online and paper-based screening for depression and anxiety in adult patients with CF yield comparable findings on prevalence rates and scores, associations with health and internal consistency of subscales. This study highlights that online screening offers an alternative method to paper-based screening. Further research with a larger sample and assessment of measurement equivalence between online and paper based screening is needed to confirm our results.

Objective To survey the knowledge, attitude, and practices of Vietnamese pharmacists regarding the COVID-19 pandemic. Method This cross-sectional, paper-based study was conducted from June to August 2020. A validated questionnaire (Cronbach’s alpha = 0.84) was used to interview 1,023 pharmacists in nine provinces of Vietnam. Analysis of covariance was employed to identify factors associated with the knowledge of pharmacists. The best model was chosen by using the Bayesian Model Averaging method in R software version 4.0.4. Results The mean knowledge score was 12.02 ± 1.64 (range: 6–15), which indicated that 93.4% of pharmacists had good knowledge of COVID-19. There was no difference in the average score between males and females (p > 0.05). The multivariate linear regression model revealed that the knowledge was significantly associated with pharmacists’ age, education level, and residence (p < 0.001). About attitude and practices, pharmacists daily sought and updated information on the COVID-19 pandemic through mass media and the internet (social network and online newspapers). Nearly 48% of them conceded that they communicated with customers when at least one person did not wear a face mask at the time of the COVID-19 outbreak. At medicine outlets, many measures were applied to protect pharmacists and customers, such as equipping pharmacists with face masks and hand sanitizers (95.0%), using glass shields (83.0%), and maintaining at least one-meter distance between two people (85.2%). Conclusion The pharmacists’ knowledge of COVID-19 transmission, symptoms, and prevention was good. Many useful measures against the spread of this perilous virus were applied in medicine outlets. However, pharmacists should restrict forgetting to wear face masks in communication with medicine purchasers. The government and health agencies should have practical remedies to reduce the significant differences in the COVID-19 knowledge of pharmacists among provinces and education-level groups.

E-hailing industry is a new concept in the taxi services whereby private cars can register with online transport. Despite the rapid popularity of e-hailing services, there are major public concerns pertaining to cyber security behavior issues both to the passengers and the drivers such as hit and run accident, robbery, rape, sexual harassment, murder, rude drivers and grab driver scams. Hence, this study intends to investigate the predictors of cyber security behaviors of e-hailing services in Malaysia. The prevailing factors to be examined are perceived threats, perceived privacy, fraud victimization, response efficacy, perceived vulnerability, security self-efficacy, perceived benefit and government policy. The research methods to be used are quantitative and qualitative research design. The sampling technique is to collect data passengers and drivers of e-hailing services operating in Malaysia. The measurement of the twelve main variables consists of 90 items. The data will be collected using self-administered survey and analyzed using SMART PLS 3.0. The expected finding is a new cyber security behavior model for Malaysia, provide new inputs for e-hailing regulation and policy improvement in line with Industrial Revolution 4, new suggestions for e-hailing market segmentation according gender and generation gaps, enhancement of the existing applications according to research findings, set new guidelines on the development of similar application in line with industrial Revolution 4 and the installation of panic button in e-hailing automobile. From the pilot study results, all scales were found to be consistent and reliable with Cronbach's alpha readings above 0.70.

Aim: To investigate the reliability of the COntext Assessment for Community Health (COACH) tool on mobile phone versus pen-paper in Nairobi, Kenya. Background: One of the barriers to the progress of the MDGs has been the failure of health systems in many LMICs to effectively implement evidence-based interventions As a result of the “know-do” gap, patients do not benefit from advances in healthcare and are exposed to unnecessary risks. Better mapping of context improves implementation by allowing tailoring of strategies and interpretation of knowledge translation. COACH investigates healthcare contexts for LMICs and has only been used on pen-paper. With 5 billion mobile phone users globally, mobile technologies is being recognized as able to play a formal role in health services. Methods: Comparative study with 140 nurses/midwives and doctors in four hospitals in Nairobi. 70 were randomly assigned to mobile phone and pen-paper each. The tool was administered twice with a two week interval and test-retest reliability, internal consistency and interrater reliability were assessed. Findings: Excellent test-retest reliability for both pen-paper and mobile phone (ICC >0.81). 45% (pen-paper) and 34% (mobile phone) moderate agreement between individual questions in round 1 and 2. Acceptable average Cronbach’s alpha (>0.70). Conclusion: Both mobile phone and pen-paper were reliable and feasible for data collection. The findings are a good first step towards using COACH in Kenya. Additional research is needed for individual settings. Using mobile phones could increase healthcare facilities’ accessibility in implementation research, helping to close the “know-do” gap and reach the SDGs.

Integration of e-Health technologies for purposes of both assessment and intervention has recently become an interest area in pediatric psychology. The purpose of this study is to present psychometric characteristics of a technology-based (i.e., tablet administration) approach for measuring quality of life (QOL) in children. Eighty children (8-12 years) completed the Quality of Life Systemic Inventory for Children (QLSI-C) twice over a 2-week delay, in a crossover design that used paper and tablet-based modes of administration. Equivalence of scores across methods was examined using intraclass correlation coefficients (ICC), augmented by paired t test and Pearson's correlations. Test-retest reliability was assessed using paired t test and Pearson's correlations while internal consistency was assessed using Cronbach's coefficient. Results showed a good concordance across methods of administration (ICCs = .72 to .91; r = .56 to .83). Paired t test showed no significant differences between the tablet and paper version of the QLSI-C. Internal consistency reliability yielded acceptable Cronbach's alphas for all QLSI-C scores, with all α > .70. Test-retest reliability for the tablet-administered QLSI-C was good (r = .66 to .90). Paired t test showed no significant difference between Time 1 and 2 for the QLSI-C scores, except for the state score. Findings established the reliability of the tablet-administered QLSI-C scores. This technology approach to assessment is more attractive for children, decreases time for administration, and enhances the ease of scoring. These advantages might encourage both clinicians and researchers to consider using e-Health developments in assessment in pediatric psychology. (PsycINFO Database Record

Aims To evaluate the psychometric properties of an online versus paper US-English version of the International Consultation on Incontinence Questionnaire-Bowel (ICIQ-B). Methods The ICIQ-B includes 17 items under 3 domains: bowel pattern (5 items), bowel control (7 items), and quality of life (5 items). We recruited community-dwelling adults seeking treatment for ≥monthly bowel leakage from specialty clinics within a VA medical center and university affiliate. An online versus paper version was evaluated at baseline, 2 weeks later, and 3 months after nonsurgical treatments per usual care. We assessed test-retest reliability (Pearson correlations) at 2 weeks, internal consistency (Cronbach's alpha), and convergent validity (Pearson correlations). Sensitivity to change was the difference between the baseline and post-treatment (3-month) scores. Results Mean age was 58.0 ± 11.9; 36% Veterans, 52% women. At baseline, 2 weeks, and 3 months, we found no differences in the online vs paper scores for the bowel control and quality of life domains. The ICIQ-B demonstrated fair internal consistency for the bowel pattern domain (Cronbach's α = 0.36–0.54). Internal consistency on the bowel pattern domain was better with the paper version than the online version at 2 weeks (P 0.80), good retest reliability (r ≥ 0.70, P

The aim of this paper was to assess the validity and reliability of the touch-screen standard Portuguese version of the following patient-reported outcomes (PROs), compared with paper format, in patients with rheumatoid arthritis (RA) and spondyloarthritis: Bath Ankylosing Spondylitis Disease Activity Index (BASDAI), Bath Ankylosing Spondylitis Functional Index (BASFI), Ankylosing Spondylitis Quality of Life scale (ASQoL), Short-Form 36 (SF-36), Health Assessment Questionnaire (HAQ) and visual analogue scales (VAS) measuring pain and burden of disease. Adult patients with RA and spondyloarthritis attending the Portuguese Institute of Rheumatology were recruited from March 2013 to January 2014. Patients filled the paper and touch-screen formats of the standard Portuguese versions of the PROs. Two groups of VAS were used, RA and psoriatic arthritis (Global VAS) and another specific for spondyloarthrites (Spa-VAS). Paper questionnaires were filled 15 min before touch-screen formats. Agreement between formats (validity) was assessed by intraclass correlation coefficient (ICC), while internal consistency of scales (reliability) was assessed by Cronbach's alpha. Overall, 134 patients were included with a mean age of 51 years, 74.6 % female and 57.5 % presenting RA. BASDAI, BASFI, HAQ and ASQoL showed high ICC between paper and touch-screen formats (0.977, 0.958, 0.974 and 0.940, respectively). ICC for Global VAS ranged from 0.906 to 0.921, while Spa-VAS ranged from 0.867 to 0.943. The mean ICC for all SF-36 domains was 0.889 (ICC for each domain ranged from 0.781 to 0.944). Touch-screen standard Portuguese formats of these PROs may be valid and reliable tools for PRO measurement in rheumatology.

Aims This observational study compared data values, reliability, consistency and compliance collected by electronic and paper diaries of differing durations. Methods Subjects ≥18 years with overactive bladder (OAB) on stable antimuscarinic treatment for ≥12 weeks were assigned to one of five, 15-week diary schedules in this randomized, parallel-group observational study. Sample size was sufficient to assess reliability and consistency of diary data with adequate precision. Reliability was assessed via intraclass correlation coefficients, variability with ANCOVAs, and consistency using Cronbach's alpha. Results Demographic characteristics of randomized subjects were representative of OAB trial populations. For mean volume voided, reliability was comparable across diary groups. For incontinence, reliability improved with increasing diary duration. For micturition frequency, electronic 7-day diary results had highest reliability and lowest variability. Lowest overall reliability was observed in the 3-day paper diary. Consistency was highest in the electronic continuous groups; Cont A (daily measurements throughout the study period [fully Continuous]) and Cont B (daily measurements for some but not all endpoints of interest [Partially Continuous]). Compliance was generally high; across groups ≥90% of diaries had at least one entry per day. There was no significant change in average micturition frequency with diary duration, suggesting no diary fatigue. One-third of subjects in the electronic Cont B group also reported micturitions as incontinence when they only needed to report incontinence; they also reported lowest satisfaction with the study. The electronic 7-day and electronic Cont A schedules (who reported incontinence and micturitions throughout the study) had lowest residual errors. Conclusions For future OAB trials, 7-day or continuous electronic diaries may improve accuracy and reliability of micturition and incontinence frequency data compared with shorter collection periods and paper diaries. Neurourol. Urodynam. © 2015 Wiley Periodicals, Inc.

Use of Internet versions of questionnaires may have several advantages in clinical and epidemiological research, but we know little about if Internet versions differ with respect to validity and reliability. We aimed to compare Internet- and pen-and-paper versions of short form-36 (SF-36) with respect to test-retest reliability and internal consistency. Women referred to mammography (n = 782) were randomised to receive either a paper version with a prepaid return envelope or a guideline on how to fill in the Internet version. A subgroup was asked to answer the questionnaire once again in the alternative version. Test-retest reliability was assessed by the intra-class correlation coefficient. Internal consistency was calculated as Cronbach's alpha. The between-version test-retest reliability for the eight subscales were between 0.63 and 0.92. Cronbach's alpha for the two versions were all between 0.75 and 0.93 with minor differences between the Internet- and the pen-and-paper version. We found little or no evidence of a difference in test-retest reliability and internal consistency when we compared an Internet- and a pen-and-paper version of SF-36.

Assessing anatomy in a way that tests higher cognitive domains and clinical application is not always straightforward. The old "spotter" examination has been criticized for only testing low level "identify" knowledge, whereas other assessment modalities such as multiple choice questions do not reflect the three dimensional and application nature of clinical anatomy. Medical curricula are frequently integrated and subject specific examinations do not reflect the case based, spiral, integrative nature of the curricula. The integrated anatomy practical paper (IAPP) is a hybrid of the old "spotter" and an objective structured clinical examination but it demonstrates how higher levels of taxonomy can be assessed, together with clinical features and integrates well with other disciplines. Importantly, the IAPP has shown to be reliable and practical to administer. Data gathered from the Bachelor of Medicine five-year program over two academic years for four IAPP examinations, each being 40 minutes with (K = 60 items) based on 440 students revealed consistently strong reliability coefficients (Cronbach alpha) of up to 0.923. Applying Blooms taxonomy to questions has shown a marked shift resulting in an increase in the complexity level being tested; between 2009 and 2013 a reduction of 26% in the number of low level "remember knowledge" domain questions was noted with up to an increase of 15% in "understanding" domain and 12% increase in the "applying" knowledge domain. Our findings highlight that it is possible to test, based in a laboratory, anatomy knowledge and application that is integrated and fit for practice. Anat Sci Educ. © 2014 American Association of Anatomists.

Objectives This study aimed to examine the validity and reliability of a Web-based version of the epidemiology of prolapse and incontinence questionnaire (EPIQ). Methods Participants included 876 women age 38 to 65 years attending primary care clinics in the Salt Lake Valley. Women completed a single Web- or paper-based version of the symptom bother questions from EPIQ, and a subset repeated the same or opposite method at 2 separate time points. To assess subscales for the Web-based version factor, analysis of the 22 EPIQ items related to pelvic floor disorder symptoms was performed using principal components analysis and varimax rotation. Internal consistency was assessed using coefficient α. Test-retest and intermethod reliability were assessed using intraclass correlation coefficients for domain scores. Correlations above 0.70 were considered acceptable. Results Overall, 384 and 492 women completed at least 1 Web and 1 paper EPIQ and 93% were white with mean age of 50 (7) years. Of these, 63 completed Web-Web, 57 Web-paper, 47 paper-Web, and 109 paper-paper test-retest. Overall, factor analyses were consistent with the 7 domains of the original EPIQ. Cronbach α for the 4 symptomatic pelvic floor disorder domains and range of test-retest reliability for the various administration methods were similar to the original EPIQ instrument. Correlations for domain scores were above 0.70, except the anal incontinence scale (intraclass correlation coefficients, 0.68.) Conclusions Web administration of the EPIQ has similar psychometric properties with comparable internal consistency and test-retest reliability when administered in the same modality. Reliability between both methods of administration is acceptable.

BackgroundSatisfactory psychometric properties in offline questionnaires do not guarantee the same outcome in Web-based versions. Any construct that is measured online should be compared to a paper-based assessment so that the appropriateness of online questionnaire data can be tested. Little research has been done in this area regarding Attention-Deficit/Hyperactivity Disorder (ADHD) in adults. ObjectiveThe objective was to simultaneously collect paper-based and Web-based ADHD questionnaire data in adults not diagnosed with ADHD in order to compare the two data sources regarding their equivalence in raw scores, in measures of reliability, and in factorial structures. MethodsData from the German versions of the Connors Adult ADHD Rating Scales (CAARS-S), the Wender Utah Rating Scale (WURS-k), and the ADHD Self Rating Scale (ADHS-SB) were collected via online and paper questionnaires in a cross-sectional study with convenience sampling. We performed confirmatory factor analyses to examine the postulated factor structures in both groups separately and multiple group confirmatory factor analyses to test whether the postulated factor structures of the questionnaires were equivalent across groups. With Cronbach alpha, we investigated the internal consistency of the postulated factors in the different questionnaires. Mann-Whitney U tests with the effect size “Probability of Superiority (PS)” were used to compare absolute values in the questionnaires between the two groups. ResultsIn the paper-based sample, there were 311 subjects (73.3% female); in the online sample, we reached 255 subjects (69% female). The paper-based sample had a mean age of 39.2 years (SD 18.6); the Web-based sample had a mean age of 30.4 years (SD 10.5) and had a higher educational background. The original four factor structure of the CAARS-S could be replicated in both samples, but factor loadings were different. The Web-based sample had significantly higher total scores on three scales. The five-factor structure of the German short form of the WURS-k could be replicated only in the Web-based sample. The Web-based sample had substantially higher total scores, and nearly 40% of the Web-based sample scored above the clinically relevant cut-off value. The three-factor structure of the ADHS-SB could be replicated in both samples, but factor loadings were different. Women in the Web-based sample had substantially higher total scores, and 30% of the Web-based sample scored above the clinically relevant cut-off value. Internal consistencies in all questionnaires were acceptable to high in both groups. ConclusionsData from the Web-based administration of ADHD questionnaires for adults should not be used for the extraction of population norms. Separate norms should be established for ADHD online questionnaires. General psychometric properties of ADHD questionnaires (factor structure, internal consistency) were largely unaffected by sampling bias. Extended validity studies of existing ADHD questionnaires should be performed by including subjects with a diagnosis of ADHD and by randomizing them to Web- or paper-based administration.

ObjectivesDysfunction after transient ischaemic attack (TIA) and minor stroke is often underestimated by clinical measures. Patient-reported outcome measures used in value-based healthcare may help in detecting these problems. The Patient-Reported Outcomes Measurement Information System 10-Question Short Form (PROMIS-10 Global Health) is a concise patient-centred outcome measuring tool proposed for assessing health status in patients who had stroke. This study aims to address the validity of the Dutch PROMIS-10 in patients who had stroke in the Netherlands and also aims to compare telephone versus on-paper assessment.DesignObservational cohort study.SettingSingle-centre hospital in the Netherlands.Participants75 patients who were diagnosed with TIA or minor stroke and discharged without rehabilitation treatment 1 year ago (between December 2014 and January 2016) completed the study.Primary and secondary outcome measuresPROMIS-10 physical (PH) and mental health (MH) scores assessed 1 year poststroke on paper (n=37) and by telephone (n=38) was compared with RAND-36 physical and mental component scores assessed on paper.ResultsPROMIS-10 and RAND-36 correlated significantly in PH, r=0.81 (95% CI 0.69 to 0.88), and MH, r=0.76 (95% CI 0.64 to 0.85). Paper-and-pencil assessed correlations were r=0.87 and 0.79 for PH and MH, respectively. Telephone assessed correlations were r=0.76 and 0.73 for PH and MH, respectively. Internal consistency analysis indicated high reliabilities for both health components of the PROMIS-10, all Cronbach’s α>0.70.ConclusionsThe Dutch PROMIS-10 was found to strongly correlate with the RAND-36. Paper-and-pencil assessment was found to have a higher correlation than telephone assessment. This study provides support for the use of the Dutch PROMIS-10 in assessing health status in patients after TIA and minor stroke.

Objective: The International Classification of Functioning and Disability (ICF) centres on participation as the ultimate outcome for persons with disabling conditions. In the ICF, participation is defined as involvement within a life situation and encompasses personal maintenance, mobility, information exchange, social relationships, home life, education, work and employment, economic life and community, social, and civic life. Children's participation needs to be considered in the context of school, home, and broader community environments. This study aimed to investigate the validity, reliability, sensitivity to change, feasibility, accessibility, and practicality of use of measurements of participation of primary school children with hemiplegia. Design: A systematic review. Method: Inclusion criteria: assessments that measure primary school aged children (5-13y) with cerebral palsy or physical disabilities AND participation (at least 30% content), but may also include activity and environmental factors. Exclusion criteria: papers not published in English that assess quality of life, impairments, communication, or interpersonal relationships. Three raters independently assessed all papers and reached consensus. Results: Systematic searching identified 17 assessments. Consensus agreement was reached for the Canadian Occupational Performance Measure (COPM); School Function Assessment (SFA);' Assessment of Life Habits (LIFE-H for children 1.0);2 Children's Assessment of Participation and Enjoyment(CAPE);3 Goal Attainment Scaling (GAS); and School Outcomes Assessment. The Children Helping Out: responsibilities, Expectations and Supports (CHORES) was selected by two of the raters. The CAPE, SFA, and LIFE-H were found to have the best clinimetric properties. The LIFE-H covers 13 life habit areas. Content validity is good and test retest reliability for most areas is adequate (ICC=O.314.74).* The SFA is judgement based, with specific assessment of participation in school. It has high internal consistency (coefficient alpha=0.924.98), excellent test retest reliability (ICC=0.824.98),and adequate interrater reliability (ICC=0.624.73).' Four studies have supported content and construct validity. The CAPE measures participation in non-school mandated activities. Test development and standardization indicates sufficient internal consistency (0.42 formal domain, 0.76 informal domain), test retest reliability (ICC=0.64-0.86) and validity3 Conclusion: The most suitable measures of participation for primary school children with hemiplegia are the CAPE and LIFE-H for home and broader community environments and the SFA for the school environment. The results of this review will further inform the outcome measures for the participation domain in a randomized trial of upper limb training in children with hemiplegia.

The purpose of this study was to test whether the web version is an alternative to the paper version of the short version of the World Health Organization Quality of Life assessment (WHOQOL-BREF). Two studies were conducted. Study 1 used crossover self-controlled trials with 80 participants to compare the web and paper versions and to determine the test–retest reliability of the web version. Study 2 used data from 1,016 web participants to analyze the internal consistency and concurrent and construct validity of the web version. The correlations of domain scores between the web and paper versions ranged from 0.71 to 0.85. Dependent t tests showed no significant differences in domain scores between these two versions. The intra-class correlation coefficients (ICC) for test–retest reliability of web version ranged from 0.79 to 0.91. The Cronbach’s α for internal consistency reliability ranged from 0.60 to 0.83. Multiple regression models indicated that the web version has good concurrent validity. Confirmatory factor analysis (CFA) for the second-order hierarchical factor model also supported the construct validity of the web version. The web version of the WHOQOL-BREF can be the alternative to the paper version for health-related quality of life (HR-QOL) evaluation.

This study reports results from a format comparison between Web-based and pencil and paper questionnaires measuring two well-validated measures of psychological distress among 530 frequent Internet users studying at an on-line University (Open University of Catalonia, UOC). A four-item version of the Perceived Stress Scale (PSS) and a seven-item version of the Center for Epidemiological Studies-Depression Scale (CESD) were randomly administered in Web-based and pencil and paper format. Internal consistency analyses showed that these two brief versions were reliable for on-line assessment. Also, no differences in Cronbach αs were found between formats. Exploratory as well as multigroup factor analysis techniques showed that factor structures were invariant across formats. Overall, results revealed that respondents did not bias their responses in the Web-based condition. As these findings suggest, when familiarity with technology is high among respondents and sample procedures are followed to maximize control for potential participants, Web-based and paper and pencil formats are virtually equivalent, as in the two brief measures of psychological distress used in this study.

This study assessed the degree of equivalence between paper and Internet administration of three measures of panic and agoraphobia-related cognition and behavior: Body Sensations Questionnaire (BSQ), Agoraphobic Cognitions Questionnaire (ACQ), and Mobility Inventory (MI). Participants were 110 people with panic disorder who had registered for an Internet-based treatment program in Sweden (n = 54) or Australia (n = 56). Participants were randomly assigned to complete the questionnaires via the differing administration formats in a counterbalanced order. Results showed broadly equivalent psychometric properties across administrations, with strong significant intraclass correlations between them, and comparable Cronbach's alpha coefficients. A significant mean difference between administration formats was found for the BSQ only. In contrast to previous research, Internet administration did not generate higher scores than paper administration. No effect was found for order of administration. The findings suggest that each questionnaire can be validly administered via the Internet and used with confidence.

PURPOSE The aim of this study was to determine whether two methods of documentation, print and electronic forms, for the assessment of patient-reported outcomes (PRO) in complete denture wearers provide comparable results. The study also quantified the time needed for filling the forms by each method. MATERIALS AND METHODS Thirty participants enrolled in a university clinic answered two forms (a questionnaire for denture satisfaction and OHIP-EDENT). They provided answers with two application methods in a random order, with a one-month interval between them: (1) electronic forms on a tablet computer; and (2) print forms. The methods were compared in terms of mean results, correlation/agreement, internal consistency, and spent time. RESULTS Mean results for both methods were similar for each denture satisfaction item (100-mm VAS) and OHIP-EDENT summary score. Both questionnaires presented good internal consistency regardless of the application method (Cronbach's α=0.86 or higher). Correlation and agreement between the methods regarding specific items was at least moderate for the majority of cases. Mean time for the electronic and print forms were 9.2 and 8.5 minutes, respectively (paired t test, P=.06, non-significant). CONCLUSION The electronic method is comparable to print forms for the assessment of important PRO of prosthetic treatment for edentulism, considering the results and time needed. Findings suggest the viability of replacing print forms with a tablet for applying the tested inventories in clinical trials.

In this study the internal consistency and predictive validity of the Paper and Pencil Games (PPG) Level 3 for a group of isiXhosa-speaking learners in Grade 4 were investigated. The internal consistency for the verbal, non-verbal and total scales was established by means of Cronbach's coefficient alpha. The internal consistency of the total and non-verbal scales was high and the internal consistency of the verbal scale notably lower. The predictive validity of the PPG was investigated by calculating Pearson correlation coefficients between the verbal, non-verbal and total scores of the PPG and achievement in the different school subjects and the overall achievement. The total scale of the PPG was the best predictor of achievement in English, Mathematics, Science, Geography, History and Health Science as well as overall achievement. The verbal scale was the best predictor of achievement in Afrikaans and the non-verbal scale of achievement in isiXhosa. Local norms in the form of stanines were also calculated for the group of isiXhosa-speaking learners.

This is the first in a short series of papers on measurement theory and practice with particular relevance to intervention research in nursing, midwifery, and healthcare. In this article I discuss reliability, its origins in classic measurement theory, important issues to consider when operationally defining reliability for a particular study, correlational procedures for assessing the reliability of data once collected, including test–retest reliability, split-half reliability, and Cronbach's coefficient α . Some important insights into reliability provided by attenuation theory are also offered.

A test measuring the behavioral aspects of the personality trait of persistence, The Persistent Effort Test, was constructed and psychometric properties assessed. The original version consisted of 12 items, each one a nonsense block of six letters. The task of 9 men and 9 women was to construct as many correct Swedish words as possible from letter combinations. The total time spent on this task and the number of correct words constituted the dependent variables. A Persistence Effort Quotient was calculated. The reliability calculated on the quotient for the 12-item version was acceptable (Cronbach alpha = .86) and an item analysis indicated that the test could be shortened by six items with increased reliability (Cronbach alpha =.87). A validity analysis also using the quotient performed with a second sample of subjects using classmates' ratings on two separate rating scales of specific aspects of persistence, yielded acceptable validity (Pearson r = .69 for the first scale and .71 for the second scale). This indicates that the shortened 6-item version is a reliable and valid test of persistence even though it is necessary with more studies to address the issues of predictive validity and norms for different groups of people.

Administration of psychological questionnaires via the Internet has gained popularity in recent years and touts many advantages. However, before questionnaires that were originally developed as paper-and-pencil measures can be confidently administered over the Internet, it is necessary to document the equivalence of the paper and computer-generated versions [American Psychological Association. (1986). Guidelines for computer-based tests and interpretations. Washington, DC: American Psychological Association; Cohen, R.J., Swerdlik, M.E., & Smith, D.K. (1992). Psychological testing and assessment (2nd ed.). Mountain View, CA: Mayfield Publishing; Cronbach, L.J. (1990). Essentials in psychological testing (5th ed.). New York: Harper Collins; Meier, S. (1994). The chronic crisis in psychological measurement and assessment: A historical survey. San Diego: Academic Press; Schulenberg, S.E., & Yutrzenka, B.A. (2001). Equivalence of computerized and conventional versions of the Beck Depression Inventory- II (BDI-II). Current Psychology: Developmental, Learning, Personality, Social, 20, 216-230]. The current study tested this equivalence for the Obsessive Compulsive Inventory [Foa, E.B., Kozak, M.J., Salkovskis, P.M, Coles, M.E., & Amir, N. (1998). The validation of a new obsessive compulsive disorder scale: The obsessive-compulsive inventory. Psychological Assessment, 10(3), 206-214] and the Obsessive Beliefs Questionnaire-44 [Obsessive Compulsive Cognitions Working Group. (2005). Psychometric validation of the obsessive belief questionnaire and interpretation of intrusions inventory-Part 2: Factor analyses and testing of a brief version. Behaviour Research and Therapy, 43, 1527-1543] in an unselected student sample. Study results support the equivalence of these measures of obsessive compulsive disorder (OCD) symptoms and beliefs independent of administration method (paper versus secure project website). These findings create new opportunities for conducting OCD-related research online.

In this paper we discuss some key issues involved in developing, validating, and reducing multi-item scales of paper and pencil measures. Specifically, we examine the importance of content validity, dimensionality, coefficient alpha, scale length, and item redundancy with a focus on the inter-relatedness of these psychometric properties. We also examine the viability of reduced-item scales and discuss some recent trends in self-report measures of marketing and consumer behavior-related constructs.