Search

Background: The commonly used ('legacy') PROMs evaluating outcomes of total hip arthroplasty (THA), have several limitations regarding their measurement properties and interpretation of scores. One innovation in PROMs is the use of Computerized Adaptive Testing (CAT). The Patient-Reported Outcomes Measurement Information System (PROMIS ® ) is a validated system of CATs. The aim of this study was to assess the measurement properties of PROMIS and legacy instruments in patients undergoing THA., Methodology: Patients in this multicenter study filled out a questionnaire twice, including Dutch-Flemish PROMIS v1.2 Physical Function (PROMIS-PF) and v1.1 Pain Interference (PROMIS-PI) CATs and short forms, PROMIS v1.0 Pain Intensity, and legacy PROMs (Hip disability and Osteoarthritis Outcome Score (HOOS), HOOS-Physical function Shortform (HOOS-PS), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Oxford Hip Score (OHS), and two numeric rating scales measuring pain). The reliability, measurement precision (Standard Error of Measurement (SEM)), smallest detectable change (SDC), and burden of PROMIS instruments were presented head-to-head to legacy PROMs. Furthermore, construct validity was assessed., Results: 208 patients were included. All instruments had a sufficient test-retest reliability (range ICC: 0.83-0.96). The SEM of PROMIS CATs and short forms ranged from 1.8 to 2.2 T-score points, the SEM of legacy instruments 2.6-11.1. The SDC of PROMIS instruments ranged from 2.1 to 7.3 T-score points, the SDC of legacy instruments 7.2-30.9. The construct validity of PROMIS CAT and short forms were found sufficient, except for the PROMIS-PI short form. The burden of PROMIS CATs was smaller than PROMIS short forms (range 4.8-5.2 versus 8-20 items, respectively). The burden of legacy instruments measuring physical functioning ranged from 5 to 40 items., Conclusions: The PROMIS-PF is less burdensome, with high measurement precision, and almost no minimal or maximal scores, and an equal reliability compared to legacy instruments measuring physical functioning in patients undergoing THA. The PROMIS Pain Intensity 1a is comparable to the legacy pain instruments in terms of burden, reliability and SDC. Measuring the construct Pain Interference may not have additional value in this population because of its high correlation with instruments measuring physical functioning. The SDC values presented in this study can be used for individual patient monitoring., (© 2024. The Author(s).)

Background: There is no gold standard patient-reported outcome measure (PROM) in hand surgery. As a result, a diverse array of PROM instruments have been utilized across centers over time. Lack of score interchangeability limits the ability to compare or conglomerate scores when new instruments are introduced. Our aim was to develop a linkage for the PROMIS UE CAT v1.2 and PROMIS PF CAT scores and develop crosswalk tables for interconversion between these PROMs., Methods: Retrospective review was conducted to identify adult (≥ 18y) patients seen by orthopaedic hand surgeons at a single academic tertiary care hospital who had completed PROMIS UE CAT v1.2 and PROMIS PF CAT score at the same visit. For those with multiple visits, only one randomly selected visit was included in the analyses. Pearson's correlation was calculated to determine the linear relationship between the scores. Linkage from PF to UE was performed utilizing several commonly utilized equating models (identity, mean, linear, equipercentile and circle-arc methods). The performance of the models was assessed using intraclass correlation (ICC) between observed PROMIS UE CAT v1.2 and estimated PROMIS UE CAT v1.2 scores generated using the model as well as Root Mean Square Error (RMSE). The model chosen as the 'best' was further assessed for population invariance using root expected mean squared difference (REMSD) where < 0.08 were considered good., Results: Of 10,081 included patients, mean age was 48.3 (SD = 17.0), and 54% were female (5,477/10,081). Mean UE CAT v1.2 and PF CAT scores were 37 (SD = 9.8) and 46 (SD = 10.0), respectively. There was a strong correlation between the scores (Pearson correlation r = 0.70). All methods performed acceptably (ICC ≥ 0.66 and RMSE < = 7.52 for all). The equipercentile method had the highest ICC (ICC = 0.70 (95% CI 0.69-0.71)) while the mean and circle arc methods had the lowest RMSE. The circle arc method is the most reliable with the smallest standard error and has satisfactory population invariance across age group (REMSD 0.065) and sex (REMSD 0.036)., Conclusions: Crosswalk tables to be used for bidirectional conversion between scores were created., Level of Evidence: III., (© 2024. The Author(s).)

Background: Given the variability of the questions asked, the Patient-Reported Outcomes Measurement Information System (PROMIS) upper extremity (UE) computer adaptive test (CAT) Version 2.0 item bank aids in the evaluation of rotator cuff repair (RCR) rehabilitation by determining when recovery milestones are possible based on the quality of patient responses at certain time points., Purpose: To assess the time point at which patients with RCR were able to achieve specific functional milestones, determined as positive responses to the 5 most frequently asked items on the PROMIS UE CAT Version 2.0., Study Design: Case series; Level of evidence, 4., Methods: The postoperative PROMIS UE CAT Version 2.0 scores of patients who underwent RCR between February 16, 2017, and July 30, 2019, were reviewed with respect to individual PROMIS item, response, and timing of response. A functional milestone was considered achieved if the patient response was "without any difficulty" or "with a little difficulty" to any of the 5 most frequently asked PROMIS items. The percentage of patients in each monthlong postoperative interval who answered with either response was recorded. The logit generalized estimating equations method was used to analyze the association between milestone achievement for each PROMIS item and predictor variables (age, sex, body mass index, smoking status, race, ethnicity, and employment status)., Results: A total of 1131 responses from 371 patients were included. The majority of patients attained milestone achievement on 4 of the 5 most frequently asked PROMIS items at time points ranging from 1 to 5 months postoperatively: "Are you able to carry a shopping bag or briefcase?" (by 1 month), "Are you able to put on and take off a coat or jacket?" (by 3 months), "Are you able to pour liquid from a bottle into a glass?" (by 3 months), and "Are you able to carry a heavy object (over 10 pounds/5 kg)?" (by 5 months). For the item "Are you able to put on a shirt or blouse?", the majority of patients did not achieve the milestone by 1 year., Conclusion: These findings support the application of PROMIS UE CAT Version 2.0 milestone achievement in the shared decision-making process and postoperative monitoring, as patients can use this information to determine when they can return to certain activities and providers can apply these standards to identify patients needing additional clinical support., Competing Interests: One or more of the authors has declared the following potential conflict of interest or source of funding: N.M. has received education payments from Medwest Associates. V.M. has received education payments from Arthrex, consulting fees from Pacira Pharmaceuticals, and hospitality payments from Smith & Nephew and Stryker. E.C.M. has received education payments from Endo Pharmaceuticals and Arthrex, consulting fees from Endo Pharmaceuticals and Smith & Nephew, nonconsulting fees from Smith & Nephew, and hospitality payments from Stryker. AOSSM checks author disclosures against the Open Payments Database (OPD). AOSSM has not conducted an independent investigation on the OPD and disclaims any liability or responsibility relating thereto. Ethical approval for this study was obtained from Henry Ford Health System (reference No. 11361)., (© The Author(s) 2024.)

Introduction: Patient-Reported Outcomes Measurement Information System (PROMIS) enables the use of computer adaptive testing (CAT). The aim of this prospective cohort study was to compare the most commonly used disease-specific instruments with PROMIS CAT questionnaires in patients with trauma., Methods: All patients with trauma (ages 18-75) who underwent an operative intervention for an extremity fracture between June 1, 2018, and June 30, 2019, were included. The disease-specific instruments were the Quick Disabilities of the Arm, Shoulder, and Hand for upper extremity fractures and the Lower Extremity Functional Scale (LEFS) for lower extremity fractures. Pearson's correlation (r) between the disease-specific instruments and the PROMIS CAT questionnaires (PROMIS Physical Function, PROMIS Pain Interference, and PROMIS Ability to Participate in Social Roles and Activities) was calculated at week 2, week 6, month 3, and month 6. Construct validity and responsiveness were calculated., Results: A total of 151 patients with an upper extremity fracture and 109 patients with a lower extremity fracture were included. At month 3 and month 6, the correlation was strong between the LEFS and PROMIS Physical Function (r = 0.88 and r = 0.90, respectively), and at month 3, the correlation was strong between the LEFS and PROMIS Social Roles and Activities (r = 0.72). At week 6, month 3, and month 6, there was a strong correlation between the Quick Disabilities of the Arm, Shoulder, and Hand and PROMIS Physical Function (r = 0.74, r = 0.70, and r = 0.76, respectively)., Conclusions: The PROMIS CAT measures are acceptably related to existing non-CAT instruments and may be a useful tool during follow-up after operative interventions for extremity fractures., (Copyright © 2023. Published by Elsevier Inc.)

Background: The Depression Anxiety Stress Scale 21 (DASS-21) is a mental health screening tool with conflicting studies regarding its factor structure. No studies have yet attempted to develop a computer adaptive test (CAT) version of it., Objective: This study calibrated items for, and simulated, a DASS-21 CAT using a nonclinical sample., Methods: An evaluation sample (n=580) was used to evaluate the DASS-21 scales via confirmatory factor analysis, Mokken analysis, and graded response modeling. A CAT was simulated with a validation sample (n=248) and a simulated sample (n=10,000) to confirm the generalizability of the model developed., Results: A bifactor model, also known as the "quadripartite" model (1 general factor with 3 specific factors) in the context of the DASS-21, displayed good fit. All scales displayed acceptable fit with the graded response model. Simulation of 3 unidimensional (depression, anxiety, and stress) CATs resulted in an average 17% to 48% reduction in items administered when a reliability of 0.80 was acceptable., Conclusions: This study clarifies previous conflicting findings regarding the DASS-21 factor structure and suggests that the quadripartite model for the DASS-21 items fits best. Item response theory modeling suggests that the items measure their respective constructs best between 0θ and 3θ (mild to moderate severity)., (©Jake Kraska, Karen Bell, Shane Costello. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 22.06.2023.)

Introduction: Patient-reported outcome measures (PROMs) are essential to patient-centered care in orthopaedics. PROMIS measures have demonstrated reliability, validity, responsiveness, and minimal floor and ceiling effects in various populations of patients receiving orthopaedic care but have not yet been examined in hip fracture patients. This pilot study sought to evaluate the psychometric performance of the PROMIS Physical Function (PROMIS PF) and Pain Interference (PROMIS PI) computer adaptive tests and compare these instruments with legacy outcome measures in hip fracture patients., Methods: This study included 67 patients who were 27-96 years old (median 76) and underwent osteosynthesis for a proximal femoral fracture. At 3, 6, and/or 12 months follow-up, patients completed both legacy (mHHS, SF-36-PCS, and VAS for pain) and PROMIS questionnaires (PROMIS PF and PROMIS PI). Respondent burden and floor/ceiling effects were calculated for each outcome measure. Correlation was calculated to determine concurrent validity between related constructs., Results: A strong correlation was found between PROMIS PF and mHHS (rho = 0.715, p < 0.001) and moderately strong correlation between PROMIS PF and SF-36 PCS (rho = 0.697, p < 0.001). There was also a moderately strong correlation between the VAS and the PROMIS PI (rho = 0.641, p < 0.001). Patients who completed PROMIS PF were required to answer significantly fewer questions as compared with legacy PROMs (mHHS, SF-36). For the PROMIS measures, 1% of patients completing PROMIS PF achieved the highest allowable score while 34% of patients completing PROMIS PI achieved the lowest allowable score. Of the legacy outcome measures, 31% of patients completing the VAS for pain achieved the lowest allowable score and 7% of patients completing the mHHS achieved the highest allowable score., Conclusions: The results of this study support the validity of PROMIS CATs for use in hip fracture patients. The PROMIS PF was significantly correlated with SF-36 PCS and mHHS while requiring fewer question items per patient relative to the legacy outcome measures., (© 2021. Springer-Verlag GmbH Germany, part of Springer Nature.)

Purpose: To examine trends in Patient-Reported Outcome Measurement Information System (PROMIS) scores among orthopedic sports medicine patients undergoing surgery who completed PROMIS forms both in the ambulatory (preoperative) setting at the time of surgical scheduling, as well as on the day of surgery (perioperative) prior to their procedure., Methods: Consecutive patients undergoing various sports medicine-related surgeries were recruited. Patients were included if they were scheduled for surgery and completed preoperative PROMIS on the day of surgical scheduling and on the day of surgery. Patients were excluded if they refused the questionnaire or had been administered perioperative anesthesia, which would interfere with questionnaire completion. Paired samples t-tests were run between preoperative and perioperative PROMIS scores to determine statistical significance., Results: 153 patients were included with an average age of 46.5 years. The average (SD) time between completion of PROMIS questionnaires was 46.5 (44.4) days. The absolute value change in scores between preoperative and perioperative visits was 4.09 for PROMIS UE, 3.59 for PROMIS PF, 3.67 for PROMIS PI, and 4.13 for PROMIS D. The overall net change of scores between preoperative and perioperative visits were -.57 for PROMIS UE CAT, .16 points for PROMIS PF CAT, -.85 points for PROMIS PI CAT, and -2.14 points for PROMIS D CAT. Statistically significant differences in preoperative and perioperative PROMIS PI (P =.042) and PROMIS D (P =.004) scores were found., Conclusions: Health states-as measured by PROMIS CAT forms completed among patients undergoing orthopedic surgery-can either improve or worsen preoperatively between the time of administration in both the ambulatory and perioperative setting. Despite the existence of these preoperative trends, it is important to consider patient and surgery-specific causes, such as the anatomic region, type of surgical intervention, and timing of preoperative PROMIS administration., Level of Evidence: III, prognostic., (Copyright © 2021. Published by Elsevier Inc.)

Objective: Sexual and gender minority youths are more likely to consider, attempt, and die by suicide than are heterosexual and cisgender youths, yet little is known about how to predict future attempts or transitions from suicidal thoughts to behaviors. Additionally, adaptive measurement of psychopathology is a promising approach that may help characterize risk in this population. This study examined the validity of the Computerized Adaptive Test for Suicide Scale (CAT-SS) in predicting suicide attempts and the transition from suicidal ideation to attempt., Methods: The CAT-SS was administered to participants of two ongoing cohort studies of sexual and gender minority adolescents and young adults (N=1,006). Survival analyses examined longitudinal associations between CAT-SS scores and time to suicide attempt. Analyses were conducted for the full sample and stratified by those with and without a history of suicidal ideation, with comparisons between adaptive and static measures of depressive symptoms., Results: The CAT-SS predicted future suicide attempts in the overall sample (hazard ratio [HR]=1.34, 95% confidence interval [CI]=1.03-1.74). Among youths without a history of suicidal ideation, social support reduced the risk for attempts (HR=0.66, 95% CI=0.45-0.96). Among youths with a history of ideation, predictors of the transition from suicidal thoughts to attempts included baseline CAT-SS score (HR=1.51, 95% CI=1.06-2.15) and victimization (HR=2.48, 95% CI=1.10-5.59)., Conclusions: Risk and protective factors for suicide attempts differed between youths with and without a history of suicidal thoughts. The CAT-SS had validity in predicting future risk of the sample overall and of youths with suicidal ideation.

Computer-adaptive tests use respondents' answers to previous questions to select the subsequent questions. They are gaining popularity for their increased measurement precision and decreased administration time compared to static questionnaires. The purpose of this study was to estimate the test-retest reliability and construct validity of the computer-adaptive test version of a participation measure, the Late Life Disability Instrument (LLDI-CAT) for people with COPD and to compare scores and administration time with those of the static LLDI. Among 76 older adults with COPD, scores on the LLDI-CAT were compared to scores on measures of related constructs, between groups based on symptom severity, prognosis and frailty phenotype, and to scores on the static LLDI. A subsample of 28 people completed the LLDI-CAT a second time within one week of the initial administration for test-retest reliability. The LLDI-CAT had very good test-retest reliability (ICC 2,1 0.88; SEM 2.74 points), fair correlations with physical function ( r  = 0.37-0.50), anxiety (r=-0.42), and depression (r=-0.50), fair to moderately-strong correlations with quality of life ( r  = 0.48-0.63), and strong correlation with the static LLDI limitation domain ( r  = 0.80). The LLDI-CAT scores differed between people with different symptom severity, prognosis and frailty phenotype ( p  ≤ 0.004). The mean administration time for the LLDI-CAT was 3.3 (1.5) minutes, less than that of the static LLDI at 6.3 (2.8) minutes ( p  < 0.001). The LLDI-CAT demonstrates evidence of test-retest reliability and construct validity, and correlates well with the limitation domain of the static LLDI for people with COPD. The LLDI-CAT can be used to assess participation for this population.

Objective: The 22-item PROMIS®-Rx Pain Medication Misuse item bank (Bank-22) imposes a high response burden. This study aimed to characterize the performance of the Bank-22 in a computer adaptive testing (CAT) setting based on varied stopping rules., Methods: The 22 items were administered to 288 patients. We performed a CAT simulation using default stopping rules (CATPROMIS). In 5 other simulations, a "best health" response rule was added to decrease response burden. This rule stopped CAT administration when a participant selected "never" to a specified number of initial Bank-22 items (2-6 in this study, designated CATAlt2-Alt6). The Bank-22 and 7-item short form (SF-7) scores were compared to scores based on CATPROMIS, and the 5 CAT variations., Results: Bank-22 scores correlated highly with the SF-7 and CATPROMIS, Alt5, Alt6 scores (r=0.87-0.95) and moderately with CATAlt2- Alt4 scores (r=0.63-0.74). In all CAT conditions, the greatest differences with Bank-22 scores were at the lower end of misuse T-scores. The smallest differences with Bank-22 and CATPROMIS scores were observed with CATAlt5 and CATAlt6. Compared to the SF-7, CATAlt5 and CATAlt6 reduced overall response burden by about 42%. Finally, the correlations between PROMIS-Rx Misuse and Anxiety T-scores remained relatively unchanged across the conditions (r=0.31-0.43, Ps < .001)., Conclusions: Applying a stopping rule based on number of initial "best health" responses reduced response burden for respondents with lower levels of misuse. The tradeoff was less measurement precision for those individuals, which could be an acceptable tradeoff when the chief concern is in discriminating higher levels of misuse., (© The Author(s) 2021. Published by Oxford University Press on behalf of the American Academy of Pain Medicine.All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.)

Background The Patient-Reported Outcomes Measurement Information System (PROMIS) was developed to provide measures of patient-reported symptoms and healthcare outcomes across a variety of conditions in an easily accessible manner. The purpose of this study was to validate PROMIS against traditional legacy measures in patients undergoing hip arthroscopy for femoral acetabular impingement (FAI). Methodology Outcome measures collected pre- and post-operatively included PROMIS Pain Interference (PI) and Physical Function (PF), modified Harris Hip Score (mHHS), Hip Outcome Score-Activities of Daily Living and Sport (HOS-ADL and HOS-Sport), Nonarthritic Hip Score (NAHS), and Visual Analog Scale (VAS). Pearson's correlation coefficients were calculated between each outcome measure. Results Strong correlations were observed between the PROMIS PF T-Score and the mHHS (r = 0.64-0.83, p < 0.0001), HOS-ADL (r = 0.54-0.81, p < 0.0001), HOS-Sport (r = 0.55-0.74, p < 0.0001), and NAHS (r = 0.61-0.78, p < 0.0001) measurement tools. PROMIS Computer Adaptive Testing PI T-Score and VAS also demonstrated a strong correlation (r = 0.64-0.80, p < 0.0001). Conclusions PROMIS PF scores correlate strongly with mHHS, HOS-ADL, HOS-Sport, and NAHS scores at all time points. Likewise, PROMIS PI scores correlate strongly with VAS pain scores. On average, patients completing PROMIS need to fill out only four or five questions. This study supports the use of PROMIS as an efficient, valid outcome tool for patients with FAI undergoing hip arthroscopy., Competing Interests: The authors have declared that no competing interests exist., (Copyright © 2021, Gerlach et al.)

Purpose: To develop ability levels and descriptions to interpret Pediatric Spinal Cord Injury Activity Measure (PEDI-SCI AM) and Pediatric Measure of Participation (PMoP) scores., Methods: Mixed-methods approach to 1.) create item maps using PEDI-SCI AM and PMoP calibration data; 2.) employ bookmarking methods and an iterative consensus process including semi-structured interviews, focus groups and surveys to establish PEDI-SCI AM and PMoP level score cut-points and descriptions; 3.) use calibration sample data to examine mean score differences across levels [analyses of variance (ANOVAs)] and assess the sample distribution (%) across levels; 4.) repeat in a separate validation sample; 5.) develop level descriptions. Throughout the mixed methods approach, the sample participants include children with spinal cord injury (SCI), parents of children with SCI, and professionals who work with children with SCI., Results: Four or five ability levels were identified for each PEDI-SCI AM and PMoP domain along with descriptions for each level. ANOVA results revealed significant overall differences for level mean scores and pairwise comparisons (p < 0.05). Consensus (>80%) was achieved for all PEDI-SCI AM and some PMoP level descriptions., Conclusion: PEDI-SCI AM and PMoP score cut-points identify different levels of activity and participation among children with SCI. These levels and descriptions provide clinical relevance for PEDI-SCI and PMoP numeric scores.

Background: Computerized adaptive test (CAT) questionnaires may allow standardization of patient-reported outcome measures and reductions in questionnaire burden. We evaluated the validity, accuracy, and efficacy of a CAT system in patients with end-stage osteoarthritis undergoing total knee arthroplasty., Methods: CAT Knee Osteoarthritis Outcome Scores (KOOS) and CAT KOOS-JR questionnaires were applied to 1871 standard form KOOS and 1493 KOOS-JR patient responses, respectively. Mean, standard deviations, Pearson's correlation coefficients, interclass correlation coefficients (ICCs), frequency distribution plots, and Bland-Altman plots were used to compare the precision, validity, and accuracy between CAT scores and full-form scores., Results: There was a mean reduction of 14 questions (33%) in the CAT KOOS and 1.4 questions (20%) with the CAT KOOS-JR version, compared with the standard KOOS and KOOS-JR surveys, respectively. There were no significant differences between KOOS and CAT KOOS scores with respect to pain (P = .66), symptoms (P = .43), quality of life (P = .99), activities of daily living (P = .68), and sports (P = .84). Similarly, there were no significant differences between the standard form KOOS-JR and CAT KOOS-JR scores (P = .94). There were strong correlations with minimal variability between the CAT KOOS and standard KOOS questionnaires for pain (r = 0.98, ICC: 0.98), symptoms (r = 0.97, ICC: 0.97), quality of life scores (r = 0.99, ICC: 0.99), activities of daily living scores (r = 0.99, ICC: 0.99), and sports scores (r = 0.99, ICC: 0.99). Similarly, there were strong correlations between the KOOS-JR and the CAT KOOS-JR scores (r = 0.99, ICC: 0.99)., Conclusion: CAT KOOS and the CAT KOOS-JR versions are accurate and reduce questionnaire burden up to one-third compared with standard surveys. CAT versions may improve patient compliance and decrease fatigue., (Copyright © 2020 Elsevier Inc. All rights reserved.)

Background: The use of multidomain developmental screening tools is a viable strategy for pediatric professionals to identify children at risk for developmental problems. However, a specialized multidimensional computer adaptive testing (MCAT) tool has not been developed to date., Objective: We developed an app using MCAT, combined with Multidimensional Screening in Child Development (MuSiC) for toddlers, to help patients and their family members or clinicians identify developmental problems at an earlier stage., Methods: We retrieved 75 item parameters from the MuSiC literature item bank for 1- to 3-year-old children, and simulated 1000 person measures from a normal standard distribution to compare the efficiency and precision of MCAT and nonadaptive testing (NAT) in five domains (ie, cognitive skills, language skills, gross motor skills, fine motor skills, and socioadaptive skills). The number of items saved and the cutoff points for the tool were determined and compared. We then developed an app for a Web-based assessment., Results: MCAT yielded significantly more precise measurements and was significantly more efficient than NAT, with 46.67% (=(75-40)/75) saving in item length when measurement differences less than 5% were allowed. Person-measure correlation coefficients were highly consistent among the five domains. Significantly fewer items were answered on MCAT than on NAT without compromising the precision of MCAT., Conclusions: Developing an app as a tool for parents that can be implemented with their own computers, tablets, or mobile phones for the online screening and prediction of developmental delays in toddlers is useful and not difficult., (©Chen-Fang Hsu, Tsair-Wei Chien, Julie Chi Chow, Yu-Tsen Yeh, Willy Chou. Originally published in JMIR Pediatrics and Parenting (http://pediatrics.jmir.org), 16.04.2020.)

Background: Probability-based computer algorithms that reduce patient burden are currently in high demand. These computer adaptive testing (CAT) methods improve workflow and reduce patient frustration, while achieving high measurement precision. In this study, we evaluated the accuracy and validity of the CAT Hip Disability and Osteoarthritis Outcome Score (HOOS) and the Hip Disability and Osteoarthritis Outcome Score Joint Replacement (HOOS-JR) by comparing them to the full version of these scoring systems in a subset of patients who had undergone total hip arthroplasties., Methods: A previously developed CAT HOOS and HOOS-JR was applied to 354 and 1547 HOOS and HOOS-JR patient responses, respectively. Mean, standard deviations, Pearson's correlation coefficients, interclass correlation coefficients, frequency distribution plots, and Bland-Altman plots were used to compare the precision, validity, and accuracy between CAT scores and full-form scores., Results: By modifying the questions to past responses, the CAT HOOS demonstrated a mean reduction of 30% of questions (28 vs 40 questions). There were no significant differences between the full HOOS and CAT HOOS with respect to pain (P = .73), symptoms (P = .94), quality of life (P = .99), activities of daily living (P = .82), and sports (P = .99). There were strong linear relationships between the CAT versions and the standard questionnaires (r > 0.99). The Bland-Altman plot showed that differences between CAT HOOS and full HOOS were independent of the overall scores., Conclusion: The CAT HOOS and HOOS-JR have high correlation and require fewer questions to finish compared to the standard full-form questionnaires. This may represent a reliable and practical alternative that may be less burdensome to patients and may help improve compliance for reporting outcome metrics., (Copyright © 2019 Elsevier Inc. All rights reserved.)

The standard error ( SE ) stopping rule, which terminates a computer adaptive test (CAT) when the SE is less than a threshold, is effective when there are informative questions for all trait levels. However, in domains such as patient reported outcomes, the items in a bank might all target one end of the trait continuum (e.g., negative symptoms), and the bank may lack depth for many individuals. In such cases, the predicted standard error reduction (PSER) stopping rule will stop the CAT even if the SE threshold has not been reached, and can avoid administering excessive questions that provide little additional information. By tuning the parameters of the PSER algorithm, a practitioner can specify a desired tradeoff between accuracy and efficiency . Using simulated data for the PROMIS Anxiety and Physical Function banks, we demonstrate that these parameters can substantially impact CAT performance. When the parameters were optimally tuned, the PSER stopping rule was found to outperform the SE stopping rule overall and particularly for individuals not targeted by the bank, and presented roughly the same number of items across the trait continuum. Therefore, the PSER stopping rule provides an effective method for balancing the precision and efficiency of a CAT.

Functional assessment of patients with osteosarcoma may yield unique insights into the guide and advance treatment. A range of patient-reported outcomes has been validated, including general health and condition-specific measures as well as computer adaptive testing. Health state utility measures, which facilitate comparative-effectiveness research, are also available. Beyond these surveys, and laboratory-dependent gait analyses, is the potential for real-world evaluation through research-oriented and consumer-oriented accelerometers. Initial studies have shown promising validity of these activity trackers and may also have implications for traditional oncologic outcomes.

Background: To date, the computerized adaptive testing (CAT) version of the Neuro-quality of life (QOL) has not been assessed in a large sample of people with multiple sclerosis (MS)., Objective: The aim of this study was to assess the associations between the CAT version of Neuro-QOL and other clinical and patient-reported outcome measures., Methods: Subjects ( n  = 364) enrolled in SysteMS completed the CAT version of the Neuro-QOL and the 36-Item Short Form Survey (SF-36) within 4 weeks of a clinical exam that included the Multiple Sclerosis Functional Composite-4 (MSFC-4). The correlations between the Neuro-QOL domains and the MSFC-4 subscores and the SF-36 scores were calculated. The changes over time in the Neuro-QOL and other measures were also examined., Results: The lower extremity functioning score of the Neuro-QOL showed the highest correlations with MSFC-4 components including Timed 25-Foot Walk, 9-Hole Peg Test, and cognitive score. The expected domains of the Neuro-QOL showed high correlations with the SF-36 subscores, and some Neuro-QOL domains were associated with many SF-36 subscores. There was limited longitudinal change on the Neuro-QOL domains over 12 months, and the change was not associated with change on other measures., Conclusion: The CAT version of the Neuro-QOL shows many of the expected associations with clinical and patient-reported outcome measures.

A substantial body of work supports the existence of a general psychopathology factor ("p"). Psychometrically, this is important because it implies that there is a psychological phenomenon (overall psychopathology) that can be measured and potentially used in clinical research or treatment. The present study aimed to construct, calibrate, and begin to validate a computerized adaptive (CAT) screener for "p". In a large community sample (N = 4544; age 11-21), we modeled 114 clinical items using a bifactor multidimensional item response theory (MIRT) model and constructed a fully functional (and public) CAT for assessing "p" called the Overall mental illness (OMI) screener. In a random, non-overlapping sample (N = 1019) with extended phenotyping (neuroimaging) from the same community cohort, adaptive versions of the OMI screener (10-, 20-, and 40-item) were simulated and compared to the full 114-item test in their ability to predict demographic characteristics, common mental disorders, and brain parameters. The OMI screener performed almost as well as the full test, despite being only a small fraction of the length. For prediction of 13 mental disorders, the mid-length (20-item) adaptive version showed mean area under the receiver operating characteristic curve of 0.76, compared to 0.79 for the full version. For prediction of brain parameters, mean absolute standardized relationship was 0.06 for the 20-item adaptive version, compared to 0.07 for the full form. This brief, public tool may facilitate the rapid and accurate measurement of overall psychopathology in large-scale studies and in clinical practice., (Copyright © 2019. Published by Elsevier Ltd.)

This article discusses measuring quality of life (QOL) loss in litigation. Case examples are provided. The complexity challenge in QOL assessment is more easily addressed since the advent of computer adaptive testing, which is used by physicians and rehabilitationists in the administration of psychometric instruments to determine QOL loss. It is now possible to write algorithms to capture QOL data through text-mining. If QOL domains and their factors could be accessed through text-mining, it would make for an extraordinary opportunity for much needed doctoral level research in QOL issues for injured workers in workers' compensation programs., (Copyright © 2019 Elsevier Inc. All rights reserved.)

An important consideration of any computer adaptive testing (CAT) program is the criterion used for ending item administration-the stopping rule, which ensures that all examinees are assessed to the same standard. Although various stopping rules exist, none of them have been compared under the generalized partial-credit model (Muraki in Applied Psychological Measurement, 16, 159-176, 1992). In this simulation study we compared the performance of three variable-length stopping rules-standard error (SE), minimum information (MI), and change in theta (CT)-both in isolation and in combination with requirements of minimum and maximum numbers of items, as well as a fixed-length stopping rule. Each stopping rule was examined under two termination criteria-one a more lenient requirement (SE = 0.35, MI = 0.56, CT = 0.05), and one more stringent (SE = 0.30, MI = 0.42, CT = 0.02). The simulation design also included content-balancing and exposure controls, aspects of CAT that have been excluded in previous research comparing variable-length stopping rules. The minimum-information stopping rule produced biased theta estimates and varied greatly in measurement quality across the theta distribution. The absolute-change-in-theta stopping rule had strong performance when paired with a lower criterion and a minimum test length. The standard error stopping rule consistently provided the best balance of measurement precision and operational efficiency and was based on the fewest number of administered items necessary to obtain accurate and precise theta estimates, particularly when it was paired with a maximum-number-of-items stopping rule.

Background: With the increasingly rapid growth of the elderly population, individuals aged 65 years and above now compose 14% of Taiwanese citizens, thereby making Taiwanese society an aged society. A leading factor that affects the elderly population is dementia. A method of precisely and efficiently examining patients with dementia through multidimensional computer adaptive testing (MCAT) to accurately determine the patients' stage of dementia needs to be developed. This study aimed to develop online MCAT that family members can use on their own computers, tablets, or smartphones to predict the extent of dementia for patients responding to the Clinical Dementia Rating (CDR) instrument., Methods: The CDR was applied to 366 outpatients in a hospital in Taiwan. MCAT was employed with parameters for items across eight dimensions, and responses were simulated to compare the efficiency and precision between MCAT and non-adaptive testing (NAT). The number of items saved and the estimated person measures was compared between the results of MCAT and NAT, respectively., Results: MCAT yielded substantially more precise measurements and was considerably more efficient than NAT. MCAT achieved 20.19% (= [53 - 42.3]/53) saving in item length when the measurement differences were less than 5%. Pearson correlation coefficients were highly consistent among the eight domains. The cut-off points for the overall measures were - 1.4, - 0.4, 0.4, and 1.4 logits, which was equivalent to 20% for each portion in percentile scores. Substantially fewer items were answered through MCAT than through NAT without compromising the precision of MCAT., Conclusions: Developing a website that family members can use on their own computers, tablets, and smartphones to help them perform online screening and prediction of dementia in older adults is useful and manageable., Competing Interests: Competing interestsThe authors declare that they have no competing interests.

Internet addiction disorder has become one of the most popular forms of addiction in psychological and behavioral areas, and measuring it is growing increasingly important in practice. This study aimed to develop a computerized adaptive testing to measure and assess internet addiction (CAT-IA) efficiently. Four standardized scales were used to build the original item bank. A total of 59 polytomously scored items were finally chosen after excluding 42 items for failing the psychometric evaluation. For the final 59-item bank of CAT-IA, two simulation studies were conducted to investigate the psychometric properties, efficiency, reliability, concurrent validity, and predictive validity of CAT-IA under different stopping rules. The results showed that (1) the final 59 items met IRT assumptions, had high discrimination, showed good item-model fit, and were without DIF; and (2) the CAT-IA not only had high measurement accuracy in psychometric properties but also sufficient efficiency, reliability, concurrent validity, and predictive validity. The impact and limitations of CAT-IA were discussed, and several suggestions for future research were provided.

Purpose: The current study compares the Patient Reported Outcomes Information System Physical Function Computer Adaptive Test (PROMIS PF CAT) to traditional knee PRO instruments in a healthy population undergoing surgery for ACL injuries with the following objectives: (1) identify and determine the strength of any correlations between the scores of PROMIS PF CAT and current knee PROs or their subscales that measure physical function; (2) evaluate PROMIS PF CAT's test burden; and (3) determine if PROMIS PF CAT has any floor or ceiling effects in this population., Methods: Patients indicated for ACL surgery completed the Short Form-36 Physical Function (SF-36 PF), Knee Injury and Osteoarthritis Outcome Score (KOOS), Marx Knee Activity Rating Scale (Marx), the EuroQol 5-dimensions Questionnaire (EQ-5D), and PROMIS PF CAT. Correlations between PROs were defined as follows: High (≥ 0.7); high-moderate (0.61-0.69); moderate (0.4-0.6); moderate-weak (0.31-0.39); and weak (≤ 0.3). Floor or ceiling effects were considered significant if 15% or more patients reported the lowest or highest possible total score, respectively., Results: 100 patients participated with a mean age of 26 years (range 11-57). The PROMIS PF CAT demonstrated high correlations with SF-36 PF (r = 0.82, p < 0.01), EQ-5D (r = - 0.70, p < 0.01) KOOS ADL (r = 0.74, p < 0.01), and KOOS Sport (r = 0.70, p < 0.01). There were no ceiling or floor effects for PROMIS PF CAT (0%). The mean number of items completed for the PROMIS PF CAT was 4.2 (median 4; range 4-11)., Conclusions: The PROMIS PF CAT shows a high correlation with commonly employed PROs that also measure physical function with low test burden and without ceiling effects in this relatively young and healthy population.

Outcome measures evaluate various aspects of patient health, and when appropriately utilized can provide valuable information in both clinical practice and research settings. The orthopedic community has placed increasing emphasis on patient-reported outcome measures, recognizing their value for understanding patients' perspectives of treatment outcomes. Patient-reported outcomes are information directly reported by patients regarding their perceptions of health, quality of life, or functional status without interpretation by healthcare providers. The American Orthopaedic Foot & Ankle Society (AOFAS) supports the use of validated patient-reported outcome (PRO) instruments to assess patient general health, functional status, and outcomes of treatment. It is not possible to recommend a single instrument to collect quality orthopedic data as the selection is dependent on the population being examined and the question being asked. We support the use of the PROMIS Physical Function Computerized Adaptive Test (PF CAT) or Lower Extremity Computerized Adaptive Test (LE CAT), which can be assessed with other domains such as Pain Interference. In addition, a disease-specific measure can be used when available.

Delay discounting has been linked to important behavioral, health, and social outcomes, including academic achievement, social functioning and substance use, but thoroughly measuring delay discounting is tedious and time consuming. We develop and consistently validate an efficient and psychometrically sound computer adaptive measure of discounting. First, we develop a binary search-type algorithm to measure discounting using a large international data set of 4,190 participants. Using six independent samples ( N = 1,550), we then present evidence of concurrent validity with two standard measures of discounting and a measure of discounting real rewards, convergent validity with addictive behavior, impulsivity, personality, survival probability; and divergent validity with time perspective, life satisfaction, age and gender. The new measure is considerably shorter than standard questionnaires, includes a range of time delays, can be applied to multiple reward magnitudes, shows excellent concurrent, convergent, divergent, and discriminant validity-by showing more sensitivity to effects of smoking behavior on discounting.

Purpose: This pilot study evaluated the outcomes of tendon Achilles lengthening in 12 children (mean age: 11.2 years) with spastic hemiplegia., Methods: Cerebral Palsy Computer Adaptive Tests, the timed up-and-go, the Gross Motor Function Measure, the Gillette Functional Assessment Questionnaire, and the Pediatric Outcomes Data Collection Instrument were administered at baseline and at 6, 12, and 24 months postsurgery., Results: Significant improvement at the latest follow-up (12-24 months following surgery) was seen in all domains of the Cerebral Palsy Computer Adaptive Test: activity ( P = .017), lower extremity ( P = .005), global ( P = .005), pain ( P = .005), and fatigue ( P = .028), as well as in the Gross Motor Function Measure-D domain ( P = .02) and the mobility domain of the Pediatric Outcomes Data Collection Instrument ( P = .04)., Conclusion: These findings indicate that the tendon Achilles lengthening improved functional outcome in these children as measured by tests of physical function, walking speed, and activity performance., Competing Interests: Declaration of Conflicting Interests: The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Purpose: To evaluate the degree to which applying alternative stopping rules would reduce response burden while maintaining score precision in the context of computer adaptive testing (CAT)., Data: Analyses were conducted on secondary data comprised of CATs administered in a clinical setting at multiple time points (baseline and up to two follow ups) to 417 study participants who had back pain (51.3%) and/or depression (47.0%). Participant mean age was 51.3 years (SD = 17.2) and ranged from 18 to 86. Participants tended to be white (84.7%), relatively well educated (77% with at least some college), female (63.9%), and married or living in a committed relationship (57.4%). The unit of analysis was individual assessment histories (i.e., CAT item response histories) from the parent study. Data were first aggregated across all individuals, domains, and time points in an omnibus dataset of assessment histories and then were disaggregated by measure for domain-specific analyses. Finally, assessment histories within a "clinically relevant range" (score ≥ 1 SD from the mean in direction of poorer health) were analyzed separately to explore score level-specific findings., Method: Two different sets of CAT administration rules were compared. The original CAT (CAT ORIG ) rules required at least four and no more than 12 items be administered. If the score standard error (SE) reached a value < 3 points (T score metric) before 12 items were administered, the CAT was stopped. We simulated applying alternative stopping rules (CAT ALT ), removing the requirement that a minimum four items be administered, and stopped a CAT if responses to the first two items were both associated with best health, if the SE was < 3, if SE change < 0.1 (T score metric), or if 12 items were administered. We then compared score fidelity and response burden, defined as number of items administered, between CAT ORIG and CAT ALT ., Results: CAT ORIG and CAT ALT scores varied little, especially within the clinically relevant range, and response burden was substantially lower under CAT ALT (e.g., 41.2% savings in omnibus dataset)., Conclusions: Alternate stopping rules result in substantial reductions in response burden with minimal sacrifice in score precision.

Background: Challenges exist in routinely collecting patient-reported outcomes (PROs) from patients at a busy ambulatory clinic. A number of validated Patient-Reported Outcomes Measurement Information System (PROMIS) subdomains allow for efficient PRO administration., Purpose: To determine the time to completion (TTC) of 3 PROMIS computer adaptive test (CAT) scores. CAT questionnaires were administered at the ambulatory clinic with the following PROMIS subdomains: Pain Interference (PI), Depression, and Physical Function for lower extremity (PF) or for upper extremity (UE). The secondary purpose was to determine the influence of patient demographic factors on TTC., Study Design: Cross-sectional study; Level of evidence, 3., Methods: Patients were recruited from 3 fellowship-trained upper extremity and sports medicine orthopaedic surgery clinics. PROMIS CAT questionnaires were administered to consecutive patients during the study period (July 2017-September 2017). The start and completion times of each CAT were recorded. The primary outcome of interest was TTC of the questionnaires. Patients were stratified into age quartiles to determine the impact of age on TTC. Patient demographic information, such as sex, race, and ethnicity, was determined retroactively., Results: A total of 1178 questionnaire sets consisting of 3658 individual PROMIS forms were analyzed. The mean TTC was 3.29 minutes for all 4 forms in aggregate, with PROMIS PI, PF, UE, and Depression taking on average 1.05, 0.74, 0.96, and 0.57 minutes to complete, respectively. Patients from the oldest age quartile (mean ± SD, 70.3 ± 7.5 years) had a statistically significant longer TTC as compared with the second quartile (41.2 ± 4.7 years) (3.70 vs 2.87 minutes; P < .05). Asian patients had the longest PROMIS PF TTC, while white patients completed PF with the shortest TTC (1.28 vs 0.68 minutes; P < .05). Patients of unstated ethnicity had a longer TTC for PF as compared with their Hispanic/Latino and non-Hispanic/Latino counterparts (0.91 vs 0.30 and 0.70 minutes; P < .05)., Conclusion: PROMIS CAT forms are efficient tools for collecting patient-reported outcomes in the ambulatory orthopaedic surgery clinic. Older patients, Asian patients, and patients of unstated ethnicity took longer to complete the forms., Competing Interests: One or more of the authors has declared the following potential conflict of interest or source of funding: S.M. is a paid consultant for DePuy and Exactech; has received educational support from Arthrex; and has received hospitality payments from DePuy Synthes, Zimmer Biomet Holdings, Biomet Orthopedics, Exactech, Tornier, Conventus Orthopaedics, and Arthrex. V.M. has received hospitality payments from Stryker and Pinnacle and educational support from Arthrex and Pinnacle. E.C.M. receives royalties from Springer, has received educational support from Pinnacle and Smith & Nephew, and has received hospitality payments from Smith & Nephew and Stryker.

Aims: Outcome measures quantifying aspects of health in a precise, efficient, and user-friendly manner are in demand. Computer adaptive tests (CATs) may overcome the limitations of established fixed scales and be more adept at measuring outcomes in trauma. The primary objective of this review was to gain a comprehensive understanding of the psychometric properties of CATs compared with fixed-length scales in the assessment of outcome in patients who have suffered trauma of the upper limb. Study designs, outcome measures and methodological quality are defined, along with trends in investigation., Materials and Methods: A search of multiple electronic databases was undertaken on 1 January 2017 with terms related to "CATs", "orthopaedics", "trauma", and "anatomical regions". Studies involving adults suffering trauma to the upper limb, and undergoing any intervention, were eligible. Those involving the measurement of outcome with any CATs were included. Identification, screening, and eligibility were undertaken, followed by the extraction of data and quality assessment using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) criteria. The review is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria and reg istered (PROSPERO: CRD42016053886)., Results: A total of 31 studies reported trauma conditions alone, or in combination with non-traumatic conditions using CATs. Most were cross-sectional with varying level of evidence, number of patients, type of study, range of conditions and methodological quality. CATs correlated well with fixed scales and had minimal or no floor-ceiling effects. They required significantly fewer questions and/or less time for completion. Patient-Reported Outcomes Measurement Information System (PROMIS) CATs were the most frequently used, and the use of CATs is increasing., Conclusion: Early studies show valid and reliable outcome measurement with CATs performing as well as, if not better than, established fixed scales. Superior properties such as floor-ceiling effects and ease of use support their use in the assessment of outcome after trauma. As CATs are being increasingly used in patient outcomes research, further psychometric evaluation, especially involving longitudinal studies and groups of patients with specific injuries are required to inform clinical practice using these contemporary measures. Cite this article: Bone Joint J 2018;100-B:693-702.

This study developed and validated a short form (SF) using activities of daily living (ADL) outcome measures from the Korea National Health and Nutrition Examination Survey (KNHANES) that can minimize survey administration burden for clinicians. This study utilized secondary data from the 2005 KNHANES with 422 community-dwelling stroke survivors. The KNHANES data were collected from April to June 2005 in South Korea. We created a 7-item SF from the 17 ADL questions in the survey using item response theory (IRT) methodologies. The precision and validity of the SF were compared to the full questionnaire of ADL items and the EuroQol-5D total score. Among the 17 ADL questions, 14 questions demonstrated unidimensional construct validity. Using IRT methodologies, a set of 7 items were selected from the full bank. The 7-item SF demonstrated good psychometric properties: high correlation with the full bank ( r = .975, p < .001), good internal consistency (Cronbach's α = .93), and a high correlation with the EuroQol-5D total score ( r = .678, p < .001). These findings indicate that a well-developed SF can precisely measure ADL performance capacity for stroke survivors compared to the full item bank, which is expected to reduce the administration burden of the KNHANES.

Background: The Patient-Reported Outcomes Measurement Information System (PROMIS) consists of question banks for health domains through computer adaptive testing (CAT)., Hypothesis: For patients with glenohumeral arthritis, (1) there would be high correlation between traditional patient-reported outcome (PRO) measures and the PROMIS upper extremity item bank (PROMIS UE) and PROMIS physical function CAT (PROMIS PF CAT), and (2) PROMIS PF CAT would not demonstrate ceiling effects., Study Design: Cohort study (diagnosis); Level of evidence, 3., Methods: Sixty-one patients with glenohumeral osteoarthritis were included. Each patient completed the American Shoulder and Elbow Surgeons (ASES) assessment form, Marx Shoulder Activity Scale, Short Form-36 physical function scale (SF-36 PF), EuroQol 5 Dimensions (EQ-5D) questionnaire, Western Ontario Osteoarthritis Shoulder (WOOS) index, PROMIS PF CAT, and the PROMIS UE. Correlation was defined as high (>0.7), moderate (0.4-0.6), or weak (0.2-0.3). Significant floor and ceiling effects were present if more than 15% of individuals scored the lowest or highest possible total score on any PRO., Results: The PROMIS PF demonstrated excellent correlation with the SF-36 PF ( r = 0.81, P < .0001) and good correlation with the ASES ( r = 0.62, P < .0001), EQ-5D ( r = 0.64, P < .001), and WOOS index ( r = 0.51, P < .01). The PROMIS PF demonstrated low correlation with the Marx scale ( r = 0.29, P = .02). The PROMIS UE demonstrated good correlation with the ASES ( r = 0.55, P < .0001), SF-36 ( r = 0.53, P < .01), EQ-5D ( r = 0.48, P < .01), and WOOS ( r = 0.34, P <.01), and poor correlation with the Marx scale ( r = 0.06, P = .62). There were no ceiling or floor effects observed. The mean number of items administered by the PROMIS PRO was 4., Conclusion: These data suggest that for a patient population with operative shoulder osteoarthritis, PROMIS UE and PROMIS PF CAT may be valid alternative PROs. Additionally, PROMIS PF CAT offers a decreased question burden with no ceiling effects., Competing Interests: One or more of the authors has declared the following potential conflict of interest or source of funding: C.M.H. receives research support from Tornier.

Objective: The Patient Reported Outcomes Measurement Information System (PROMIS) initiative developed an array of patient reported outcome (PRO) measures. To reduce the number of questions administered, PROMIS utilizes unidimensional item response theory and unidimensional computer adaptive testing (UCAT), which means a separate set of questions is administered for each measured trait. Multidimensional item response theory (MIRT) and multidimensional computer adaptive testing (MCAT) simultaneously assess correlated traits. The objective was to investigate the extent to which MCAT reduces patient burden relative to UCAT in the case of PROs., Methods: One MIRT and 3 unidimensional item response theory models were developed using the related traits anxiety, depression, and anger. Using these models, MCAT and UCAT performance was compared with simulated individuals., Results: Surprisingly, the root mean squared error for both methods increased with the number of items. These results were driven by large errors for individuals with low trait levels. A second analysis focused on individuals aligned with item content. For these individuals, both MCAT and UCAT accuracies improved with additional items. Furthermore, MCAT reduced the test length by 50%., Discussion: For the PROMIS Emotional Distress banks, neither UCAT nor MCAT provided accurate estimates for individuals at low trait levels. Because the items in these banks were designed to detect clinical levels of distress, there is little information for individuals with low trait values. However, trait estimates for individuals targeted by the banks were accurate and MCAT asked substantially fewer questions., Conclusion: By reducing the number of items administered, MCAT can allow clinicians and researchers to assess a wider range of PROs with less patient burden., (© The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com)

Computer adaptive testing (CAT) is a kind of tailored testing, in that it is a form of computer-based testing that is adaptive to each test-taker's ability level. In this review, the impacts of CAT are discussed from different perspectives in order to illustrate crucial points to keep in mind during the development and implementation of CAT. Test developers and psychometricians often emphasize the efficiency and accuracy of CAT in comparison to traditional linear tests. However, many test-takers report feeling discouraged after taking CATs, and this feeling can reduce learning self-efficacy and motivation. A trade-off must be made between the psychological experiences of test-takers and measurement efficiency. From the perspective of educators and subject matter experts, nonstatistical specifications, such as content coverage, content balance, and form length are major concerns. Thus, accreditation bodies may be faced with a discrepancy between the perspectives of psychometricians and those of subject matter experts. In order to improve test-takers' impressions of CAT, the author proposes increasing the target probability of answering correctly in the item selection algorithm even if doing so consequently decreases measurement efficiency. Two different methods, CAT with a shadow test approach and computerized multistage testing, have been developed in order to ensure the satisfaction of subject matter experts. In the shadow test approach, a full-length test is assembled that meets the constraints and provides maximum information at the current ability estimate, while computerized multistage testing gives subject matter experts an opportunity to review all test forms prior to administration.

The current paper describes new opportunities for patient-centred assessment methods which have come about by the increased adoption of affordable smart technologies in biopsychosocial research and medical care. In this commentary, we review modern assessment methods including item response theory (IRT), computer adaptive testing (CAT), and ecological momentary assessment (EMA) and explain how these methods may be combined to improve psychological assessment. We demonstrate both how a 'naïve' selection of a small group of items in an EMA can lead to unacceptably unreliable assessments and how IRT can provide detailed information on the individual information that each item gives thus allowing short form assessments to be selected with acceptable reliability. The combination of CAT and IRT can ensure assessments are precise, efficient, and well targeted to the individual; allowing EMAs to be both brief and accurate.

Introduction: In this study we evaluated the suitability of a caregiver-reported functional measure, the Pediatric Evaluation of Disability Inventory-Computer Adaptive Test (PEDI-CAT), for children and young adults with spinal muscular atrophy (SMA)., Methods: PEDI-CAT Mobility and Daily Activities domain item banks were administered to 58 caregivers of children and young adults with SMA. Rasch analysis was used to evaluate test properties across SMA types., Results: Unidimensional content for each domain was confirmed. The PEDI-CAT was most informative for type III SMA, with ability levels distributed close to 0.0 logits in both domains. It was less informative for types I and II SMA, especially for mobility skills. Item and person abilities were not distributed evenly across all types., Conclusions: The PEDI-CAT may be used to measure functional performance in SMA, but additional items are needed to identify small changes in function and best represent the abilities of all types of SMA. Muscle Nerve 54: 1097-1107, 2016., (© 2016 Wiley Periodicals, Inc.)

Background: The National Health Service (NHS) 70-item inpatient questionnaire surveys inpatients on their perceptions of their hospitalization experience. However, it imposes more burden on the patient than other similar surveys. The literature shows that computerized adaptive testing (CAT) based on item response theory can help shorten the item length of a questionnaire without compromising its precision., Objective: Our aim was to investigate whether CAT can be (1) efficient with item reduction and (2) used with quick response (QR) codes scanned by mobile phones., Methods: After downloading the 2008 inpatient survey data from the Picker Institute Europe website and analyzing the difficulties of this 70-item questionnaire, we used an author-made Excel program using the Rasch partial credit model to simulate 1000 patients' true scores followed by a standard normal distribution. The CAT was compared to two other scenarios of answering all items (AAI) and the randomized selection method (RSM), as we investigated item length (efficiency) and measurement accuracy. The author-made Web-based CAT program for gathering patient feedback was effectively accessed from mobile phones by scanning the QR code., Results: We found that the CAT can be more efficient for patients answering questions (ie, fewer items to respond to) than either AAI or RSM without compromising its measurement accuracy. A Web-based CAT inpatient survey accessed by scanning a QR code on a mobile phone was viable for gathering inpatient satisfaction responses., Conclusions: With advances in technology, patients can now be offered alternatives for providing feedback about hospitalization satisfaction. This Web-based CAT is a possible option in health care settings for reducing the number of survey items, as well as offering an innovative QR code access.

Background: Response burden is a major detriment to questionnaire completion rates. Computer adaptive testing may offer advantages over non-adaptive testing, including reduction of numbers of items required for precise measurement., Objective: Our aim was to compare the efficiency of non-adaptive (NAT) and computer adaptive testing (CAT) facilitated by Partial Credit Model (PCM)-derived calibration to estimate skin cancer risk., Methods: We used a random sample from a population-based Australian cohort study of skin cancer risk (N=43,794). All 30 items of the skin cancer risk scale were calibrated with the Rasch PCM. A total of 1000 cases generated following a normal distribution (mean [SD] 0 [1]) were simulated using three Rasch models with three fixed-item (dichotomous, rating scale, and partial credit) scenarios, respectively. We calculated the comparative efficiency and precision of CAT and NAT (shortening of questionnaire length and the count difference number ratio less than 5% using independent t tests)., Results: We found that use of CAT led to smaller person standard error of the estimated measure than NAT, with substantially higher efficiency but no loss of precision, reducing response burden by 48%, 66%, and 66% for dichotomous, Rating Scale Model, and PCM models, respectively., Conclusions: CAT-based administrations of the skin cancer risk scale could substantially reduce participant burden without compromising measurement precision. A mobile computer adaptive test was developed to help people efficiently assess their skin cancer risk.

Context/objective: The Spinal Cord Injury--Quality of Life (SCI-QOL) measurement system was developed to address the shortage of relevant and psychometrically sound patient reported outcome (PRO) measures available for clinical care and research in spinal cord injury (SCI) rehabilitation. Using a computer adaptive testing (CAT) approach, the SCI-QOL builds on the Patient Reported Outcomes Measurement Information System (PROMIS) and the Quality of Life in Neurological Disorders (Neuro-QOL) initiative. This initial manuscript introduces the background and development of the SCI-QOL measurement system. Greater detail is presented in the additional manuscripts of this special issue., Design: Classical and contemporary test development methodologies were employed. Qualitative input was obtained from individuals with SCI and clinicians through interviews, focus groups, and cognitive debriefing. Item pools were field tested in a multi-site sample (n=877) and calibrated using item response theory methods. Initial reliability and validity testing was performed in a new sample of individuals with traumatic SCI (n=245)., Setting: Five Model SCI System centers and one Department of Veterans Affairs Medical Center across the United States., Participants: Adults with traumatic SCI., Interventions: n/a, Outcome Measures: n/a, Results: The SCI-QOL consists of 19 item banks, including the SCI-Functional Index banks, and 3 fixed-length scales measuring physical, emotional, and social aspects of health-related QOL (HRQOL)., Conclusion: The SCI-QOL measurement system consists of psychometrically sound measures for individuals with SCI. The manuscripts in this special issue provide evidence of the reliability and initial validity of this measurement system. The SCI-QOL also links to other measures designed for a general medical population.

Objective: To develop a comprehensive, psychometrically sound, and conceptually grounded patient reported outcomes (PRO) measurement system for individuals with spinal cord injury (SCI)., Methods: Individual interviews (n=44) and focus groups (n=65 individuals with SCI and n=42 SCI clinicians) were used to select key domains for inclusion and to develop PRO items. Verbatim items from other cutting-edge measurement systems (i.e. PROMIS, Neuro-QOL) were included to facilitate linkage and cross-population comparison. Items were field tested in a large sample of individuals with traumatic SCI (n=877). Dimensionality was assessed with confirmatory factor analysis. Local item dependence and differential item functioning were assessed, and items were calibrated using the item response theory (IRT) graded response model. Finally, computer adaptive tests (CATs) and short forms were administered in a new sample (n=245) to assess test-retest reliability and stability., Participants and Procedures: A calibration sample of 877 individuals with traumatic SCI across five SCI Model Systems sites and one Department of Veterans Affairs medical center completed SCI-QOL items in interview format., Results: We developed 14 unidimensional calibrated item banks and 3 calibrated scales across physical, emotional, and social health domains. When combined with the five Spinal Cord Injury--Functional Index physical function banks, the final SCI-QOL system consists of 22 IRT-calibrated item banks/scales. Item banks may be administered as CATs or short forms. Scales may be administered in a fixed-length format only., Conclusions: The SCI-QOL measurement system provides SCI researchers and clinicians with a comprehensive, relevant and psychometrically robust system for measurement of physical-medical, physical-functional, emotional, and social outcomes. All SCI-QOL instruments are freely available on Assessment CenterSM.

Background: The use of surveys is becoming popular in the health care industry for acquiring information useful to the accomplishment of several studies. Besides their exploitation on a large scale for conducting epidemiological studies, surveys are being increasingly carried out on a narrower perspective through the administration of questionnaires aimed at assessing the quality of life perceived by patients or their clinical status during mid- or long-term treatments. This is useful for managing resources or optimizing and individualizing treatments., Objectives: This paper describes Gquest, a platform for modeling, generating and administering questionnaires through mobile devices such as smartphones or tablets. Gquest was motivated by the need of administering questionnaires during home treatments, albeit its applicability is rather general. The main requirement was to have a very simple, clean and easy to use platform able to support (a) physicians in the design and delivery of questionnaires and (b) outpatients in sending self-recorded outcomes to the clinical staff., Methods: Gquest has two basic components. The first one is a model devised for representing questionnaires which is extremely flexible. It allows the generation of questions and answers of different types, supports adaptivity in the dialog with the user and enforces simple consistency rules for checking his input. The second component is an application able to run instances of those questionnaires. It downloads questionnaires over the air in terms of XML files from a server and stores them locally into the mobile repository. Questionnaires become then available to the user, who in our case is a patient or one of his relatives. The user can select which one to fill-in, according to his needs and/or the specific treatment protocol. The selected questionnaire may be filled-in all at once or be completed in subsequent steps over time since any input provided is persisted on a local database. Finally, when a questionnaire is closed all the answers are transparently synchronized to a server for further evaluation or statistical purposes., Results: The platform has been exploited and tested in two medical domains where questionnaires have very different purposes; a quality of life pilot survey involving patients with atrial fibrillation within the EU-funded project MobiGuide, and an investigation of the users' needs during the requirements elicitation phase of a telemedicine project for the safe discharge of fragile patients., Conclusions: Gquest proved to be a suitable tool for dealing with a wide variety of question types and has been positively accepted by the patients enrolled in the pilot study., (Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.)

Purpose: To compare psychometric and responder burden characteristics between the Patient-Reported Outcomes Measurement Information System Physical Function Computer Adaptive Test (PF CAT) and the Disabilities of Arm, Shoulder, and Hand (DASH) instruments in a tertiary hand and upper extremity practice., Methods: Adult patients who presented to the clinic of 2 hand and upper extremity surgeons in a university-based tertiary care center were enrolled in this study. Participants received the DASH and PF CAT administered via tablet computer. Time to completion was recorded for both the DASH and PF CAT. We conducted statistical analyses to calculate Pearson correlation coefficients between the 2 instruments and performed a Rasch item response theory analysis to determine dimensionality, reliability, ceiling and floor effects, and item bias for each instrument., Results: A total of 134 patients were included. Time to completion for the DASH was 262 seconds, and for the PF CAT 57 seconds. The instruments had strong correlation (r = 0.726). The item and Pearson reliability were 0.97 and 0.94, respectively, for the DASH and 0.99 and 0.96 for the PF CAT. The DASH and PF CAT had 5% and 5% of unexplained variance, respectively. The DASH exhibited 5% of ceiling effect and 1% floor effect whereas the PF CAT had no ceiling or floor effects., Conclusions: The psychometric characteristics of the Patient-Reported Outcomes Measurement Information System PF CAT instrument compared favorably with the DASH in a tertiary upper extremity practice. Patient time burden was significantly reduced with the PF CAT compared with the DASH., Type of Study/level of Evidence: Diagnostic III., (Copyright © 2014 American Society for Surgery of the Hand. Published by Elsevier Inc. All rights reserved.)

Introduction: There is an increasing need for orthopaedic practitioners to measure and collect patient-reported outcomes data. In an effort to better understand outcomes from operative treatment, the American Orthopaedic Foot & Ankle Society (AOFAS) established the Orthopaedic Foot and Ankle Outcomes Research (OFAR) Network, a national consortium of foot and ankle orthopaedic surgeons. We hypothesized that the OFAR Network could successfully collect, aggregate, and report patient-reported outcome (PRO) data using the National Institutes of Health (NIH) Patient Reported Outcomes Measurement Information System (PROMIS)., Methods: Ten sites enrolled consecutive patients undergoing elective surgery for 1 of 6 foot/ankle disorders. Outcome instruments were collected preoperatively and at 6 months postoperatively using the PROMIS online system: Foot and Ankle Ability Measure (FAAM), Foot Function Index (FFI), and PROMIS physical function (PF) and pain computerized adaptive tests (CAT). During the 3-month period, 328 patients were enrolled; 249 (76%) had completed preoperative patient-reported outcomes data and procedure-specific data. Of these, 140 (56%) also completed 6-month postoperative patient- reported outcomes data., Results: Ankle arthritis and flatfoot demonstrated consistently worse preoperative scores. Five of 6 disorders showed significant improvement at 6 months on PF CAT and FAAM, 4 of 6 showed improvement on pain interference CAT, and no disorders showed improvement on FFI. Ankle arthritis and flatfoot demonstrated the greatest magnitude of change on most patient-reported outcomes scales., Conclusion: We were able to enroll large numbers of patients in a short enrollment period for this preliminary study. Data were easily aggregated and analyzed. Substantial loss of follow-up data indicates a critical area requiring further effort. The AOFAS OFAR Network is undergoing expansion with goals to ultimately facilitate large, prospective multicenter studies and optimize the quality and interpretation of available outcome instruments for the foot and ankle population., Level of Evidence: Level II, prospective comparative study., (© The Author(s) 2014.)

Background: The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group is currently developing computerized adaptive testing measures for the Quality of Life Questionnaire Core-30 (QLQ-C30) scales. The work presented here describes the development of an EORTC item bank for emotional functioning (EF), which is one of the core domains of the QLQ-C30., Methods: According to the EORTC guidelines on module development, the development of the EF item bank comprised four phases, of which the phases I-III are reported in the present paper. Phase I involved defining the theoretical framework for the EF item bank and a literature search. Phase II included pre-defined item selection steps and a multi-stage expert review process. In phase III, feedback from cancer patients from different countries was obtained., Results: On the basis of literature search in phase I, a list of 1750 items was generated. These were reviewed and further developed in phase II with a focus on relevance, redundancy, clarity, and difficulty. The development and selection steps led to a preliminary list of 41 items. In phase III, patient interviews (N = 41; Austria, Denmark, Italy, and the UK) were conducted with the preliminary item list, resulting in some minor changes to item wording. The final list comprised 38 items., Discussion: The phases I-III of the developmental process have resulted in an EF item list that was well accepted by patients in several countries. The items will be subjected to larger-scale field testing in order to establish their psychometric characteristics and their fit to an item response theory model., (© 2013 The Authors. Psycho-Oncology published by John Wiley & Sons, Ltd.)

Objectives: To develop a broad set of claimant-reported items to assess behavioral health functioning relevant to the Social Security disability determination processes, and to evaluate the underlying structure of behavioral health functioning for use in development of a new functional assessment instrument., Design: Cross-sectional., Setting: Community., Participants: Item pools of behavioral health functioning were developed, refined, and field tested in a sample of persons applying for Social Security disability benefits (N=1015) who reported difficulties working because of mental or both mental and physical conditions., Interventions: None., Main Outcome Measure: Social Security Administration Behavioral Health (SSA-BH) measurement instrument., Results: Confirmatory factor analysis (CFA) specified that a 4-factor model (self-efficacy, mood and emotions, behavioral control, social interactions) had the optimal fit with the data and was also consistent with our hypothesized conceptual framework for characterizing behavioral health functioning. When the items within each of the 4 scales were tested in CFA, the fit statistics indicated adequate support for characterizing behavioral health as a unidimensional construct along these 4 distinct scales of function., Conclusions: This work represents a significant advance both conceptually and psychometrically in assessment methodologies for work-related behavioral health. The measurement of behavioral health functioning relevant to the context of work requires the assessment of multiple dimensions of behavioral health functioning. Specifically, we identified a 4-factor model solution that represented key domains of work-related behavioral health functioning. These results guided the development and scale formation of a new SSA-BH instrument., (Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.)

This is a commentary on 5 articles in this issue of Archives of Physical Medicine and Rehabilitation that report on several related studies of new approaches to measuring disability. The project was grounded in theory, beginning with the development of a conceptual framework enhanced by a literature review and expert consultation within and outside of the Social Security Administration. The investigators then used item response theory to develop test items, which they organized into computer adaptive testing instruments and tested them for their psychometric properties. All in all, it is a groundbreaking set of studies and an enormously valuable contribution to the field. Hopefully it will also be tested as an alternative approach to assessing disability in the Social Security Administration disability benefits programs., (Copyright © 2013 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.)