Search

Questionnaires inquiring about psychopathology symptoms often produce data with excess zeros or the equivalent (e.g., none, never, and not at all). This type of zero inflation is especially common in nonclinical samples in which many people do not exhibit psychopathology, and if unaccounted for, can result in biased parameter estimates when fitting latent variable models. In the present research, we adopt a maximum likelihood approach in fitting multidimensional zero-inflated and hurdle graded response models to data from a psychological distress measure. These models include two latent variables: susceptibility, which relates to the probability of endorsing the symptom at all, and severity, which relates to the frequency of the symptom, given its presence. After estimating model parameters, we compute susceptibility and severity scale scores and include them as explanatory variables in modeling health-related criterion measures (e.g., suicide attempts, diagnosis of major depressive disorder). Results indicate that susceptibility and severity uniquely and differentially predict other health outcomes, which suggests that symptom presence and symptom severity are unique indicators of psychopathology and both may be clinically useful. Psychometric and clinical implications are discussed, including scale score reliability.

Objective: Despite the public health burden of traumatic brain injury (TBI) across broader society, most TBI studies have been isolated to a distinct subpopulation. The TBI research literature is fragmented further because often studies of distinct populations have used different assessment procedures and instruments. Addressing calls to harmonize the literature will require tools to link data collected from different instruments that measure the same construct, such as civilian mild traumatic brain injury (mTBI) and sports concussion symptom inventories. Method: We used item response theory (IRT) to link scores from the Rivermead Post Concussion Symptoms Questionnaire (RPQ) and the Sport Concussion Assessment Tool (SCAT) symptom checklist, widely used instruments for assessing civilian and sport-related mTBI symptoms, respectively. The sample included data from n = 397 patients who suffered a sports-related concussion, civilian mTBI, orthopedic injury control, or non-athlete control and completed the SCAT and/or RPQ. Results: The results of several analyses supported sufficient unidimensionality to treat the RPQ + SCAT combined item set as measuring a single construct. Fixed-parameter IRT was used to create a cross-walk table that maps RPQ total scores to SCAT symptom severity scores. Linked and observed scores were highly correlated (r = .92). Standard errors of the IRT scores were slightly higher for civilian mTBI patients and orthopedic controls, particularly for RPQ scores linked from the SCAT. Conclusion: By linking the RPQ to the SCAT we facilitated efforts to effectively combine samples and harmonize data relating to mTBI.

The Glasgow Outcome Scale-Extended (GOSE) is a functional outcome measure intended to place individuals with traumatic brain injury (TBI) into one of eight broad levels of injury-related disability. This simplicity is not always optimal, particularly when more granular assessment of individuals’ injury recovery is desired. The GOSE, however, is customarily assessed using a multi-question interview that contains richer information than is reflected in the GOSE score. Using data from the multi-center Transforming Research and Clinical Knowledge in TBI (TRACK-TBI) study (N = 1544), we used item response theory (IRT) to evaluate whether rescoring the GOSE using IRT, which posits that a continuous latent variable (disability) underlies responses, can yield a more precise index of injury-related functional limitations. We fit IRT models to GOSE interview responses collected at three months post-injury. Each participant's level of functional limitation was estimated from the model (GOSE-IRT) and comparisons were made between IRT-based and standard (GOSE-Ordinal) scores. The IRT scoring resulted in 141 possible scores (vs. 7 GOSE-Ordinal scores in this sample of individuals with GOSE scores ranging between 2 and 8). Moreover, GOSE-IRT scores were significantly more strongly associated with measures of TBI-related symptoms, psychological symptoms, and quality of life. Our findings demonstrate that rescoring the GOSE interview using IRT yields more granular, meaningful measurement of injury-related functional limitations, while adding no additional respondent or examiner burden. This technique may have utility for many applications, such as clinical trials aiming to detect small treatment effects, and small-scale studies that need to maximize statistical efficiency.

Clinical instruments that use a filter/follow-up response format often produce data with excess zeros, especially when administered to nonclinical samples. When the unidimensional graded response model (GRM) is then fit to these data, parameter estimates and scale scores tend to suggest that the instrument measures individual differences only among individuals with severe levels of the psychopathology. In such scenarios, alternative item response models that explicitly account for excess zeros may be more appropriate. The multivariate hurdle graded response model (MH-GRM), which has been previously proposed for handling zero-inflated questionnaire data, includes two latent variables: susceptibility, which underlies responses to the filter question, and severity, which underlies responses to the follow-up question. Using both simulated and empirical data, the current research shows that compared to unidimensional GRMs, the MH-GRM is better able to capture individual differences across a wider range of psychopathology, and that when unidimensional GRMs are fit to data from questionnaires that include filter questions, individual differences at the lower end of the severity continuum largely go unmeasured. Practical implications are discussed.

A limited evidence base supports the Functional Status Examination (FSE) as superior to the more commonly used Glasgow Outcome Scale–Extended (GOSE) for precisely characterizing injury-related functional limitations. The aim of this study was to use modern psychometric tools to test the hypothesis that the FSE is more precise than the GOSE in characterizing individual differences in functional limitations after moderate-to-severe traumatic brain injury (TBI). Secondarily, we sought to confirm that the type of interviewee (patient, significant other) does not affect the test performance of the FSE. Using data from 357 individuals with TBI who participated in the Magnesium Sulfate clinical trial and had six-month outcome data, we performed item response theory (IRT) analyses comparing the FSE and GOSE at six months post-injury. Results showed that the FSE yielded higher measurement precision (IRT test information) than the GOSE across most of the disability severity spectrum. The GOSE yielded more information than the FSE at a very high level of disability, because of the GOSE's assignment of a unique score for individuals who are in a vegetative state. Finally, the FSE showed no evidence of differential item functioning by interviewee, indicating it is appropriate to interview either persons with TBI or significant others and combine data across respondents as is typically done. The findings support the FSE as a viable and oftentimes advantageous substitute for the GOSE in clinical trials and translational studies of TBI.

Multidimensional item response models are known to be difficult to estimate, with a variety of estimation and modeling strategies being proposed to handle the difficulties. While some previous studies have considered the performance of these estimation methods, they typically include only one or two methods, or a small number of factors. In this paper, we report on a large simulation study of between-item multidimensional IRT estimation methods, considering five different methods, a variety of sample sizes, and up to eight factors. This study provides a comprehensive picture of the methods’ relative performance, as well as each individual method’s strengths and weaknesses. The study results lead us to make recommendations for applied research, related to which estimation methods should be used under various scenarios.

Emotion dysregulation is common among autistic people, yet few measures have received psychometric evaluation in this population. We examined the factor structure, reliability, and validity of a commonly-used measure of emotion dysregulation, the Difficulties with Emotion Regulation Scale (DERS), in a sample of 156 autistic adolescents and adults. Data were drawn from the NIH National Database for Autism Research (NDAR) and an author's existing dataset. Results demonstrated that the factor structure generally conformed to the original 6-factor model, with modifications. Reliability analyses revealed good-to-excellent internal consistencies. Validity analyses indicated that the DERS was positively associated with measures of anxiety, depression, and alexithymia. Our findings provide preliminary evidence for the utility of the DERS in a small autistic sample, with minor modifications.

Anxiety commonly occurs among youth on the autism spectrum, yet measurement of anxiety in this population is complicated by a number of factors, including potentially overlapping symptomatology, the child's intellectual functioning, and changes in anxiety across development. Moreover, few studies have examined the psychometric properties of anxiety measures in this population, and no study to date has tested whether there are systematic differences in the measurement of anxiety, or differential item functioning (DIF), across the high degree of heterogeneity and the developmental course of autism. To test this possibility, data were combined across multiple studies using the National Database for Autism Research, an NIH-funded data repository. Parent-report on the Screen for Child Anxiety Related Disorders (SCARED) and Social Communication Questionnaire (SCQ) were used as measures of anxiety and autism features, respectively. A confirmatory factor analysis indicated good fit of the literature standard five-factor structure. Moderated nonlinear factor analysis (MNLFA) revealed multiple items with intercept and loading DIF based on level of autism features, IQ, and age, especially for items related to social behavior. Therefore, although the measure's factor structure is consistent with that found in the general population, the SCARED may not capture differences in anxiety equivalently for all children on the spectrum and across their development. Clinicians and researchers need to be especially vigilant in measuring anxiety symptoms in children with autism by removing items flagged for DIF from the SCARED and/or by using multiple measures and informants. LAY ABSTRACT: Autistic youth often experience clinical levels of anxiety. Many tools used to measure anxiety were developed for the general population, but not for use with autistic youth. This study found that the Screen for Child Anxiety Related Disorders (SCARED) measures the same five dimensions of anxiety as in the general population. Parents, however, may respond differently to questions on the SCARED based on their child's autism features, intellectual functioning, and age, which impacts our ability to accurately measure anxiety among autistic youth.

The Latino population continues to underutilize mental health services at an alarming rate. The Attitudes Toward Seeking Professional Psychological Help Scale–Short Form (ATSPPH-SF) is one of the most commonly used instruments to assess help-seeking attitudes. The current study sought to evaluate the factor structure and test for the presence of differential item functioning on the ATSPPH-SF with a sample of Latino adult individuals across nativity status (U.S.- vs. foreign-born), language format (English vs. Spanish), and gender. The analyses revealed two relatively independent factors named Openness to Seeking Treatment and Value and Need in Seeking Treatment. Measurement equivalence and practical implications are discussed in the context of use with Latino individuals.

Zero responses and their equivalents-for example, never, none, not at all-are commonly observed on measures of psychopathology inquiring about symptom frequencies, particularly when these measures are administered to community samples. Measurement researchers typically accommodate multivariate zero inflation by including a nonpathological class of respondents who endorse zero for all symptoms. While this latent class approach accounts for test-level zero inflation (i.e., a proportion of individuals who do not experience any of the symptoms), it may be overly restrictive on questionnaires comprising items of differing severity. For example, an item about suicidal ideation is likely to exhibit a much higher degree of zero inflation than an item about low energy. Existing models do not account for this variability. We propose a multidimensional zero-inflated graded response model (MZI-GRM) as a more flexible approach for modeling zero inflation on questionnaires. According to the model, two distinct but correlated latent variables underlie ordinal item responses; one represents susceptibility to the construct, whereas the other represents severity. As a motivating example, we show how the MZI-GRM can be fit to data from the PHQ-9, a common depression screener. Results suggest that the MZI-GRM is better able to capture zero inflation across items than existing alternative models. Further, we find support for a multidimensional model that allows distinct but correlated latent variables to underlie each response process. Some items better measure susceptibility to depression (symptom presence), whereas others better capture severity of depression (symptom frequency). Implications for scale development and scoring are discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The presence–severity response format uses a filter question to ask about the presence of a symptom, followed by a question about the severity of that symptom. Only an affirmative response to the filter question triggers the follow-up question. Despite its widespread use, little research has compared the psychometric properties of the presence–severity response format to those of the traditional single-item response format. The purpose of this research was to understand how filter questions influence item responses and characteristics on several short health-related questionnaires. Using two different experimental designs, we find that depending on the construct being measured, the inclusion of a filter question can have a substantial effect on people’s responses, and in turn, the psychometric properties of the items. Overall, the presence–severity response format results in a reduction in symptom reporting and loss of information about individual differences, particularly for people experiencing mild symptoms. Measurement recommendations are provided.

Social anxiety is common among adolescents with autism spectrum disorder (ASD). An ongoing challenge for both research and clinical practice in ASD is the assessment of anxious symptomatology. Despite its widespread use in samples of youth with ASD, the Social Anxiety Scale for Adolescents (SAS-A) has not received psychometric evaluation within this population; thus, the validity of its use in research and clinical practice for ASD remains unclear. The present study conducted a psychometric analysis of caregiver and adolescent SAS-A forms in a sample of adolescents with ASD ( N = 197). Results revealed (1) poor caregiver–adolescent item-level agreement, (2) a two-factor structure, (3) lack of measurement invariance between reporters, and (4) modest evidence for convergent and discriminant validity. Overall, findings suggest that this measure demonstrates reasonable psychometric properties in an ASD sample. Lack of measurement invariance, however, calls for careful interpretation of research involving the SAS-A in ASD samples, particularly when the primary goal is to compare adolescent and caregiver reports. The implications of these findings for future research and clinical practice are discussed.

To describe the parental experience of recruitment and assess differences between parents who participated and those who declined to enroll in a neonatal clinical trial.This was a survey conducted at 12 US neonatal intensive care units of parents of infants who enrolled in the High-dose Erythropoietin for Asphyxia and encephaLopathy (HEAL) trial or who were eligible but declined enrollment. Questions assessed 6 factors of the parental experience of recruitment: (1) interactions with research staff; (2) the consent experience; (3) perceptions of the study; (4) decisional conflict; (5) reasons for/against participation; and (6) timing of making the enrollment decision.In total, 269 of 387 eligible parents, including 183 of 242 (75.6%) of those who enrolled their children in HEAL and 86 of 145 (59.3%) parents who declined to enroll their children in HEAL, were included in analysis. Parents who declined to enroll more preferred to be approached by clinical team members rather than by research team members (72.9% vs 49.2%, P = .005). Enrolled parents more frequently reported positive initial impressions (54.9% vs 10.5%, P .001). Many parents in both groups made their decision early in the recruitment process. Considerations of reasons for/against participation differed by enrollment status.Understanding how parents experience recruitment, and how this differs by enrollment status, may help researchers improve recruitment processes for families and increase enrollment. The parental experience of recruitment varied by enrollment status. These findings can guide future work aiming to inform optimal recruitment strategies for neonatal clinical trials.

Background: Symptom assessment is a critical component of concussion diagnosis and management, with item selection primarily driven by clinical judgment or expert consensus. We recently demonstrated that concussion symptoms assessed by the Sport Concussion Assessment Tool (SCAT) are essentially unidimensional, implying that overall symptom severity may be accurately estimated with relatively few questions. Briefer, evidence-based forms for symptom assessment would provide clinicians flexibility. Purpose: To develop and validate an abbreviated assessment of general concussion symptom severity using item response theory analyses. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Broad clinical assessments (SCAT3, Immediate Post-concussion and Cognitive Testing, Balance Error Scoring System, and Brief Symptom Inventory–18 Global Severity Index) were completed by 265 injured athletes and 235 matched teammate controls at 24 to 48 hours and 8, 15, and 45 days after concussion. Symptom checklist short forms (3-14 items from the original 22) were selected using item response theory item information curves. Internal consistency reliability (Cronbach alpha), correlation with criterion measures assessed concurrently (ie, acute neurocognitive performance, balance, and emotional symptoms), predictive validity (correlations with symptom duration), and differences between concussed and control groups (Cohen d) were examined across forms. Sensitivity and false-positive rates of the forms were estimated and compared using reliable change indices derived from controls. Results: Across the 3- to 22-item forms, internal consistency was excellent (Cronbach alphas, 0.90-0.94). Clinical correlations were significant ( P≤ .017) and to similar degrees for all short forms. Group difference confidence intervals overlapped across forms at 24- to 48-hour (Cohen d, 1.27-1.51) and 8-day follow-up (Cohen d, 0.31-0.44). Sensitivity remained similar across short forms, with a low false-positive rate in controls. Conclusion: Our findings suggest that even an ultrashort (3-item) inventory provides sufficiently reliable and valid estimates of overall concussion symptom severity 24 to 48 hours after injury. Future revisions of the SCAT could eliminate inefficient items, although replication in larger samples and extension to other postinjury time points are warranted.

Traditionally, executive function (EF) tasks have been scored using either accuracy or reaction time (RT) metrics. The current study, which includes 1,015 first-grade children from the Family Life Project, demonstrates a new scoring approach for the Hearts and Flowers (HF) task that uses both item-level accuracy and RT data to estimate latent EF ability. Our primary aim was to compare scores derived from this approach to standard scores often reported in the HF literature. A second aim was to test whether item-level accuracy and RT data were differentially related to latent EF ability, depending on children's overall level of task performance. Our results indicated that item-level accuracy and RT data both convey unique information related to latent EF ability but that the relative contributions of each source of data vary across children. Accuracy was comparatively more informative of latent ability in children with lower HF task performance, while RT was comparatively more informative of latent ability in children with higher overall performance. Moreover, item-level RT was differentially related to latent EF ability for children in lower versus higher performing groups. Whereas faster responding was associated with higher ability in the higher performing group, slower responding was associated with higher ability for the lower performing group. Latent EF ability was related to criterion measures in ways comparable to traditional scores. Results are discussed in relation to the broader EF assessment literature. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

There are many challenges associated with assessment and diagnosis of ADHD in adulthood. Utilizing the graded response model (GRM) from item response theory (IRT), a comprehensive item-level analysis of adult ADHD rating scales in a clinical population was conducted with Barkley's Adult ADHD Rating Scale-IV, Self-Report of Current Symptoms (CSS), a self-report diagnostic checklist and a similar self-report measure quantifying retrospective report of childhood symptoms, Barkley's Adult ADHD Rating Scale-IV, Self-Report of Childhood Symptoms (BAARS-C). Differences in item functioning were also considered after identifying and excluding individuals with suspect effort. Items associated with symptoms of inattention (IA) and hyperactivity/impulsivity (H/I) are endorsed differently across the lifespan, and these data suggest that they vary in their relationship to the theoretical constructs of IA and H/I. Screening for sufficient effort did not meaningfully change item level functioning. The application IRT to direct item-to-symptom measures allows for a unique psychometric assessment of how the current DSM-5 symptoms represent latent traits of IA and H/I. Meeting a symptom threshold of five or more symptoms may be misleading. Closer attention given to specific symptoms in the context of the clinical interview and reported difficulties across domains may lead to more informed diagnosis.

We sought to evaluate how PROMIS patient-reported outcome (PRO) measures correlated with disease characteristics in systemic light chain (AL) amyloidosis patients at diagnosis. Newly diagnosed AL patients were recruited at two centres (N = 61). Patients completed the PROMIS Global Health v1.2, PROMIS-29 Profile v2.0 and Fatigue 8a v1.0. We assigned disease severity based on stage, presence of cardiac AL, and number of organs involved. We evaluated a) known groups validity by comparing PROMIS T-scores by disease severity, b) internal consistency using Cronbach’s alpha and c) convergent/discriminant validity based on correlations across the domains and summary scores. Using receiver operating characteristic (ROC) curve analysis, NT-proBNP cut-off level corresponding to normal/mild vs moderate/severe PRO scores was determined. The median age was 68 (48–83) years with 58% males. Sixty-six percent had cardiac involvement and 25% had 3 or more organs involved with AL amyloidosis; 14% had stage 1, 28% stage 2, 36% stage 3 and 16% stage 4 disease. PROMIS measures had acceptable to excellent internal consistency and expected patterns of correlations. PROMIS Global Physical Health score was worse than the Global Mental Health Score at diagnosis; Physical function, fatigue and anxiety were the most impaired domains. PROMIS Global Health summary scores discriminated across AL amyloidosis stage and number of organs involved. Physical Function showed the strongest effects across known groups by stage, cardiac involvement and number of organs involved followed by Ability to Participate in Social Roles and Activities. A diagnostic NT-proBNP cut-off of 4200 pg/ml identified patients with moderate/severe PRO scores for these domains. Our results provide evidence for reliability and validity of select PROMIS short form measures in AL amyloidosis at diagnosis.

The goal of this study is to compare three different types of retrospective frequency response formats on the Healthy Days Symptoms Module (HDSM). Responses are compared in terms of intra-individual consistency, psychometric value, and participant feedback about each type of response format. Respondents each completed three versions of the HDSM, where items were framed to elicit an open-ended frequency, a fixed choice frequency, or a vague quantifier response. Traditional reliability statistics were used to evaluate intra-individual consistency. Differential item functioning (DIF) was used to test for response format effects, and item response theory (IRT) scale scores and standard errors were computed across the three forms to compare psychometric value. Linear mixed modeling was used to examine the associations of IRT scale scores across response formats with respondent characteristics. People are largely consistent in how they respond to items about their health, regardless of the response format, and no DIF was detected between response formats. The IRT scores computed from the “# of days” frequency response formats tend to have better measurement precision than those from vague quantifiers. Open-ended frequencies capture a greater span of individual differences for people reporting fewer symptoms; however, little measurement precision is lost in collapsing the frequencies into categories. Both the open-ended and fixed choice frequency response formats offer more measurement precision than vague quantifiers. While the open-ended frequency response format may capture more individual differences, respondents tend to report more difficulty with exact frequency recall, and thus, prefer the fixed choice frequency format.

This article reviews the book The Basics of Item Response Theory Using R by Baker and Kim (2017). It describes the structure and goals of the book, provides an overview of each chapter, and conclud...

This research introduces a latent class item response theory (IRT) approach for modeling item response data from zero-inflated, positively skewed, and arguably unipolar constructs of psychopathology. As motivating data, the authors use 4,925 responses to the Patient Health Questionnaire (PHQ-9), a nine Likert-type item depression screener that inquires about a variety of depressive symptoms. First, Lucke’s log-logistic unipolar item response model is extended to accommodate polytomous responses. Then, a nontrivial proportion of individuals who do not endorse any of the symptoms are accounted for by including a nonpathological class that represents those who may be absent on or at some floor level of the latent variable that is being measured by the PHQ-9. To enhance flexibility, a Box-Cox normal distribution is used to empirically determine a transformation parameter that can help characterize the degree of skewness in the latent variable density. A model comparison approach is used to test the necessity of the features of the proposed model. Results suggest that (a) the Box-Cox normal transformation provides empirical support for using a log-normal population density, and (b) model fit substantially improves when a nonpathological latent class is included. The parameter estimates from the latent class IRT model are used to interpret the psychometric properties of the PHQ-9, and a method of computing IRT scale scores that reflect unipolar constructs is described, focusing on how these scores may be used in clinical contexts.

Early childhood represents a period of rapid cognitive developmental change in executive function (EF) skills along with a variety of related cognitive processes, including processing speed. This leads to interpretational challenges in that children’s performance on EF tasks reflects more than EF skills per se. We tested whether the inclusion of a brief measure of simple reaction time (SRT) during EF assessments could help to partially address this challenge. Data were drawn from a cross-sectional convenience sample of 830 preschool-aged children. Individual differences in SRT were significantly associated with performance on all tasks (R2s = .09–.26); slower performance on the SRT task was associated with poorer performance on each EF task. Age-related differences in individual EF tasks were reduced by approximately one half after accounting for age-related differences in SRT, and EF task scores were less coherent (i.e., less strongly intercorrelated with each other) after the removal of SRT. Age-related differences in EF were smaller (Cohen ds = 1.36 vs. 0.78), and poverty-related differences in EF were larger (Cohen ds = 0.30 vs. 0.46) after accounting for SRT-related variation. Finally, consistent with previous studies, SRT-related differences in fluid reasoning were mediated by EF skills. Results are discussed with respect to using a brief measure of SRT to partially address the problem of measurement impurity at the level of individual EF tasks.

Raising a child with autism spectrum disorder (ASD) poses unique challenges that may impact parents' mental health and parenting experiences. The current study analyzed self-report data from 77 parents of youth with ASD. A serial multiple mediation model revealed that parenting stress (SIPA) and parental mental health (BAI and BDI-II) appears to be impacted by challenging adolescent behaviors (SSIS-PBs) and, in turn, affect parental involvement (PRQ), controlling for social skills (SSIS-SSs). Further, the study explored the malleability of parents' mental health over the course of a social skills intervention, and provides modest evidence that parent depressive symptoms decline across intervention. This study illustrates the importance of considering the entire family system in research on youth with ASD.

Antiretroviral therapy (ART) requires lifelong daily oral therapy. While patient characteristics associated with suboptimal ART adherence and persistence have been described in cohorts of HIV-infected persons, these factors are poor predictors of individual medication taking behaviors. We aimed to create and test instruments for the estimation of future ART adherence and persistence for clinical and research applications. Following formative work, a battery of 148 items broadly related to HIV infection and treatment was developed and administered to 181 HIV-infected patients. ART adherence and persistence were assessed using electronic monitoring for 3 months. Perceived confidence in medication taking and self-reported barriers to adherence were strongest in predicting non-adherence over time. Barriers to adherence (e.g., affordability, scheduling) were the strongest predictors of non-adherence, as well as 3- and 7-day non-persistence. A ten-item battery for prediction of these outcomes ( www.med.unc.edu/ncaidstraining/adherence/for-providers ) and a 30-item battery reflective of underlying psychological constructs can help identify and study individuals at risk for suboptimal ART adherence and persistence.

The Glasgow Outcome Scale-Extended (GOSE) is one of the most widely used measures of functional limitations after traumatic brain injury (TBI), and is the primary outcome measure used in clinical trials of acute TBI treatment. However, the GOSE appears insensitive to the full spectrum of TBI-related functional limitations, which may limit its potential to capture treatment effects or correlate with other variables that impact outcome. The Functional Status Examination (FSE) was designed to improve on the assessment of injury-related functional limitations using a standardized assessment and wider possible score range. The aim of this pilot study was to employ item response theory (IRT) to test the hypothesis that the FSE yields more precise estimation of functional outcome than the GOSE. Traumatically injured patients (n = 100, 77 TBI, 23 orthopedic injuries) were interviewed at 3 months post-injury using both the GOSE and FSE structured interviews. IRT was used to quantify and compare the tests' information functions, which reflect the degree to which each instrument precisely measures functional limitations across the severity spectrum. Findings were consistent with predictions: the FSE yielded stronger measurement of functional limitations (i.e., higher test information) across a wider range of severity than the GOSE, whether scoring the GOSE from all interview items or using the traditional GOSE overall score. Although the FSE appears to be a promising alternative measure to the GOSE, further research is needed to cross-validate these findings in a larger sample and understand how to best deploy it in clinical and translational research.

Importance It remains poorly understood how parents decide whether to enroll a child in a neonatal clinical trial. This is particularly true for parents from racial or ethnic minority populations. Understanding factors associated with enrollment decisions may improve recruitment processes for families, increase enrollment rates, and decrease disparities in research participation. Objective To assess differences in parental factors between parents who enrolled their infant and those who declined enrollment for a neonatal randomized clinical trial. Design, Setting, and Participants This survey study conducted from July 2017 to October 2019 in 12 US level 3 and 4 neonatal intensive care units included parents of infants who enrolled in the High-dose Erythropoietin for Asphyxia and Encephalopathy (HEAL) trial or who were eligible but declined enrollment. Data were analyzed October 2019 through July 2020. Exposure Parental choice of enrollment in neonatal clinical trial. Main Outcomes and Measures Percentages and odds ratios (ORs) of parent participation as categorized by demographic characteristics, self-assessment of child’s medical condition, study comprehension, and trust in medical researchers. Survey questions were based on the hypothesis that parents who enrolled their infant in HEAL differ from those who declined enrollment across 4 categories: (1) infant characteristics and parental demographic characteristics, (2) perception of infant’s illness, (3) study comprehension, and (4) trust in clinicians and researchers. Results Of a total 387 eligible parents, 269 (69.5%) completed the survey and were included in analysis. This included 183 of 242 (75.6%) of HEAL-enrolled and 86 of 145 (59.3%) of HEAL-declined parents. Parents who enrolled their infant had lower rates of Medicaid participation (74 [41.1%] vs 47 [55.3%];P = .04) and higher rates of annual income greater than $55 000 (94 [52.8%] vs 30 [37.5%];P = .03) compared with those who declined. Black parents had lower enrollment rates compared with White parents (OR, 0.35; 95% CI, 0.17-0.73). Parents who reported their infant’s medical condition as more serious had higher enrollment rates (OR, 5.7; 95% CI, 2.0-16.3). Parents who enrolled their infant reported higher trust in medical researchers compared with parents who declined (mean [SD] difference, 5.3 [0.3-10.3]). There was no association between study comprehension and enrollment. Conclusions and Relevance In this study, the following factors were associated with neonatal clinical trial enrollment: demographic characteristics (ie, race/ethnicity, Medicaid status, and reported income), perception of illness, and trust in medical researchers. Future work to confirm these findings and explore the reasons behind them may lead to strategies for better engaging underrepresented groups in neonatal clinical research to reduce enrollment disparities.

Background Given the call for gender-informed autism research ( Mandy & Lai, 2017 ), understanding the presentation and measurement of commonly co-occurring behavioral and emotional concerns among males and females on the autism spectrum is paramount. The validity of conclusions in this area of research necessitates that questionnaires capture true differences in constructs rather than systematic gender-based differences in measurement, an assumption which may be violated due to differential item functioning (DIF). Method In the present study, caregiver-report data on the Child Behavior Checklist (CBCL) (N = 502) were gathered across multiple studies from the National Database for Autism Research (NDAR), an NIH-funded data repository. Results Confirmatory factor analysis initially revealed poor to acceptable fit across subscales, suggesting a lack of unidimensionality. Fit was acceptable on all subscales following modifications for low factor loadings or highly correlated residuals. Multiple indicator multiple cause (MIMIC) models indicated that the majority of items did not show substantial DIF, with no items flagged for gender-based DIF on the Attention Problems, Withdrawn/Depressed, and Somatic Problems subscales. Items were flagged for gender-based DIF, however, on the Social Problems, Anxious/ Depressed, Aggressive Behavior, and Thought Problems subscales. Conclusions These findings indicate that few items on a measure of emotional and behavioral problems (Child Behavior Checklist; CBCL) function differently for male and female youth on the autism spectrum. This study has implications for future autism research aiming to accurately capture co-occurring emotional or behavioral problems and examine the etiology, trajectory, and ultimately treatment for males and females on the autism spectrum.

PURPOSE: Having independent versions of the PROMIS® scales (for Pediatric and Adults) is problematic as scores can’t be evaluated longitudinally as individuals move from childhood into adulthood. The primary aim of this research project is to use item response theory (IRT) to develop a transitional scoring link (or “crosswalk”) between the PROMIS adult and pediatric physical health measures. SETTING: Sample 1 was collected at 6 rehabilitation hospitals in the U.S., and participants in Sample 2 were recruited from public health insurance programs and an online research panel. METHODS: PROMIS pediatric and adult physical function, mobility, upper extremity, fatigue, and pain measures were administered to a sample of 874 individuals aged 14–20 years old with special health needs and a sample of 641 individuals aged 14–25 years with a disability. IRT-based scores were linked using a linear approximation to calibrated projection. RESULTS: Estimated latent variable correlations ranged between .84 and .95 for the PROMIS pediatric and adult scores. Root expected mean square difference values were below the .08 threshold in all cases except when comparing genders on the Mobility (.097) and Pain (.10) scales in the special health care needs sample. Sum score conversion tables for the pediatric and adult PROMIS measures are presented. CONCLUSIONS: The linking coefficients can be used to calculate scale scores on PROMIS adult measures from pediatric measure scores and vice-versa. This may lead to more accurate measurement in cross-sectional studies spanning multiple age groups or longitudinal studies that require comparable measurement across distinct developmental stages.

Research studies that measure health-related quality of life (HRQOL) in both children and adults and longitudinal studies that follow children into adulthood need measures that can be compared across these age groups. This study links the PROMIS pediatric and adult emotional distress measures using data from participants with diverse health conditions and disabilities. Analyses were conducted and compared in two separate samples to confirm the stability of results. One sample (n = 874) included individuals aged 14–20 years with special health care needs and who require health services. The other sample (n = 641) included individuals aged 14–25 years who have a physical or cognitive disability. Participants completed both PROMIS pediatric and adult measures. Item response theory-based scores were linked using the linear approximation to calibrated projection. The estimated latent-variable correlation between pediatric and adult PROMIS measures ranged from 0.87 to 0.94. Regression coefficients β 0 (intercept) and β 1 (slope), and mean squared error are provided to transform scores from the pediatric to the adult measures, and vice versa. This study used a relatively new linking method, calibrated projection, to link PROMIS pediatric and adult measure scores, thus expanding the use of PROMIS measures to research that includes both populations.

Efforts to improve children’s executive function are often hampered by the lack of measures that are optimized for use during the transition from preschool to elementary school. Whereas preschool-based measures often emphasize response accuracy, elementary school-based measures emphasize reaction time (RT)—especially for measures inhibitory control (IC) tasks that typically have a speeded component. The primary objective of this study was to test in a preschool-aged sample whether the joint use of item-level accuracy and RT data resulted in improved scoring for three IC tasks relative to scores derived from accuracy data alone. Generally, the joint use of item-level accuracy and RT data resulted in modest improvements in the measurement precision of IC abilities. Moreover, the joint use of item-level accuracy and RT helped eliminate floor and ceiling effects that occurred when accuracy data were considered alone. Results are discussed with respect to the importance of scoring IC tasks in ways that are maximally informative for program evaluation and longitudinal modeling.

Objective To evaluate the psychometric properties of questions that assess patient perceptions of patient-provider communication and design measures of patient-centered communication (PCC). Methods Participants (adults with colon or rectal cancer living in North Carolina) completed a survey at 2 to 3 months post-diagnosis. The survey included 87 questions in six PCC Functions: Exchanging Information, Fostering Health Relationships, Making Decisions, Responding to Emotions, Enabling Patient Self-Management, and Managing Uncertainty. For each Function we conducted factor analyses, item response theory modeling, and tests for differential item functioning, and assessed reliability and construct validity. Results Participants included 501 respondents; 46% had a high school education or less. Reliability within each Function ranged from 0.90 to 0.96. The PCC-Ca-36 (36-question survey; reliability=0.94) and PCC-Ca-6 (6-question survey; reliability=0.92) measures differentiated between individuals with poor and good health (i.e., known-groups validity) and were highly correlated with the HINTS communication scale (i.e., convergent validity). Conclusion This study provides theory-grounded PCC measures found to be reliable and valid in colorectal cancer patients in North Carolina. Future work should evaluate measure validity over time and in other cancer populations. Practice implications The PCC-Ca-36 and PCC-Ca-6 measures may be used for surveillance, intervention research, and quality improvement initiatives.

The objectives of the present study are to investigate the precision of static (fixed-length) short forms versus computerized adaptive testing (CAT) administration, response pattern scoring versus summed score conversion, and test-retest reliability (stability) of the Patient-Reported Outcomes Measurement Information System (PROMIS(®)) pediatric self-report scales measuring the latent constructs of depressive symptoms, anxiety, anger, pain interference, peer relationships, fatigue, mobility, upper extremity functioning, and asthma impact with polytomous items.Participants (N = 331) between the ages of 8 and 17 were recruited from outpatient general pediatrics and subspecialty clinics. Of the 331 participants, 137 were diagnosed with asthma. Three scores based on item response theory (IRT) were computed for each respondent: CAT response pattern expected a posteriori estimates, short-form response pattern expected a posteriori estimates, and short-form summed score expected a posteriori estimates. Scores were also compared between participants with and without asthma. To examine test-retest reliability, 54 children were selected for retesting approximately 2 weeks after the first assessment.A short CAT (maximum 12 items with a standard error of 0.4) was found, on average, to be less precise than the static short forms. The CAT appears to have limited usefulness over and above what can be accomplished with the existing static short forms (8-10 items). Stability of the scale scores over a 2-week period was generally supported.The study provides further information on the psychometric properties of the PROMIS pediatric scales and extends the previous IRT analyses to include precision estimates of dynamic versus static administration, test-retest reliability, and validity of administration across groups. Both the positive and negative aspects of using CAT versus short forms are highlighted.

Substantial evidence has established that individual differences in executive function (EF) in early childhood are uniquely predictive of children’s academic readiness at school entry. The current study tested whether growth trajectories of EF across the early childhood period could be used to identify a subset of children who were at pronounced risk for academic impairment in kindergarten. Using data that were collected at the age 3, 4, and 5 home assessments in the Family Life Project ( N = 1,120), growth mixture models were used to identify 9% of children who exhibited impaired EF performance (i.e., persistently low levels of EF that did not show expected improvements across time). Compared to children who exhibited typical trajectories of EF, the delayed group exhibited substantial impairments in multiple indicators of academic readiness in kindergarten (Cohen’s ds = 0.9–2.7; odds ratios = 9.8–23.8). Although reduced in magnitude following control for a range of socioeconomic and cognitive (general intelligence screener, receptive vocabulary) covariates, moderate-sized group differences remained (Cohen’s ds = 0.2–2.4; odds ratios = 3.9–5.4). Results are discussed with respect to the use of repeated measures of EF as a method of early identification, as well as the resulting translational implications of doing so.

To test equivalence of scores obtained with the PROMIS(®) pediatric Depressive Symptoms, Fatigue, and Mobility measures across two modes of administration: computer self-administration and telephone interviewer-administration. If mode effects are found, to estimate the magnitude and direction of the mode effects.Respondents from an internet survey panel completed the child self-report and parent proxy-report versions of the PROMIS(®) pediatric Depressive Symptoms, Fatigue, and Mobility measures using both computer self-administration and telephone interviewer-administration in a crossed counterbalanced design. Pearson correlations and multivariate analysis of variance were used to examine the effects of mode of administration as well as order and form effects.Correlations between scores obtained with the two modes of administration were high. Scores were generally comparable across modes of administration, but there were some small significant effects involving mode of administration; significant differences in scores between the two modes ranged from 1.24 to 4.36 points.Scores for these pediatric PROMIS measures are generally comparable across modes of administration. Studies planning to use multiple modes (e.g., self-administration and interviewer-administration) should exercise good study design principles to minimize possible confounding effects from mixed modes.

Objective To validate a brief measure of vaccination confidence using a large, nationally representative sample of parents. Methods We analyzed weighted data from 9018 parents who completed the 2010 National Immunization Survey–Teen, an annual, population-based telephone survey. Parents reported on the immunization history of a 13- to 17-year-old child in their households for vaccines including tetanus, diphtheria, and acellular pertussis (Tdap), meningococcal, and human papillomavirus vaccines. For each vaccine, separate logistic regression models assessed associations between parents' mean scores on the 8-item Vaccination Confidence Scale and vaccine refusal, vaccine delay, and vaccination status. We repeated analyses for the scale's 4-item short form. Results One quarter of parents (24%) reported refusal of any vaccine, with refusal of specific vaccines ranging from 21% for human papillomavirus to 2% for Tdap. Using the full 8-item scale, vaccination confidence was negatively associated with measures of vaccine refusal and positively associated with measures of vaccination status. For example, refusal of any vaccine was more common among parents whose scale scores were medium (odds ratio, 2.08; 95% confidence interval, 1.75–2.47) or low (odds ratio, 4.61; 95% confidence interval, 3.51–6.05) versus high. For the 4-item short form, scores were also consistently associated with vaccine refusal and vaccination status. Vaccination confidence was inconsistently associated with vaccine delay. Conclusions The Vaccination Confidence Scale shows promise as a tool for identifying parents at risk for refusing adolescent vaccines. The scale's short form appears to offer comparable performance.

This study examined differences between adults with low literacy skills and typically achieving children, who were matched on decoding ability, on their production of morphologically complex words (MC) in oral and written stories. In addition, we collected data on their morphological awareness, spelling, and vocabulary skills. Both adults and children were more likely to produce MC words in their oral stories compared to their written stories. While children were much more skilled at using –ed forms to produce past tense verbs than adults, adults were more likely to add –s to a verb and to produce contractions compared to children. Children and adults were comparable in pluralizing words, adding –ing to verbs, and producing derived MC words. For all of the literacy measures (morphological awareness, spelling, and vocabulary) adults always outperformed children. Thus, while adults were stronger in morphological awareness, spelling, and vocabulary, those skills did not seem to aid in the growth of explicitly applying morphological knowledge in the story-telling tasks.

To assess minimally important differences (MIDs) for several pediatric self-report item banks from the National Institutes of Health Patient-Reported Outcomes Measurement Information System(®) (PROMIS(®)).We presented vignettes comprising sets of two completed PROMIS questionnaires and asked judges to declare whether the individual completing those questionnaires had an important change or not. We enrolled judges (including adolescents, parents, and clinicians) who responded to 24 vignettes (six for each domain of depression, pain interference, fatigue, and mobility). We used item response theory to model responses to the vignettes across different judges and estimated MID as the point at which 50 % of the judges would declare an important change.We enrolled 246 judges (78 adolescents, 85 parents, and 83 clinicians). The MID estimated with clinician data was about 2 points on the PROMIS T-score scale, and the MID estimated with adolescent and parent data was about 3 points on that same scale.The MIDs enhance the value of PROMIS pediatric measures in clinical research studies to identify meaningful changes in health status over time.

Two methods to make inferences about scores that would have been obtained on one test using responses obtained with a different test are scale aligning and projection. If both tests measure the same construct, scale aligning may be accomplished using the results of simultaneous calibration of the items from both tests with a unidimensional IRT model. If the tests measure distinct but related constructs, an alternative is the use of regression to predict scores on one test from scores on the other; when the score distribution is predicted, this is projection. Calibrated projection combines those two methods, using a multidimensional IRT (MIRT) model to simultaneously calibrate the items comprising two tests onto scales representing distinct constructs, and estimating the parameters describing the relation between the two scales. Then projection is done within the MIRT model. This presentation describes two extensions of calibrated projection: (1) the use of linear models to compute the projected scores and their error variances, and (2) projection from more than one test to a single test. The procedures are illustrated using data obtained with scales measuring closely related quality of life constructs.

The study objective was to describe the individual item-level discrepancies between children ages 8–17 years and their parents for the PROMIS® pediatric scales. Contextual effects on item-level informant discrepancies for the pediatric pain interference items were further analyzed conditional on whether the child, the parent, or anyone else in the household experienced chronic pain. Parallel pediatric self-report and parent proxy-report items were completed by approximately 300 parent–child dyads depending on form assignment and individual nonresponse. Agreement between parent and child responses to individual items was measured using the polychoric correlation coefficient and weighted κ. The Chi-square test of symmetry was utilized for a comparison of the pattern of parent–child item discrepancies on the response scales, and the differences between the child and parent responses on the 1–5 item response scale are summarized . A continuum of higher item-level parent–child discrepancies was demonstrated starting with peer relationships, anger, anxiety, and depressive symptoms, followed by progressively lower parent–child discrepancies for energy, fatigue, asthma impact, pain interference, upper extremity, and mobility items. Parent–child discrepancies for pain interference items were lower in the context of chronic pain either in the child or in the parent. Parent–child item-level discrepancies were lower for more objective or visible items than for items measuring internal states or less observable items measuring latent variables such as peer relationships and fatigue. Future research should focus on the child and parent characteristics that influence domain-specific item-level discrepancies, and under what conditions item-level parent–child discrepancies predict child health outcomes.

Purpose The success of national immunization programs depends on the public's confidence in vaccines. We sought to develop a scale for measuring confidence about adolescent vaccination in diverse populations of parents. Methods Data came from 9623 parents who completed the 2010 National Immunization Survey-Teen, an annual, population-based telephone survey. Parents reported on a 13- to 17-year-old child in their households. We used exploratory and confirmatory factor analysis to identify latent constructs underlying parents’ responses to 8 vaccination belief survey items (response scale 0–10) conceptualized using the Health Belief Model. We assessed the scale's psychometric properties overall and across demographic subgroups. Results Parents’ confidence about adolescent vaccination was generally high. Analyses provided support for three factors assessing benefits of vaccination (mean = 8.5), harms of vaccination (mean = 3.3), and trust in healthcare providers (mean = 9.0). The model showed good fit both overall (comparative fit index = 0.97) and across demographic subgroups, although internal consistency was variable for the three factors. We found lower confidence among several potentially vulnerable subpopulations, including mothers with lower levels of education and parents whose children were of Hispanic ethnicity (both p Conclusions Our brief, three-factor scale offers an efficient way to measure confidence in adolescent vaccination across demographic subgroups. Given evidence of lower confidence by educational attainment and race/ethnicity, program planners should consider factors such as health literacy and cultural competence when designing interventions to promote adolescent vaccination to ensure these programs are fully accessible.

Background The primary objective was to enhance the content coverage of some of the pediatric self-report item banks for ages 8–17 years from the National Institutes of Health (NIH) Patient Reported Outcomes Measurement Information System (PROMIS®), and extend the range of precise measurement to higher levels of physical functioning. Methods Data from 1,419 pediatric patients with cancer, chronic kidney disease, obesity, rehabilitation needs, rheumatic disease, and sickle cell disease were combined with item responses from the original standardization sample of 3,048 children to calibrate new items for the pediatric PROMIS Anger, Anxiety, Depressive Symptoms, Pain Interference, Fatigue, and physical functioning Upper Extremity and Mobility scales. Simultaneous or concurrent calibration using the graded item response theory model placed all of the items on the same scale. Results Twenty-two of 28 potential new items were added across the seven scales. A recommended short form was proposed for the Anger scale, and the recommended short forms for the Anxiety and Depressive Symptoms scales were revised. Unfortunately, we were not particularly successful at extending the range of measurement for the physical functioning banks. Conclusions The present study expanded PROMIS pediatric item banks to add new content and to increase the range of measurement. Using item response theory, the banks were revised and expanded without changing the underlying scale of measurement. For Anger, Anxiety, and Depressive Symptoms, we successfully added new content that may render those banks more robust and flexible. Electronic supplementary material The online version of this article (doi:10.1186/s12955-014-0160-x) contains supplementary material, which is available to authorized users.

The objective of the present study is to describe the extension of the National Institutes of Health Patient-Reported Outcomes Measurement Information System (PROMIS(®)) pediatric parent proxy-report item banks for parents of children ages 5-7 years, and to investigate differential item functioning (DIF) between the data obtained from parents of 5-7-year-old children with the data obtained from parents of 8-17 year-old children in the original construction of the scales.Item response theory (IRT) analyses of DIF were conducted comparing data from the 5-7 age group with data from the established scales for ages 8-17 across 5 generic health domains (physical functioning, pain, fatigue, emotional health, and social health) and asthma.IRT DIF analyses revealed that the majority of the items functioned similarly with responses from parents of younger and older children. A small number of items were removed from the item bank for younger children, and a few items that exhibited statistical DIF were retained in the pools with the caveat that they should not be used in studies that involve comparisons of younger children with older children.The study confirms that most of the items in the PROMIS parent proxy-report item banks can be used with parents of children ages 5-7. It is anticipated that these new scales will have application for younger pediatric populations when pediatric self-report is not feasible.