Search

Background: Patient-reported outcome (PRO) measures produce scores that do not always have obvious clinical meaning. The PRO-bookmarking procedure is a new and promising way to make PRO measures more meaningful and interpretable. However, the materials and procedures of the task may benefit from adaptations to be more accessible to individuals with cognitive and language disorders. Aims: This study aims to provide an overview of the iterative refinement process used to modify the materials and procedures of the PRO-bookmarking task so that they are more accessible to adults with acquired cognitive and language impairments. Method and Procedures: Our team of health psychologists, neuropsychologists, and speech-language pathologists (SLPs) conducted two focus groups with SLPs and care partners of people with aphasia using the same PRO-bookmarking materials and procedures as previous reports. These PRO-bookmarking materials and procedures were then refined iteratively based on discussion with those who participated in focus groups and among the research team, and three more times in the course of 16 additional focus groups of different stakeholders: people with Parkinson's disease, aphasia, or traumatic brain injury; care partners of people with those conditions; and SLPs who have experience with those, and other adult-acquired conditions. Outcomes and Results: The PRO-bookmarking materials and procedures underwent four iterations to make them clearer, simpler, and more accessible. For example, the materials included more structured text and graphic supports where appropriate and the procedures were clustered into smaller discrete tasks and displayed graphically when possible and appropriate. Conclusions: PRO-bookmarking materials and procedures were made simpler and more structured to increase their accessibility to adults with cognitive and language impairments. In fact, these adaptations made the tasks simpler and clearer for all types of stakeholders.

Background: Patient-reported outcome (PRO) measures produce scores that do not always have obvious clinical meaning. The PRO-bookmarking procedure is a new and promising way to make PRO measures more meaningful and interpretable. However, the materials and procedures of the task may benefit from adaptations to be more accessible to individuals with cognitive and language disorders. Aims: This study aims to provide an overview of the iterative refinement process used to modify the materials and procedures of the PRO-bookmarking task so that they are more accessible to adults with acquired cognitive and language impairments. Method and Procedures: Our team of health psychologists, neuropsychologists, and speech-language pathologists (SLPs) conducted two focus groups with SLPs and care partners of people with aphasia using the same PRO-bookmarking materials and procedures as previous reports. These PRO-bookmarking materials and procedures were then refined iteratively based on discussion with those who participated in focus groups and among the research team, and three more times in the course of 16 additional focus groups of different stakeholders: people with Parkinson's disease, aphasia, or traumatic brain injury; care partners of people with those conditions; and SLPs who have experience with those, and other adult-acquired conditions. Outcomes and Results: The PRO-bookmarking materials and procedures underwent four iterations to make them clearer, simpler, and more accessible. For example, the materials included more structured text and graphic supports where appropriate and the procedures were clustered into smaller discrete tasks and displayed graphically when possible and appropriate. Conclusions: PRO-bookmarking materials and procedures were made simpler and more structured to increase their accessibility to adults with cognitive and language impairments. In fact, these adaptations made the tasks simpler and clearer for all types of stakeholders., Patient-reported outcome measures (PROMs) quantify health outcomes from the patient's perspective, such as emotional well-being, functional status, symptoms, and social participation (Cella et al., 2015; Mayo et al., 2017). Over [...]

Study designThis is a focused review article.ObjectivesThis review presents important features of clinical outcomes assessments (COAs) in human spinal cord injury research. Considerations for COAs by trial phase and International Classification of Functioning, Disability and Health are presented as well as strengths and recommendations for upper extremity COAs for research. Clinical trial tools and designs to address recruitment challenges are identified.MethodsThe methods include a summary of topics discussed during a two-day workshop, conceptual discussion of upper extremity COAs and additional focused literature review.ResultsCOAs must be appropriate to trial phase and particularly in mid-late-phase trials, should reflect recovery vs. compensation, as well as being clinically meaningful. The impact and extent of upper vs. lower motoneuron disease should be considered, as this may affect how an individual may respond to a given therapeutic. For trials with broad inclusion criteria, the content of COAs should cover all severities and levels of SCI. Specific measures to assess upper extremity function as well as more comprehensive COAs are under development. In addition to appropriate use of COAs, methods to increase recruitment, such as adaptive trial designs and prognostic modeling to prospectively stratify heterogeneous populations into appropriate cohorts should be considered.ConclusionsWith an increasing number of clinical trials focusing on improving upper extremity function, it is essential to consider a range of factors when choosing a COA.SponsorsCraig H. Neilsen Foundation, Spinal Cord Outcomes Partnership Endeavor.

Purpose: The purpose of this study was to evaluate the internal consistency and construct validity of the Traumatic Brain Injury Quality of Life Communication Item Bank (TBI-QOL COM) short form as a parent-proxy report measure. The TBI-QOL COM is a patient-reported outcome measure of functional communication originally developed as a self-report measure for adults with traumatic brain injury (TBI), but it may also be valid as a parent-proxy report measure for children who have sustained TBI. Method: One hundred twenty-nine parent-proxy raters completed the TBI-QOL COM short form 6 months postinjury as a secondary aim of a multisite study of pediatric TBI outcomes. The respondents' children with TBI were between 8 and 18 years old (M[subscript age] = 13.2 years old) at the time of injury, and the proportion of TBI severity mirrored national trends (73% complicated-mild; 27% moderate or severe). Results: The parent-proxy report version of the TBI-QOL COM displayed strong internal consistency (ordinal [alpha] = 0.93). It also displayed evidence of known-groups validity by virtue of more severe injuries associated with more abnormal scores. The instrument also showed evidence of convergent and discriminant validity by displaying a pattern of correlations with other constructs according to their conceptual relatedness to functional communication. Conclusions: This preliminary psychometric investigation of the TBI-QOL COM supports the further development of a parent report version of the instrument. Future development of the TBI-QOL COM with this population may include expanding the content of the item bank and developing calibrations specifically for parent-proxy raters.

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: "Crystallized Cognition Composite," "Fluid Cognition Composite," and "Total Cognition Composite" scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.

This study introduces a special series on validity studies of the Cognition Battery (CB) from the U.S. National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function (NIHTB) (Gershon, Wagster et al., 2013) in an adult sample. This first study in the series describes the sample, each of the seven instruments in the NIHTB-CB briefly, and the general approach to data analysis. Data are provided on test-retest reliability and practice effects, and raw scores (mean, standard deviation, range) are presented for each instrument and the gold standard instruments used to measure construct validity. Accompanying papers provide details on each instrument, including information about instrument development, psychometric properties, age and education effects on performance, and convergent and discriminant construct validity. One study in the series is devoted to a factor analysis of the NIHTB-CB in adults and another describes the psychometric properties of three composite scores derived from the individual measures representing fluid and crystallized abilities and their combination. The NIHTB-CB is designed to provide a brief, comprehensive, common set of measures to allow comparisons among disparate studies and to improve scientific communication.

The List Sorting Working Memory Test was designed to assess working memory (WM) as part of the NIH Toolbox Cognition Battery. List Sorting is a sequencing task requiring children and adults to sort and sequence stimuli that are presented visually and auditorily. Validation data are presented for 268 participants ages 20 to 85 years. A subset of participants (N=89) was retested 7 to 21 days later. As expected, the List Sorting Test had moderately high correlations with other measures of working memory and executive functioning (convergent validity) but a low correlation with a test of receptive vocabulary (discriminant validity). Furthermore, List Sorting demonstrates expected changes over the age span and has excellent test-retest reliability. Collectively, these results provide initial support for the construct validity of the List Sorting Working Memory Measure as a measure of working memory. However, the relationship between the List Sorting Test and general executive function has yet to be determined.

The objective of this study is to evaluate the construct validity of the NIH Neurobehavioral Toolbox Cognitive Health Battery (NIHTB-CHB) in adults. Confirmatory factor analysis was used to evaluate the dimensional structure underlying the NIHTB-CHB and Gold Standard tests chosen to serve as concurrent validity criteria for the NIHTB-CHB. These results were used to evaluate the convergent and discriminant validity of the NIHTB-CHB in adults ranging from 20 to 85 years of age. Five dimensions were found to explain the correlations among NIHTB-CHB and Gold Standard tests: Vocabulary, Reading, Episodic Memory, Working Memory and Executive Function/Processing Speed. NIHTB-CHB measures and their Gold Standard analogues defined factors in a pattern that broadly supported the convergent and discriminant validity of the NIHTB-CHB tests. This 5-factor structure was found to be invariant across 20-60 year old (N=159) and 65-85 year old (N=109) age groups that were included in the current validity study. Second order Crystallized Abilities (Vocabulary and Reading) and Fluid Abilities (Episodic Memory, Working Memory, Executive/Speed) factors parsimoniously explained correlations among the five first order factors. These results suggest that the NIHTB-CHB will provide both fine-grained and broad characterization of cognition across the adult age span.

Purpose: The purpose of this study was to evaluate the internal consistency and construct validity of the Traumatic Brain Injury Quality of Life Communication Item Bank (TBIQOL COM) short form as a parent-proxy report measure. The TBI-QOL COM is a patient-reported outcome measure of functional communication originally developed as a self-report measure for adults with traumatic brain injury (TBI), but it may also be valid as a parent-proxy report measure for children who have sustained TBI. Method: One hundred twenty-nine parent-proxy raters completed the TBI-QOL COM short form 6 months postinjury as a secondary aim of a multisite study of pediatric TBI outcomes. The respondents' children with TBI were between 8 and 18 years old ([M.sub.age] = 13.2 years old) at the time of injury, and the proportion of TBI severity mirrored national trends (73% complicated-mild; 27% moderate or severe). Results: The parent-proxy report version of the TBI-QOL COM displayed strong internal consistency (ordinal [alpha] = .93). It also displayed evidence of known-groups validity by virtue of more severe injuries associated with more abnormal scores. The instrument also showed evidence of convergent and discriminant validity by displaying a pattern of correlations with other constructs according to their conceptual relatedness to functional communication. Conclusions: This preliminary psychometric investigation of the TBI-QOL COM supports the further development of a parent report version of the instrument. Future development of the TBI-QOL COM with this population may include expanding the content of the item bank and developing calibrations specifically for parent-proxy raters. Supplemental Material: https://doi.org/10.23641/asha. 7616534, Every year in the United States, traumatic brain injury (TBI) accounts for approximately 2.8 million visits to the emergency department, hospitalizations, or deaths (Taylor, Bell, Breiding, & Xu, 2017). More [...]

This chapter focuses on the NIH Toolbox List Sorting Working Memory Test, which was developed to assess processing speed within the NIH Toolbox Cognition Battery (CB). This test is a sequencing task requiring children and adults to process stimuli (presented both visually and auditorily) and sequence the stimuli according to size. We describe the development of the NIH Toolbox List Sorting Working Memory Test, highlighting its utility in children. We examine descriptive data, test-retest reliability, and convergent and discriminant validity. Results indicated that List Sorting performance was positively correlated with age indicating that performance on the task improved throughout childhood and early adolescence. Further, test-retest reliability coefficients were high and there was support for both convergent and discriminant validity. These data suggest that the NIH Toolbox List Sorting Working Memory Test is reliable and shows evidence of construct validity.

The NIH Toolbox Cognition Battery (CB) includes 7 tests covering 6 cognitive abilities. This chapter describes the psychometric characteristics in children ages 3-15 years of a total summary score and composite scores reflecting two major types of cognition: "crystallized" (more dependent upon past learning experiences) and "fluid" (capacity for new learning and information processing in novel situations). Both types of cognition are considered important in everyday functioning, but are thought to be differently affected by brain health status throughout life, from early childhood through older adulthood. All three Toolbox composite scores showed excellent test-retest reliability, robust developmental effects across the childhood age range considered here, and strong correlations with established measures of similar abilities. Additional preliminary evidence of validity includes significant associations between all three Toolbox composite scores and maternal reports of children's health status and school performance.

This monograph presents the pediatric portion of the National Institutes of Health (NIH) Toolbox Cognition Battery (CB) of the NIH Toolbox for the Assessment of Neurological and Behavioral Function. The NIH Toolbox is an initiative of the Neuroscience Blueprint, a collaborative framework through which 16 NIH Institutes, Centers, and Offices jointly support neuroscience-related research, to accelerate discoveries and reduce the burden of nervous system disorders. The CB is one of four modules that measure cognitive, emotional, sensory, and motor health across the lifespan. The CB is unique in its continuity across childhood, adolescence, early adulthood, and old age, and in order to help create a common currency among disparate studies, it is also available at low cost to researchers for use in large-scale longitudinal and epidemiologic studies. This chapter describes the evolution of the CB; methods for selecting cognitive subdomains and instruments; the rationale for test design; and a validation study in children and adolescents, ages 3-15 years. Subsequent chapters feature detailed discussions of each test measure and its psychometric properties (Chapters 2-6), the factor structure of the test battery (Chapter 7), the effects of age and education on composite test scores (Chapter 8), and a final summary and discussion (Chapter 9). As the chapters in this monograph demonstrate, the CB has excellent psychometric properties, and the validation study provided evidence for the increasing differentiation of cognitive abilities with age.

Confirmatory factor analysis was used the evaluate the dimensional structure underlying the NIH Toolbox Cognition Battery (CB) and the measures chosen to serve as concurrent validity criteria for the NIH Toolbox CB. These results were used to evaluate the convergent and discriminant validity of the CB in children ranging from 3 to 15 years of age. Results were evaluated separately for a 3- to 6-year-old group and a 8- to 15-year-old group because different validation measures were used in these age groups. Three distinct dimensions were found for the 3- to 6-year-old group: Vocabulary, Reading, and Fluid Abilities. Five dimensions were found for 8-15 year olds: Vocabulary, Reading, Episodic Memory, Working Memory, and Executive Function/Processing Speed. CB measures and their validation analogues consistently defined common factors in a pattern that broadly supported the convergent and discriminant validity of the CB, but results showed higher intercorrelation and less differentiation of cognitive dimensions in younger than in older children and in older children compared with adults. Age was strongly related to the cognitive dimensions underlying test performance in both groups of children and results are consistent with broader literature showing increasing differentiation of cognitive abilities associated with the rapid brain development that occurs from early childhood into adulthood.