Search

Background and objectiveIndividuals with intellectual disability (ID) experience protracted cognitive development compared with typical youth. Sensitive measurement of cognitive change in this population is a critical need for clinical trials and other intervention studies, but well-validated outcome measures are scarce. This study's aim was to evaluate the sensitivity of the NIH Toolbox Cognition Battery (NIHTB-CB) to detect developmental changes in groups with ID-fragile X syndrome (FXS), Down syndrome (DS), and other ID (OID)-and to provide further support for its use as an outcome measure for treatment trials.MethodsWe administered the NIHTB-CB and a reference standard cross-validation measure (Stanford-Binet Intelligence Scales, Fifth Edition [SB5]) to 256 individuals with FXS, DS, and OID (ages 6-27 years). After 2 years of development, we retested 197 individuals. Group developmental changes in each cognitive domain of the NIHTB-CB and SB5 were assessed using latent change score models, and 2-year growth was evaluated at 3 age points (10, 16, and 22 years).ResultsOverall, effect sizes of growth measured by the NIHTB-CB tests were comparable with or exceeded those of the SB5. The NIHTB-CB showed significant gains in almost all domains in OID at younger ages (10 years), with continued gains at 16 years and stability in early adulthood (22 years). The FXS group showed delayed gains in attention and inhibitory control compared with OID. The DS group had delayed gains in receptive vocabulary compared with OID. Unlike the other groups, DS had significant growth in early adulthood in 2 domains (working memory and attention/inhibitory control). Notably, each group's pattern of NIHTB-CB growth across development corresponded to their respective pattern of SB5 growth.DiscussionThe NIHTB-CB is sensitive to developmental changes in individuals with ID. Comparison with levels and timing of growth on the cross-validation measure shows that the NIHTB-CB has potential to identify meaningful trajectories across cognitive domains and ID etiologies. Sensitivity to change within the context of treatment studies and delineation of clinically meaningful changes in NIHTB-CB scores, linked to daily functioning, must be established in future research to evaluate the battery more completely as a key outcome measure.

BackgroundCognitive impairment, including dementia, is frequently under-detected in primary care. The Consortium for Detecting Cognitive Impairment, including Dementia (DetectCID) convenes three multidisciplinary teams that are testing novel paradigms to improve the frequency and quality of patient evaluations for detecting cognitive impairment in primary care and appropriate follow-up.ObjectiveOur objective was to characterize the three paradigms, including similarities and differences, and to identify common key lessons from implementation.MethodsA qualitative evaluation study with dementia specialists who were implementing the detection paradigms. Data was analyzed using content analysis.ResultsWe identified core components of each paradigm. Key lessons emphasized the importance of engaging primary care teams, enabling primary care providers to diagnose cognitive disorders and provide ongoing care support, integrating with the electronic health record, and ensuring that paradigms address the needs of diverse populations.ConclusionApproaches are needed that address the arc of care from identifying a concern to post-diagnostic management, are efficient and adaptable to primary care workflows, and address a diverse aging population. Our work highlights approaches to partnering with primary care that could be useful across specialties and paves the way for developing future paradigms that improve differential diagnosis of symptomatic cognitive impairment, identifying not only its presence but also its specific syndrome or etiology.

ObjectiveHispanics/Latinos are the largest and fastest-growing minority population in the United States. To facilitate appropriate outcome assessment of this expanding population, the NIH Toolbox for Assessment of Neurological and Behavioral Function® (NIH Toolbox®) was developed with particular attention paid to the cultural and linguistic needs of English- and Spanish-speaking Hispanics/Latinos.MethodsA Cultural Working Group ensured that all included measures were appropriate for use with Hispanics/Latinos in both English and Spanish. In addition, a Spanish Language Working Group assessed all English-language NIH Toolbox measures for translatability.ResultsMeasures were translated following the Functional Assessment of Chronic Illness Therapy (FACIT) translation methodology for instances where language interpretation could impact scores, or a modified version thereof for more simplified translations. The Spanish versions of the NIH Toolbox Cognition Battery language measures (i.e., Picture Vocabulary Test, Oral Reading Recognition Test) were developed independently of their English counterparts.ConclusionsThe Spanish-language version of the NIH Toolbox provides a much-needed set of tools that can be selected as appropriate to complement existing protocols being conducted with the growing Hispanic/Latino population in the United States.

ObjectiveTo advance the science of cognitive outcome measurement for individuals with intellectual disability (ID), we established administration guidelines and evaluated the psychometric properties of the NIH-Toolbox Cognitive Battery (NIHTB-CB) for use in clinical research.MethodsWe assessed feasibility, test-retest reliability, and convergent validity of the NIHTB-CB (measuring executive function, processing speed, memory, and language) by assessing 242 individuals with fragile X syndrome (FXS), Down syndrome (DS), and other ID, ages 6 through 25 years, with retesting completed after 1 month. To facilitate accessibility and measurement accuracy, we developed accommodations and standard assessment guidelines, documented in an e-manual. Finally, we assessed the sensitivity of the battery to expected syndrome-specific cognitive phenotypes.ResultsAbove a mental age of 5.0 years, all tests had excellent feasibility. More varied feasibility across tests was seen between mental ages of 3 and 4 years. Reliability and convergent validity ranged from moderate to strong. Each test and the Crystallized and Fluid Composite scores correlated moderately to strongly with IQ, and the Crystallized Composite had modest correlations with adaptive behavior. The NIHTB-CB showed known-groups validity by detecting expected executive function deficits in FXS and a receptive language deficit in DS.ConclusionThe NIHTB-CB is a reliable and valid test battery for children and young adults with ID with a mental age of ≈5 years and above. Adaptations for very low-functioning or younger children with ID are needed for some subtests to expand the developmental range of the battery. Studies examining sensitivity to developmental and treatment changes are now warranted.

BackgroundThere is a need for valid self-report measures of core health-related quality of life (HRQoL) domains.ObjectiveTo derive brief, reliable and valid health profile measures from the Patient Reported Outcomes Measurement Information System® (PROMIS®) item banks.MethodsLiterature review, investigator consensus process, item response theory (IRT) analysis, and expert review of scaling results from multiple PROMIS data sets. We developed 3 profile measures ranging in length from 29 to 57 questions. These profiles assess important HRQoL domains with highly informative subsets of items from respective item banks and yield reliable information across mild-to-severe levels of HRQoL experiences. Each instrument assesses the domains of pain interference, fatigue, depression, anxiety, sleep disturbance, physical function, and social function using 4-, 6-, and 8-item short forms for each domain, and an average pain intensity domain score, using a 0-10 numeric rating scale.ResultsWith few exceptions, all domain short forms within the profile measures were highly reliable across at least 3 standard deviation (30 T-score) units and were strongly correlated with the full bank scores. Construct validity with ratings of general health and quality of life was demonstrated. Information to inform statistical power for clinical and general population samples is also provided.ConclusionsAlthough these profile measures have been used widely, with summary scoring routines published, description of their development, reliability, and initial validity has not been published until this article. Further evaluation of these measures and clinical applications are encouraged.

ObjectiveThis study examined the influence of Hispanic ethnicity and language/cultural background on performance on the NIH Toolbox Cognition Battery (NIHTB-CB).MethodParticipants included healthy, primarily English-speaking Hispanic (n = 93; Hispanic-English), primarily Spanish-speaking Hispanic (n = 93; Hispanic-Spanish), and English speaking Non-Hispanic white (n = 93; NH white) adults matched on age, sex, and education levels. All participants were in the NIH Toolbox national norming project and completed the Fluid and Crystallized components of the NIHTB-CB. T-scores (demographically-unadjusted) were developed based on the current sample and were used in analyses.ResultsSpanish-speaking Hispanics performed worse than English-speaking Hispanics and NH whites on demographically unadjusted NIHTB-CB Fluid Composite scores (ps

Introduction: Emotional functioning in older adults is influenced by normal aging and cognitive impairment, likely heterogeneous across positive versus negative aspects of emotional functioning. Little is known about positive emotional experiences at the early stages of cognitive impairment. Methods: We assessed different aspects of emotional functioning among 448 participants aged 65+ (Normal Control (NC) = 276, Mild Cognitive Impairment (MCI) = 103, and mild dementia of the Alzheimer type (mild DAT) = 69) and tested moderators. Results: Compared to NC, older adults with MCI and mild DAT have maintained many positive aspects of emotional functioning, despite higher levels of negative affect, sadness, and loneliness. Among the oldest-old, the mild DAT group experienced higher fear and lower self-efficacy. Discussion: Older adults at early stages of cognitive impairment can experience positive aspects of emotional functioning, such as positive affect, purpose, and life satisfaction, all of which are important buildable psychological resources for coping. [ABSTRACT FROM AUTHOR]

Objective The percentage of older adults living into their 80s and beyond is expanding rapidly. Characterization of typical cognitive performance in this population is complicated by a dearth of normative data for the oldest old. Additionally, little attention has been paid to other aspects of health, such as motor, sensory, and emotional functioning, that may interact with cognitive changes to predict quality of life and well-being. The current study used the NIH Toolbox (NIHTB) to determine age group differences between persons aged 65–84 and 85+ with normal cognition. Method Participants were recruited in two age bands (i.e. 65–84 and 85+). All participants completed the NIHTB Cognition, Motor, Sensation, and Emotion modules. Independent-samples t -tests determined age group differences with post-hoc adjustments using Bonferroni corrections. All subtest and composite scores were then regressed on age and other demographic covariates. Results The 65–84 group obtained significantly higher scores than the 85+ group across all cognitive measures except oral reading, all motor measures except gait speed, and all sensation measures except pain interference. Age remained a significant predictor after controlling for covariates. Age was not significantly associated with differences in emotion scores. Conclusions Results support the use of the NIHTB in persons over 85 with normal cognition. As expected, fluid reasoning abilities and certain motor and sensory functions decreased with age in the oldest old. Inclusion of motor and sensation batteries is warranted when studying trajectories of aging in the oldest old to allow for multidimensional characterization of health. [ABSTRACT FROM AUTHOR]

Objective: Symptom clustering research provides a unique opportunity for understanding complex medical conditions. The objective of this study was to apply a variable-centered analytic approach to understand how symptoms may cluster together, within and across domains of functioning in mild cognitive impairment (MCI) and dementia, to better understand these conditions and potential etiological, prevention, and intervention considerations. Method: Cognitive, motor, sensory, emotional, and social measures from the NIH Toolbox were analyzed using exploratory factor analysis (EFA) from a dataset of 165 individuals with a research diagnosis of either amnestic MCI or dementia of the Alzheimer's type. Results: The six-factor EFA solution described here primarily replicated the intended structure of the NIH Toolbox with a few deviations, notably sensory and motor scores loading onto factors with measures of cognition, emotional, and social health. These findings suggest the presence of cross-domain symptom clusters in these populations. In particular, negative affect, stress, loneliness, and pain formed one unique symptom cluster that bridged the NIH Toolbox domains of physical, social, and emotional health. Olfaction and dexterity formed a second unique cluster with measures of executive functioning, working memory, episodic memory, and processing speed. A third novel cluster was detected for mobility, strength, and vision, which was considered to reflect a physical functioning factor. Somewhat unexpectedly, the hearing test included did not load strongly onto any factor. Conclusion: This research presents a preliminary effort to detect symptom clusters in amnestic MCI and dementia using an existing dataset of outcome measures from the NIH Toolbox. [ABSTRACT FROM AUTHOR]

Cognitive research with developmental samples requires improved methods that support large‐scale, diverse, and open science. This paper offers initial evidence to support the Mobile Toolbox (MTB), a self‐administered remote smartphone‐based cognitive battery, in youth populations, from a pilot sample of 99 children (Mage = 11.79 years; 36% female; 53% White, 33% Black or African American, 9% Asian, and 15% Hispanic). Completion rates (95%–99%), practice performance (96%–100%), internal consistency (0.60–0.98), and correlations with similar NIHTB measures (0.55–0.77) provide the first evidence to support the MTB in a youth sample, although there were some inconsistencies across measures. Preliminary findings provide promising evidence of the MTB in developmental populations, and further studies are encouraged. [ABSTRACT FROM AUTHOR]

Consumers often cite cognitive improvements as reasons for making dietary changes or using dietary supplements, a motivation that if leveraged could greatly enhance public health. However, rarely is it considered whether standardized cognitive tests that are used in nutrition research are aligned to outcomes of interest to the consumer. This knowledge gap presents a challenge to the scientific substantiation of nutrition-based cognitive health benefits. Here we combined focus group transcript review using reflexive thematic analysis and a multidisciplinary expert panel exercise to evaluate the applicability of cognitive performance tools/tasks for substantiating the specific cognitive benefits articulated by consumers with the objectives to (1) understand how consumers comprehend the potential benefits of nutrition for brain health, and (2) determine the alignment between consumers desired brain benefits and validated tests and tools. We derived a 'Consumer Taxonomy of Cognitive and Affective Health in Nutrition Research' which describes the cognitive and affective structure from the consumers perspective. Experts agreed that validated tests exist for some consumer benefits including focused attention, sustained attention, episodic memory, energy levels, and anxiety. Prospective memory, flow, and presence represented novel benefits that require the development and validation of new tests and tools. Closing the gap between science and consumers and fostering co-creative approaches to nutrition research are critical to the development of products and dietary recommendations that support realizable cognitive benefits that benefit public health. [ABSTRACT FROM AUTHOR]

PurposeWe examined symptom variability in men and women with urological chronic pelvic pain syndrome. We describe symptom fluctuations as related to early symptom regression and its effect on estimated 1-year symptom change. We also describe a method to quantify patient specific symptom variability.Materials and methodsSymptoms were assessed biweekly in 424 subjects with urological chronic pelvic pain syndrome during 1 year. To evaluate the impact of early symptom regression subjects were classified as improved, no change or worse according to the rate of change using 1) all data, 2) excluding week 0 and 3) excluding weeks 0 and 2. Patient specific, time varying variability was calculated at each interval using a sliding window approach. Patients were classified as high, medium or low variability at each time and ultimately as high or low variability overall based on the variability for the majority of contacts.ResultsPrior to excluding early weeks to adjust for early symptom regression 25% to 38% and 5% to 6% of patients were classified as improved and worse, respectively. After adjustment the percent of patients who were improved or worse ranged from 15% to 25% and 6% to 9%, respectively. High and low variability phenotypes were each identified in 25% to 30% of participants.ConclusionsPatients with urological chronic pelvic pain syndrome show symptom variability. At study enrollment patients had worse symptoms on average, resulting in a regression effect that influenced the estimated proportion of those who were improved or worse. Prospective studies should include a run-in period to account for regression to the mean and other causes of early symptom regression. Further, symptom variability may be quantified and used to characterize longitudinal symptom profiles of urological chronic pelvic pain syndrome.

Hispanics are the fastest growing ethnicity in the United States, yet there are limited well-validated neuropsychological tools in Spanish, and an even greater paucity of normative standards representing this population. The Spanish NIH Toolbox Cognition Battery (NIHTB-CB) is a novel neurocognitive screener; however, the original norms were developed combining Spanish- and English-versions of the battery. We developed normative standards for the Spanish NIHTB-CB, fully adjusting for demographic variables and based entirely on a Spanish-speaking sample. A total of 408 Spanish-speaking neurologically healthy adults (ages 18-85 years) and 496 children (ages 3-7 years) completed the NIH Toolbox norming project. We developed three types of scores: uncorrected based on the entire Spanish-speaking cohort, age-corrected, and fully demographically corrected (age, education, sex) scores for each of the seven NIHTB-CB tests and three composites (Fluid, Crystallized, Total Composites). Corrected scores were developed using polynomial regression models. Demographic factors demonstrated medium-to-large effects on uncorrected NIHTB-CB scores in a pattern that differed from that observed on the English NIHTB-CB. For example, in Spanish-speaking adults, education was more strongly associated with Fluid scores, but showed the strongest association with Crystallized scores among English-speaking adults. Demographic factors were no longer associated with fully corrected scores. The original norms were not successful in eliminating demographic effects, overestimating children's performances, and underestimating adults' performances on the Spanish NIHTB-CB. The disparate pattern of demographic associations on the Spanish versus English NIHTB-CB supports the need for distinct normative standards developed separately for each population. Fully adjusted scores presented here will aid in more accurately characterizing acquired brain dysfunction among U.S. Spanish-speakers.

BACKGROUND: Recent advances in understanding molecular and synaptic mechanisms of intellectual disabilities (ID) in fragile X syndrome (FXS) and Down syndrome (DS) through animal models have led to targeted controlled trials with pharmacological agents designed to normalize these underlying mechanisms and improve clinical outcomes. However, several human clinical trials have failed to demonstrate efficacy of these targeted treatments to improve surrogate behavioral endpoints. Because the ultimate index of disease modification in these disorders is amelioration of ID, the validation of cognitive measures for tracking treatment response is essential. Here, we present preliminary research to validate the National Institutes of Health Toolbox Cognitive Battery (NIH-TCB) for ID. METHODS: We completed three pilot studies of patients with FXS (total n = 63; mean age 19.3 ± 8.3 years, mean mental age 5.3 ± 1.6 years), DS (n = 47; mean age 16.1 ± 6.2, mean mental age 5.4 ± 2.0), and idiopathic ID (IID; n = 16; mean age 16.1 ± 5.0, mean mental age 6.6 ± 2.3) measuring processing speed, executive function, episodic memory, word/letter reading, receptive vocabulary, and working memory using the web-based NIH-TB-CB, addressing feasibility, test-retest reliability, construct validity, ecological validity, and syndrome differences and profiles. RESULTS: Feasibility was good to excellent (≥80 % of participants with valid scores) for above mental age 4 years for all tests except list sorting (working memory). Test-retest stability was good to excellent, and convergent validity was similar to or better than results obtained from typically developing children in the normal sample for executive function and language measures. Examination of ecological validity revealed moderate to very strong correlations between the NIH-TCB composite and adaptive behavior and full-scale IQ measures. Syndrome/group comparisons demonstrated significant deficits for the FXS and DS groups relative to IID on attention and inhibitory control, a significant reading weakness for FXS, and a receptive vocabulary weakness for DS. CONCLUSIONS: The NIH-TCB has potential for assessing important dimensions of cognition in persons with ID, and several tests may be useful for tracking response to intervention. However, more extensive psychometric studies, evaluation of the NIH-TCBs sensitivity to change, both developmentally and in the context of treatment, and perhaps establishing links to brain function in these populations, are required to determine the true utility of the battery as a set of outcome measures.

BackgroundRecent advances in understanding molecular and synaptic mechanisms of intellectual disabilities (ID) in fragile X syndrome (FXS) and Down syndrome (DS) through animal models have led to targeted controlled trials with pharmacological agents designed to normalize these underlying mechanisms and improve clinical outcomes. However, several human clinical trials have failed to demonstrate efficacy of these targeted treatments to improve surrogate behavioral endpoints. Because the ultimate index of disease modification in these disorders is amelioration of ID, the validation of cognitive measures for tracking treatment response is essential. Here, we present preliminary research to validate the National Institutes of Health Toolbox Cognitive Battery (NIH-TCB) for ID.MethodsWe completed three pilot studies of patients with FXS (total n = 63; mean age 19.3 ± 8.3 years, mean mental age 5.3 ± 1.6 years), DS (n = 47; mean age 16.1 ± 6.2, mean mental age 5.4 ± 2.0), and idiopathic ID (IID; n = 16; mean age 16.1 ± 5.0, mean mental age 6.6 ± 2.3) measuring processing speed, executive function, episodic memory, word/letter reading, receptive vocabulary, and working memory using the web-based NIH-TB-CB, addressing feasibility, test-retest reliability, construct validity, ecological validity, and syndrome differences and profiles.ResultsFeasibility was good to excellent (≥80 % of participants with valid scores) for above mental age 4 years for all tests except list sorting (working memory). Test-retest stability was good to excellent, and convergent validity was similar to or better than results obtained from typically developing children in the normal sample for executive function and language measures. Examination of ecological validity revealed moderate to very strong correlations between the NIH-TCB composite and adaptive behavior and full-scale IQ measures. Syndrome/group comparisons demonstrated significant deficits for the FXS and DS groups relative to IID on attention and inhibitory control, a significant reading weakness for FXS, and a receptive vocabulary weakness for DS.ConclusionsThe NIH-TCB has potential for assessing important dimensions of cognition in persons with ID, and several tests may be useful for tracking response to intervention. However, more extensive psychometric studies, evaluation of the NIH-TCB's sensitivity to change, both developmentally and in the context of treatment, and perhaps establishing links to brain function in these populations, are required to determine the true utility of the battery as a set of outcome measures.

PurposeWe used MAPP data to identify participants with urological chronic pelvic pain syndromes only or a chronic functional nonurological associated somatic syndrome in addition to urological chronic pelvic pain syndromes. We characterized these 2 subgroups and explored them using 3 criteria, including 1) MAPP eligibility criteria, 2) self-reported medical history or 3) RICE criteria.Materials and methodsSelf-reported cross-sectional data were collected on men and women with urological chronic pelvic pain syndromes, including predominant symptoms, symptom duration and severity, nonurological associated somatic syndrome symptoms and psychosocial factors.ResultsOf 424 participants with urological chronic pelvic pain syndromes 162 (38%) had a nonurological associated somatic syndrome, including irritable bowel syndrome in 93 (22%), fibromyalgia in 15 (4%), chronic fatigue syndrome in 13 (3%) and multiple syndromes in 41 (10%). Of 233 females 103 (44%) had a nonurological associated somatic syndrome compared to 59 of 191 males (31%) (p = 0.006). Participants with a nonurological associated somatic syndrome had more severe urological symptoms and more frequent depression and anxiety. Of 424 participants 228 (54%) met RICE criteria. Of 228 RICE positive participants 108 (47%) had a nonurological associated somatic syndrome compared to 54 of 203 RICE negative patients (28%) with a nonurological associated somatic syndrome (p < 0.001).ConclusionsNonurological associated somatic syndromes represent important clinical characteristics of urological chronic pelvic pain syndromes. Participants with a nonurological associated somatic syndrome have more severe symptoms, longer duration and higher rates of depression and anxiety. RICE positive patients are more likely to have a nonurological associated somatic syndrome and more severe symptoms. Because nonurological associated somatic syndromes are more common in women, future studies must account for this potential confounding factor in urological chronic pelvic pain syndromes.

BackgroundAlthough the Six-Minute Walk Test (6MWT), as recommended by the American Thoracic Society, is widely used as a measure of functional endurance, it may not be applicable in some settings and populations. We sought to examine, therefore, performance over the first 2 minutes and the full 6 minutes of the 6MWT. Specifically, we investigated completion rates, distances walked, test-retest reliability, and the relationship between distances walked over the first 2 and the full 6 minutes of the 6MWT.MethodsCommunity-dwelling children and adults age 3-85 years (n = 337) were asked to walk back and forth on a 15.24 meter (50 ft) course as far as possible without running over a 6 minute period. Test completion and the distance covered by the participants at 2 and 6 minutes were documented. The reliability of distances covered at 2 and 6 minutes was determined by retesting a subsample of 54 participants 6 to 10 days later. The relationship between distances covered at 2 and 6 minutes was determined for the 330 participants completing the 6MWT.ResultsAll 337 participants completed at least 2 minutes of walking, but 7 children less than 5 years of age ceased walking before 6 minutes had elapsed. For the remaining 330 participants the mean distance walked was 186 meters at 2 minutes and 543 meters at 6 minutes. The distances covered at 2 and 6 minutes were reliable between sessions (intraclass correlation coefficients = 0.888 and 0.917, respectively). The distances covered over 2 and 6 minutes were highly correlated (r = 0.968).ConclusionsThe completion rate, values obtained, test-retest reliability, and relationship of the distances walked in 2 and 6 minutes support documentation of 2 minute distance during the 6MWT. The findings also provide support for use of a Two-Minute Walk Test as the endurance component in the Motor Battery of the NIH Toolbox.

Language facilitates communication and efficient encoding of thought and experience. Because of its essential role in early childhood development, in educational achievement and in subsequent life adaptation, language was included as one of the subdomains in the NIH Toolbox for the Assessment of Neurological and Behavioral Function Cognition Battery (NIHTB-CB). There are many different components of language functioning, including syntactic processing (i.e., morphology and grammar) and lexical semantics. For purposes of the NIHTB-CB, two tests of language--a picture vocabulary test and a reading recognition test--were selected by consensus based on literature reviews, iterative expert input, and a desire to assess in English and Spanish. NIHTB-CB's picture vocabulary and reading recognition tests are administered using computer adaptive testing and scored using item response theory. Data are presented from the validation of the English versions in a sample of adults ages 20-85 years (Spanish results will be presented in a future publication). Both tests demonstrated high test-retest reliability and good construct validity compared to corresponding gold-standard measures. Scores on the NIH Toolbox measures were consistent with age-related expectations, namely, growth in language during early development, with relative stabilization into late adulthood.

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20-85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: "Crystallized Cognition Composite," "Fluid Cognition Composite," and "Total Cognition Composite" scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach's alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test-retest reliability (r: 0.86-0.92), strong convergent (r: 0.78-0.90) and discriminant (r: 0.19-0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=-0.68 fluid, r=-0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies.

This study introduces a special series on validity studies of the Cognition Battery (CB) from the U.S. National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function (NIHTB) (Gershon, Wagster et al., 2013) in an adult sample. This first study in the series describes the sample, each of the seven instruments in the NIHTB-CB briefly, and the general approach to data analysis. Data are provided on test-retest reliability and practice effects, and raw scores (mean, standard deviation, range) are presented for each instrument and the gold standard instruments used to measure construct validity. Accompanying papers provide details on each instrument, including information about instrument development, psychometric properties, age and education effects on performance, and convergent and discriminant construct validity. One study in the series is devoted to a factor analysis of the NIHTB-CB in adults and another describes the psychometric properties of three composite scores derived from the individual measures representing fluid and crystallized abilities and their combination. The NIHTB-CB is designed to provide a brief, comprehensive, common set of measures to allow comparisons among disparate studies and to improve scientific communication.

Episodic memory is one of the most important cognitive domains that involves acquiring, storing and recalling new information. In this article, we describe a new measure developed for the NIH Toolbox, called the Picture Sequence Memory Test (PSMT) that is the first to examine episodic memory across the age range from 3 to 85. We describe the development of the measure and present validation data for ages 20 to 85. The PSMT involves presentation of sequences of pictured objects and activities in a fixed order on a computer screen and simultaneously verbally described, that the participant must remember and then reproduce over three learning trials. The results indicate good test-retest reliability and construct validity. Performance is strongly related to well-established "gold standard" measures of episodic memory and, as expected, much less well correlated with those of a measure of vocabulary. It shows clear decline with aging in parallel with a gold standard summary measure and relates to several other demographic factors and to self-reported general health status. The PSMT appears to be a reliable and valid test of episodic memory for adults, a finding similar to those found for the same measure with children.

The List Sorting Working Memory Test was designed to assess working memory (WM) as part of the NIH Toolbox Cognition Battery. List Sorting is a sequencing task requiring children and adults to sort and sequence stimuli that are presented visually and auditorily. Validation data are presented for 268 participants ages 20 to 85 years. A subset of participants (N=89) was retested 7 to 21 days later. As expected, the List Sorting Test had moderately high correlations with other measures of working memory and executive functioning (convergent validity) but a low correlation with a test of receptive vocabulary (discriminant validity). Furthermore, List Sorting demonstrates expected changes over the age span and has excellent test-retest reliability. Collectively, these results provide initial support for the construct validity of the List Sorting Working Memory Measure as a measure of working memory. However, the relationship between the List Sorting Test and general executive function has yet to be determined.

The objective of this study is to evaluate the construct validity of the NIH Neurobehavioral Toolbox Cognitive Health Battery (NIHTB-CHB) in adults. Confirmatory factor analysis was used to evaluate the dimensional structure underlying the NIHTB-CHB and Gold Standard tests chosen to serve as concurrent validity criteria for the NIHTB-CHB. These results were used to evaluate the convergent and discriminant validity of the NIHTB-CHB in adults ranging from 20 to 85 years of age. Five dimensions were found to explain the correlations among NIHTB-CHB and Gold Standard tests: Vocabulary, Reading, Episodic Memory, Working Memory and Executive Function/Processing Speed. NIHTB-CHB measures and their Gold Standard analogues defined factors in a pattern that broadly supported the convergent and discriminant validity of the NIHTB-CHB tests. This 5-factor structure was found to be invariant across 20-60 year old (N=159) and 65-85 year old (N=109) age groups that were included in the current validity study. Second order Crystallized Abilities (Vocabulary and Reading) and Fluid Abilities (Episodic Memory, Working Memory, Executive/Speed) factors parsimoniously explained correlations among the five first order factors. These results suggest that the NIHTB-CHB will provide both fine-grained and broad characterization of cognition across the adult age span.

Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p <.001). Test-retest reliability was marginal (ICC =.49, p <.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p <.001), while correlations with discriminant measures were small (ρ =.23 to.27, p <.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p <.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p <.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p <.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR]

We applied a novel hierarchical Bayesian weighted quantile sum (HBWQS) regression to combine data across 3 study sites to examine associations between prenatal exposure to metals and cognitive functioning in childhood. Data from 326 mother-child dyads enrolled in an ongoing cohort study, the Programming of Intergenerational Stress Mechanisms (PRISM) Study, based in New York, New York (recruitment in 2013–2020) and Boston, Massachusetts (recruitment 2011–2013), and the First Thousand Days of Life (FTDL) cohort study (recruitment 2012–2019), based in northern Virginia, were used. Arsenic, cadmium, manganese, lead, and antimony were measured in urine collected during pregnancy. Cognitive functioning was assessed in children aged 3–11 years using the National Institutes of Health Toolbox Cognition Battery. The HBWQS regression showed a negative association between the urinary metal mixture and the Cognition Early Childhood Composite Score in the PRISM New York City (β = −3.67, 95% credible interval (CrI): −7.61, −0.01) and FTDL (β = −3.76, 95% CrI: −7.66, −0.24) samples, with a similar trend in the PRISM Boston sample (β = −3.24, 95% CrI: −6.77, 0.144). We did not detect these associations in traditionally pooled models. HBWQS regression allowed us to account for site heterogeneity and detect associations between prenatal metal-mixture exposure and cognitive outcomes in childhood. Given the ubiquity of metals exposure, interventions aimed at reducing prenatal exposure may improve cognitive outcomes in children. This article is part of a Special Collection on Environmental Epidemiology. [ABSTRACT FROM AUTHOR]

Timely detection of cognitive impairment (CI) is critical for the wellbeing of elderly individuals. The MyCog assessment employs two validated iPad-based measures from the NIH Toolbox® for Assessment of Neurological and Behavioral Function (NIH Toolbox). These measures assess pivotal cognitive domains: Picture Sequence Memory (PSM) for episodic memory and Dimensional Change Card Sort Test (DCCS) for cognitive flexibility. The study involved 86 patients and explored diverse machine learning models to enhance CI prediction. This encompassed traditional classifiers and neural-network-based methods. After 100 bootstrap replications, the Random Forest model stood out, delivering compelling results: precision at 0.803, recall at 0.758, accuracy at 0.902, F1 at 0.742, and specificity at 0.951. Notably, the model incorporated a composite score derived from a 2-parameter higher order item response theory (HOIRT) model that integrated DCCS and PSM assessments. The study's pivotal finding underscores the inadequacy of relying solely on a fixed composite score cutoff point. Instead, it advocates for machine learning models that incorporate HOIRT-derived scores and encompass relevant features such as age. Such an approach promises more effective predictive models for CI, thus advancing early detection and intervention among the elderly. [ABSTRACT FROM AUTHOR]