Search

Objective Adverse childhood experiences (ACEs) are commonly reported in individuals presenting for attention-deficit hyperactivity disorder (ADHD) evaluation. Performance validity tests (PVTs) and symptom validity tests (SVTs) are essential to ADHD evaluations in young adults, but extant research suggests that those who report ACEs may be inaccurately classified as invalid on these measures. The current study aimed to assess the degree to which ACE exposure differentiated PVT and SVT performance and ADHD symptom reporting in a multi-racial sample of adults presenting for ADHD evaluation. Method This study included 170 adults referred for outpatient neuropsychological ADHD evaluation who completed the ACE Checklist and a neurocognitive battery that included multiple PVTs and SVTs. Analysis of variance was used to examine differences in PVT and SVT performance among those with high (≥4) and low (≤3) reported ACEs. Results Main effects of the ACE group were observed, such that high ACE group reporting demonstrated higher scores on SVTs assessing ADHD symptom over-reporting and infrequent psychiatric and somatic symptoms on the Minnesota Multiphasic Personality Inventory-2-Restructured Form. Conversely, no significant differences emerged in total PVT failures across ACE groups. Conclusions Those with high ACE exposure were more likely to have higher scores on SVTs assessing over-reporting and infrequent responses. In contrast, ACE exposure did not affect PVT performance. Thus, ACE exposure should be considered specifically when evaluating SVT performance in the context of ADHD evaluations, and more work is needed to understand factors that contribute to different patterns of symptom reporting as a function of ACE exposure. [ABSTRACT FROM AUTHOR]

Objective The objective of this study was to determine base rates of response bias in veterans and service members (SM) referred specifically for attention-deficit/hyperactivity disorder (ADHD) evaluation. Method Observational study of various performance validity tests (PVTs) and symptom validity tests (SVTs) in a sample of SMs (n  = 94) and veterans (n  = 504) referred for clinical evaluation of ADHD. Results SVT and PVT failure rates were similar between the samples, but they were lower than previous Veterans Affairs (VA) and SM studies that were not exclusive to ADHD evaluations. Invalid reporting across all SVT scales on the Minnesota Multiphasic Personality Inventory and Personality Assessment Inventory was relatively uncommon, with rates of invalid scores falling at less than 7%. In both samples, free-standing PVTs were failed at about 22%. Conclusions Although the base rates of PVT and SVT failures in ADHD-specific evaluations were lower than previously published data on non-ADHD-specific evaluations in veterans and SMs, the current study continues to support the inclusion of these measures. [ABSTRACT FROM AUTHOR]

Objective The Test of Practical Judgment (TOP-J) is a stand-alone judgment measure that is considered to tap into aspects of executive functioning (EF) and inform clinical predictions of daily functioning in older adults. Past validation research is variable and has some limitations. The present study sought to examine the reliability and construct, criterion, and incremental validities of scores on TOP-J 9-item version (TOP-J/9). Method Participants were 95 community-dwelling older adults aged 60 to 85. Participants completed TOP-J/9, measures of EF and global cognition, and three different modalities of instrumental activities of daily living (IADLs) (self-report, performance-based tasks conducted in the laboratory, and performance-based tasks completed at home over 3 weeks). Results TOP-J/9 scores showed adequate internal consistency (α = 0.73) after correcting for the low number of items. TOP-J/9 was correlated with global cognition and EF, although EF did not survive correction for lower-order processes. Finally, although TOP-J/9 scores were associated with home-based IADL tasks (but not with self-report and laboratory-based IADLs), providing some evidence of criterion validity, they did not incrementally contribute to home-based IADL performance beyond other cognitive measures. However, when two items pertaining to social/ethical judgment were removed, this modified version of TOP-J did relate to EF beyond lower-order processes and contributed uniquely to prediction of home-based IADLs beyond other measures. Conclusion Results suggest that TOP-J/9 taps into global cognitive status (but not necessarily EF) and predicts "real-world" functioning (but not above and beyond other cognitive measures). TOP-J psychometrics may be improved by removing two social/ethical items. [ABSTRACT FROM AUTHOR]

Objective The goal of this study was to determine the base rates of failing proposed embedded validity indicators (EVIs) for the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) in the normative sample. Method Participants included adults in the NIHTB-CB normative sample with data to calculate age-adjusted standard scores (n  = 855; ages: M (SD) = 46.9(17.3), range: 18–85; 65.0% women; education: M (SD) = 14.1(2.5) years) or demographically adjusted T -scores (n  = 803; ages: M (SD) = 47.3(17.3), range: 18–85; 65.3% women; education: M (SD) = 14.2(2.5) years) for all tests. The NIHTB-CB includes two tests of crystallized cognition and five tests of fluid cognition. Individual norm-referenced test performances were categorized as falling above or below liberal and conservative cutoffs based on proposed univariate EVIs. The number of univariate EVI failures was summed to compute multivariable EVIs. EVI failure rates above 10% were considered high false-positive rates, indicating specificity < .90. Using chi-square analyses, the frequencies of EVI failures were compared based on gender, race/ethnicity, education, and crystallized composite. Results The multivariable EVIs had predominantly low false-positive rates in the normative sample. EVI failure rates were most common among participants with low crystallized composites. Using age-adjusted standard scores, EVI failure rates varied by education, race/ethnicity, and estimated premorbid intelligence. These differences were mostly eliminated when using demographically adjusted T -scores. Conclusions Multivariable EVIs requiring ≥ 4 failures using liberal cutoffs or ≥ 3 failures using conservative cutoffs had acceptable false-positive rates (i.e. < 10%) using both age-adjusted standard scores and demographically adjusted T -scores. These multivariable EVIs could be applied to large data sets with NIHTB-CB data to screen for potentially invalid test performances. [ABSTRACT FROM AUTHOR]

Objective Marketed as a validity test that detects feigning of posttraumatic stress disorder (PTSD), the Morel Emotional Numbing Test for PTSD (MENT) instructs examinees that PTSD may negatively affect performance on the measure. This study explored the potential that MENT performance depends on inclusion of "PTSD" in its instructions and the nature of the MENT as a performance validity versus a symptom validity test (PVT/SVT). Method 358 participants completed the MENT as a part of a clinical neuropsychological evaluation. Participants were either administered the MENT with the standard instructions (SIs) that referenced "PTSD" or revised instructions (RIs) that did not. Others were administered instructions that referenced "ADHD" rather than PTSD (AI). Comparisons were conducted on those who presented with concerns for potential traumatic-stress related symptoms (SI vs. RI-1) or attention deficit (AI vs. RI-2). Results Participants in either the SI or AI condition produced more MENT errors than those in their respective RI conditions. The relationship between MENT errors and other S/PVTs was significantly stronger in the SI: RI-1 comparison, such that errors correlated with self-reported trauma-related symptoms in the SI but not RI-1 condition. MENT failure also predicted PVT failure at nearly four times the rate of SVT failure. Conclusions Findings suggest that the MENT relies on overt reference to PTSD in its instructions, which is linked to the growing body of literature on "diagnosis threat" effects. The MENT may be considered a measure of suggestibility. Ethical considerations are discussed, as are the construct(s) measured by PVTs versus SVTs. [ABSTRACT FROM AUTHOR]

Objective Traditional measures of cognitive abilities most used by neuropsychologists are generally low in ecological validity and only capture a small proportion of the variance of a person's true functional capacity. This study evaluates the association between clinic-based performance and parallel real-world completion of an everyday planning test, the Overnight Trip Task (OTT). Method A cross-sectional cohort of 65 community-dwelling older adults completed a battery of cognitive assessments and two formats of the OTT: the paper-and-pencil clinic OTT, which was completed remotely through video conferencing (Zoom), and the parallel real-world OTT (RW-OTT), which was completed at home between sessions. Both formats required participants to plan for what they would pack and prepare for a hypothetical overnight trip based on a provided story that included rules and embedded contingencies. Results The clinic OTT demonstrated a small-to-moderate relationship with the RW-OTT (r  = 0.35) and no relationship with measures of learning, long delay recall, an executive function composite, and a measure of everyday planning. Hierarchical regressions indicated that the clinic OTT demonstrated incremental validity above an executive function composite measure and global cognition when predicting self-reported everyday functioning and RW-OTT performance. Conclusions The clinic OTT showed only modest association with the RW-OTT and discriminate but not convergent validity was demonstrated. The clinic OTT showed incremental validity when predicting self-reported everyday functioning and RW-OTT performance above more traditional measures. Before the clinic OTT could be considered a reliable and valid clinic-based measure for predicting real-world behavior, additional research would be needed. [ABSTRACT FROM AUTHOR]

Objective: The Reliable Digit Span (RDS) is an embedded measure used to assess performance validity. The purpose of this study was to determine whether the RDS can be used with Spanish speakers from Latin America. Method: The Digit Span subtest of the Wechsler Adult Intelligence Scale-IV was administered to 66 Spanish-speaking patients, 66 English-speaking patients, and 30 Spanish-speaking normal controls. The Spanish-speaking patients had a mean age of 65.82 (standard deviation [SD] = 12.44) and mean education of 6.62 years (SD = 4.91), whereas the controls had a mean age of 48.27 (SD = 10.97) and mean education of 8.33 (SD = 3.04). The English-speaking patients had a mean age of 56.44 (SD = 13.53) and mean education of 12.14 (SD = 2.37). Results: The average RDS among the Spanish-speaking patients was 5.36 (SD = 1.27) and the average RDS among the controls was 5.90 (SD = 1.06). The mean RDS of the English-speaking patients was 7.83 (SD = 1.72). The modal RDS among Spanish-speaking patients was 5. The modal RDS among Spanish-speaking controls was also 5, though the distribution was bimodal in nature with nearly as many 7 s as 5 s. The modal RDS among the English-speaking patients was 7. Among patients with ≥9 years of education and controlling for age, there remained a significant difference between both language patient groups on the RDS (F(1, 79) = 30.85, p < .0001). Conclusions: These data suggest that the RDS may not be a valuable measure in assessing performance validity among monolingual Spanish speakers from Latin America, particularly among those with low levels of education. [ABSTRACT FROM AUTHOR]

Objective It is essential to interpret performance validity tests (PVTs) that are well-established and have strong psychometrics. This study evaluated the Child and Adolescent Memory Profile (ChAMP) Validity Indicator (VI) using a pediatric sample with traumatic brain injury (TBI). Method A cross-sectional sample of N  = 110 youth (mean age = 15.1 years, standard deviation [ SD ] = 2.4 range = 8–18) on average 32.7 weeks (SD  = 40.9) post TBI (71.8% mild/concussion; 3.6% complicated mild; 24.6% moderate-to-severe) were administered the ChAMP and two stand-alone PVTs. Criterion for valid performance was scores above cutoffs on both PVTs; criterion for invalid performance was scores below cutoffs on both PVTs. Classification statistics were used to evaluate the existing ChAMP VI and establish a new VI cutoff score if needed. Results There were no significant differences in demographics or time since injury between those deemed valid (n  = 96) or invalid (n  = 14), but all ChAMP scores were significantly lower in those deemed invalid. The original ChAMP VI cutoff score was highly specific (no false positives) but also highly insensitive (sensitivity [SN] = .07, specificity [SP] = 1.0). Based on area under the curve (AUC) analysis (0.94), a new cutoff score was established using the sum of scaled scores (VI-SS). A ChAMP VI-SS score of 32 or lower achieved strong SN (86%) and SP (92%). Using a 15% base rate, positive predictive value was 64% and negative predictive value was 97%. Conclusions The originally proposed ChAMP VI has insufficient SN in pediatric TBI. However, this study yields a promising new ChAMP VI-SS, with classification metrics that exceed any other current embedded PVT in pediatrics. [ABSTRACT FROM AUTHOR]

Objective This study explored the specificity of four embedded performance validity tests (PVTs) derived from common neuropsychological tasks in a sample of older veterans with verified cognitive decline and whose performance was deemed valid by licensed psychologists. Method Participants were 180 veterans who underwent comprehensive neuropsychological evaluation, were determined to have valid performance following profile analysis/conceptualization, and were diagnosed with mild neurocognitive disorder (i.e. MCI; n  = 64) or major neurocognitive disorder (i.e. Dementia; n =  116). All participants completed at least one of four embedded PVTs: Reliable Digit Span (RDS), California Verbal Learning Test—2nd ed. Short Form (CVLT-II SF) Forced choice, Trails B:A, and Delis-Kaplan Executive Function System (DKEFS) Letter and Category Fluency. Results Adequate specificity (i.e. ≥90%) was achieved at modified cut-scores for all embedded PVTs across MCI and Dementia groups. Trails B:A demonstrated near perfect specificity at its traditional cut-score (Trails B:A < 1.5). RDS ≤ 5 and CVLT-II SF Forced Choice ≤7 led to <10% false positive classification errors across MCI and dementia groups. DKEFS Letter and Category Fluency achieved 90% specificity at extremely low normative cut-scores. Conclusions RDS, Trails B:A, and CVLT-II SF Forced Choice reflect promising embedded PVTs in the context of dementia evaluations. DKEFS Letter and Category Fluency appear too sensitive to genuine neurocognitive decline and, therefore, are inappropriate PVTs in adults with MCI or dementia. Additional research into embedded PVT sensitivity (via known-groups or analogue designs) in MCI and dementia is needed. [ABSTRACT FROM AUTHOR]

Objective Reliable Digit Span (RDS), RDS-Revised (RDS-R), and age-corrected scaled score (ACSS) have been previously validated as embedded performance validity tests (PVTs) from the Wechsler Adult Intelligence Scale-IV Digit Span subtest (WAIS-IV DS). However, few studies have directly compared the relative utility of these and other proposed WAIS-IV DS validity indicators within a single sample. Method This study compared classification accuracies of 10 WAIS-IV DS indices in a mixed neuropsychiatric sample of 227 outpatients who completed a standardized neuropsychological battery. Participants with ≤1 PVT failures of the four, freestanding criterion PVTs constituted the valid group (n  = 181), whereas those with ≥2 PVT failures formed the invalid group (n  = 46). Among the valid group, 113 met criteria for mild cognitive impairment (MCI). Results Classification accuracies for all DS indicators were statistically significant across the overall sample and subsamples with and without MCI, apart from indices derived from the Forward trial in the MCI sample. DS Sequencing ACSS, working memory RDS (wmRDS), and DS ACSS emerged as the most effective predictors of validity status, with acceptable to excellent classification accuracy for the overall sample (AUCs = 0.792–0.816; 35%–50% sensitivity/88%–96% specificity). Conclusions Although most DS indices demonstrated clinical utility as embedded PVTs, DS Sequencing ACSS, wmRDS, and DS ACSS may be particularly robust to cognitive impairment, minimizing risk of false positive errors while identifying noncredible performance. Moreover, DS indices incorporating data from multiple trials (i.e. wmRDS, DS ACSS) also generally yielded greater classification accuracy than those derived from a single trial. [ABSTRACT FROM AUTHOR]

Objective The Western Australia Olfactory Memory Test (WAOMT) is a newly developed test designed to meet a need for a comprehensive measure of olfactory episodic memory (OEM) for clinical and research applications. Method This study aimed to establish the psychometric properties of the WAOMT in a sample of 209 community-dwelling older adults. An independent sample of 27 test-naïve participants were recruited to assess test retest reliability (between 7 and 28 days). Scale psychometric properties were examined using item response theory methods, combined samples (final N  = 241). Convergent validity was assessed by comparing performance on the WAOMT with a comprehensive neuropsychological battery of domains (verbal and visual episodic memory, and odor identification), as well as other neuropsychological skills. Based on previous literature, it was predicted that the WAOMT would be positively correlated with conceptually similar cognitive domains. Results The WAOMT is a psychometrically sound test with adequate reliability properties and demonstrated convergent validity with tests of verbal and episodic memory and smell identification. Patterns of performance highlight learning and memory characteristics unique to OEM (e.g. learning curves, cued and free recall). Conclusion Clinical and research implications include streamlining future versions of the WAOMT to ease patient and administrative burden, and the potential to reliably detect early neuropathological changes in healthy older adults with nonimpaired OEM abilities. [ABSTRACT FROM AUTHOR]

The Automated Neuropsychological Assessment Metrics (ANAM) is one of the most widely used and validated neuropsychological instruments for assessing cognition. The ANAM Test System includes a reporting tool, the ANAM Validity Indicator Report that generates scores for the embedded effort measure, the ANAM Performance Validity Index (APVI). The current study seeks to develop a proxy for the APVI, using raw subtest summary test scores. This would be useful for situations where the APVI score is unavailable (e.g. validity report not generated at the time of the assessment) or when the item level data needed to generate this score are inaccessible. ANAM scores from a large data set of 1,000,000+ observations were used for this retrospective analysis. Results of linear regression analysis suggest that the APVI can be reasonably estimated from the raw subtest summary test scores that are presented on the ANAM Performance Report. Clinically, this means that an important step in the interpretation process, checking the validity of test data, can still be performed even when the APVI is not available. [ABSTRACT FROM AUTHOR]

Objective This study examined the relative contribution of performance and symptom validity in litigating adults with traumatic brain injury (TBI), as a function of TBI severity, and examined the relationship between self-reported emotional symptoms and cognitive tests scores while controlling for validity test performance. Method Participants underwent neuropsychological assessment between January 2012 and June 2021 in the context of compensation-seeking claims related to a TBI. All participants completed a cognitive test battery, the Personality Assessment Inventory (including symptom validity tests; SVTs), and multiple performance validity tests (PVTs). Data analyses included independent t -tests, one-way ANOVAs, correlation analyses, and hierarchical multiple regression. Results A total of 370 participants were included. Atypical PVT and SVT performance were associated with poorer cognitive test performance and higher emotional symptom report, irrespective of TBI severity. PVTs and SVTs had an additive effect on cognitive test performance for uncomplicated mTBI, but less so for more severe TBI. The relationship between emotional symptoms and cognitive test performance diminished substantially when validity test performance was controlled, and validity test performance had a substantially larger impact than emotional symptoms on cognitive test performance. Conclusion Validity test performance has a significant impact on the neuropsychological profiles of people with TBI, irrespective of TBI severity, and plays a significant role in the relationship between emotional symptoms and cognitive test performance. Adequate validity testing should be incorporated into every neuropsychological assessment, and associations between emotional symptoms and cognitive outcomes that do not consider validity testing should be interpreted with extreme caution. [ABSTRACT FROM AUTHOR]

Objective Testamentary capacity (TC) is a legal construct, which concerns a person's mental capacity to make or amend a will. Although expert clinicians are frequently asked to assess TC in forensic settings, there are few instruments and little empirical research to inform and guide their assessments. The present study describes the development and psychometric properties of a standardized assessment measure of TC (Testamentary Capacity Instrument-TCI), and investigates its reliability and validity. Methods The TCI is an interview-based, psychometric measure, which assesses a testator's knowledge of four conceptual elements, which together comprise the legal basis for TC in the Anglo-American legal system: (1) what a will is, (2) nature and extent of assets/property, (3) possible heirs/claimants to property, and (4) plan to distribute assets to heirs after death. Cronbach's alpha and percentage exact agreement were used to examine TCI element reliabilities. Using independent samples t -tests, MANOVA and MANCOVA, we investigated validity by comparing TCI element performance of cognitively intact older adults (n  = 22) and older adults with ad dementia (n  = 20). Results The TCI elements showed good internal consistency and good inter-rater reliability. The ad group performed significantly below the control group on all four TCI elements, with effect sizes exceeding 1.2, suggesting that the TCI has content and construct validity. Conclusions Relative to cognitively intact older adults, older adults with ad dementia showed significant impairment on all four TCI conceptual elements. The TCI has promise as a standardized quantitative measure of TC to support clinical assessment of TC in forensic settings. [ABSTRACT FROM AUTHOR]

Objective We aimed to assess the utility of a novel and easy-to-administer performance validity test (PVT), the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Forced Choice recognition trial (RFC), compared with previously developed RBANS PVTs. Method We compared the RFC with the RBANS Effort Index (EI) and Effort Scale (ES) in a sample of 62 non-litigating older adults (mean age = 74 years, 52% female) with varying levels of cognitive impairment. Results A significantly greater proportion of the sample met EI criteria for non-credible performance (EI > 2; 31%) compared with RFC criteria (RFC < 9; 15%). Among participants with Major Neurocognitive Disorder, 60% met EI criteria for non-credible performance, 32% met ES criteria (ES > 12), and 24% met RFC criteria. Conclusions The RFC may have greater specificity than other RBANS PVTs among individuals with more severe cognitive impairment. Further research is needed to establish the classification accuracy of the RFC for assessing performance validity. [ABSTRACT FROM AUTHOR]

Background Cognitive symptoms in the absence of neurological disease are common. Functional cognitive disorder (FCD) has been conceptualized as a cognitive subtype of functional neurological disorder. Although FCD is understood as different from exaggerated or feigned cognitive complaints, previous accounts have provided little practical advice on how FCD can be separated from factitious or malingered cognitive complaints. Also, the distinction of FCD from other medical or mental health disorders that impact on cognition is an area of ongoing study and debate. Diagnostic precision is important to prevent iatrogenesis and for the development of needed treatment protocols. Method We summarize the current literature and present seven anonymized case vignettes to characterize the challenges in this area and develop proposals for solutions. Results/Conclusions Recognizing the limitations of categorical diagnostic systems, we position FCD as distinct from feigning and cognitive symptoms of psychiatric disorders, although with overlapping features. We set out typical clinical features and neuropsychological profiles for each category of cognitive disorder and a statistical method to analyze performance validity tests/effort tests to assist in determining feigned or invalid responding. [ABSTRACT FROM AUTHOR]

Objective Individuals with early-onset dysexecutive Alzheimer's disease (dAD) have high rates of failed performance validity testing (PVT), which can lead to symptom misinterpretation and misdiagnosis. Method The aim of this retrospective study is to evaluate rates of failure on a common PVT, the test of memory malingering (TOMM), in a sample of clinical patients with biomarker-confirmed early-onset dAD who completed neuropsychological testing. Results We identified seventeen patients with an average age of symptom onset at 52.25 years old. Nearly fifty percent of patients performed below recommended cut-offs on Trials 1 and 2 of the TOMM. Four of six patients who completed outside neuropsychological testing were misdiagnosed with alternative etiologies to explain their symptomatology, with two of these patients' performances deemed unreliable based on the TOMM. Conclusions Low scores on the TOMM should be interpreted in light of contextual and optimally biological information and do not necessarily rule out a neurodegenerative etiology. [ABSTRACT FROM AUTHOR]

Objective Clarify procedures to correctly score Test of Premorbid Functioning (TOPF) and assess the accuracy of TOPF scores in the estimation of premorbid intellectual functioning. Method In this cross-sectional study, post-9/11 veterans (N  = 233, 84.12% male) completed the TOPF, the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV), and performance validity measures. Results All TOPF scores were significantly correlated with WAIS-IV FSIQ scores (range r  = 0.56–.73). The degree of discrepancy between TOPF scores and FSIQ varied with 10%–17% of TOPF scores deviating from FSIQ scores by one SD or more. Conclusions Proper TOPF scoring procedures are presented. The TOPF Actual and Predicted scores were related to FSIQ. However, a higher percentage of Actual and Predicted scores were discrepant from FSIQ compared with the other three TOPF estimates, arguing against their use as independent premorbid estimates. Use of the TOPF as was designed is recommended. [ABSTRACT FROM AUTHOR]

Objective Research regarding performance validity tests (PVTs) in patients with multiple sclerosis (MS) is scant, with recommended batteries for neuropsychological evaluations in this population lacking suggestions to include PVTs. Moreover, limited work has examined embedded PVTs in this population. As previous investigations indicated that nonmemory-based embedded PVTs provide clinical utility in other populations, this study sought to determine if a logistic regression-derived PVT formula can be identified from selected nonmemory variables in a sample of patients with MS. Method A total of 184 patients (M age = 48.45; 76.6% female) with MS were referred for neuropsychological assessment at a large, Midwestern academic medical center. Patients were placed into "credible" (n  = 146) or "noncredible" (n  = 38) groups according to performance on standalone PVT. Missing data were imputed with HOTDECK. Results Classification statistics for a variety of embedded PVTs were examined, with none appearing psychometrically appropriate in isolation (areas under the curve [AUCs] = .48–.64). Four exponentiated equations were created via logistic regression. Six, five, and three predictor equations yielded acceptable discriminability (AUC = .71–.74) with modest sensitivity (.34–.39) while maintaining good specificity (≥.90). The two predictor equation appeared unacceptable (AUC = .67). Conclusions Results suggest that multivariate combinations of embedded PVTs may provide some clinical utility while minimizing test burden in determining performance validity in patients with MS. Nonetheless, the authors recommend routine inclusion of several PVTs and utilization of comprehensive clinical judgment to maximize signal detection of noncredible performance and avoid incorrect conclusions. Clinical implications, limitations, and avenues for future research are discussed. [ABSTRACT FROM AUTHOR]

Objective In concussion populations, suboptimal task engagement detected by performance validity tests (PVTs) has been associated with poorer neuropsychological scores and greater post-concussive symptoms (PCS). This study examined if Pass/Fail status on the Test of Memory Malingering—TOMM Trial 1—differentiated the neurocognitive, emotional, and behavioral profile of pediatric patients with concussion. Method This study utilized archival data from 93 patients (mean age  = 14.56 and SD  = 2.01) with a history of concussion who were assessed at ~5–6 weeks post-injury (mean days  = 40.27 and SD  = 35.41). Individuals were divided into "Pass" and "Fail" groups based on TOMM Trial 1 performance. The testing battery included ACT, CPT-II and III, HVLT-R, WJ-III and IV ACH, ImPACT, BASC-2, and BRIEF. Results The overall pass rate on Trial 1 was 70% (mean  = 46.04 and SD  = 4.55). Findings suggested that a passing score on Trial 1 may be associated with adequate performance across the remaining two trials of the TOMM. The Fail group scored significantly lower across attention, memory, and processing speed measures when compared with the Pass group. On rating scales, significantly more concerns were endorsed with the Fail group for attention and executive functioning relative to the Pass group. Parents generally endorsed significantly more concerns for executive functioning when compared with their children's self-reported symptoms. There was a trend for the Fail group to report more PCS; however, they did not significantly differ from the Pass group for depression, anxiety, or somatization. Conclusions This study highlights the importance of utilizing PVTs when evaluating concussion recovery. [ABSTRACT FROM AUTHOR]

Objective This study examined the degree to which verbal and visuospatial memory abilities influence performance validity test (PVT) performance in a mixed clinical pediatric sample. Method Data from 252 consecutive clinical pediatric cases (M age=11.23 years, SD =4.02; 61.9% male) seen for outpatient neuropsychological assessment were collected. Measures of learning and memory (e.g. The California Verbal Learning Test-Children's Version; Child and Adolescent Memory Profile [ChAMP]), performance validity (Test of Memory Malingering Trial 1 [TOMM T1]; Wechsler Intelligence Scale for Children-Fifth Edition [WISC-V] or Wechsler Adult Intelligence Scale-Fourth Edition Digit Span indices; ChAMP Overall Validity Index), and intellectual abilities (e.g. WISC-V) were included. Results Learning/memory abilities were not significantly correlated with TOMM T1 and accounted for relatively little variance in overall TOMM T1 performance (i.e. ≤6%). Conversely, ChAMP Validity Index scores were significantly correlated with verbal and visual learning/memory abilities, and learning/memory accounted for significant variance in PVT performance (12%–26%). Verbal learning/memory performance accounted for 5%–16% of the variance across the Digit Span PVTs. No significant differences in TOMM T1 and Digit Span PVT scores emerged between verbal/visual learning/memory impairment groups. ChAMP validity scores were lower for the visual learning/memory impairment group relative to the nonimpaired group. Conclusions Findings highlight the utility of including PVTs as standard practice for pediatric populations, particularly when memory is a concern. Consistent with the adult literature, TOMM T1 outperformed other PVTs in its utility even among the diverse clinical sample with/without learning/memory impairment. In contrast, use of Digit Span indices appear to be best suited in the presence of visuospatial (but not verbal) learning/memory concerns. Finally, the ChAMP's embedded validity measure was most strongly impacted by learning/memory performance. [ABSTRACT FROM AUTHOR]

Objective This cross-sectional study examined accuracy of traditional Medical Symptom Validity Test (MSVT) validity indicators, including immediate recognition (IR), delayed recognition (DR), and consistency (CNS), as well as a novel indicator derived from the mean performance on IR, DR, and CNS across verbal, visual, and combined learning and memory impairment bands. Method A sample of 180 adult outpatients was divided into valid (n  = 150) and invalid (n  = 30) groups based on results of four independent criterion performance validity tests. Verbal and visual learning and recall were classified as indicative of no impairment, mild impairment, or severe impairment based on performance on the Rey Auditory Verbal Learning Test and Brief Visuospatial Memory Test-Revised, respectively. Results In general, individual MSVT subtests were able to accurately classify performance as valid or invalid, even in the context of severe learning and memory deficits. However, as verbal and visual memory impairment increased, optimal MSVT cut-scores diverged from manual-specified cutoffs such that DR and CNS required cut-scores to be lowered to maintain adequate specificity. By contrast, the newly proposed scoring algorithm generally showed more robust psychometric properties across the memory impairment bands. Conclusions The mean performance index, a novel scoring algorithm using the mean of the three primary MSVT subtests, may be a more robust validity indicator than the individual MSVT subtests in the context of bona fide memory impairment. [ABSTRACT FROM AUTHOR]

Objective The purpose of this study was to develop and validate an embedded measure of performance validity within the Neuropsychological Assessment Battery (NAB). Method This study involved a retrospective chart review at an outpatient neuropsychology clinic. Participants were 183 adults (ages 18–70) who completed the attention and memory modules of the NAB, as well as the Word Choice Test, Green's Medical Symptom Validity Test (MSVT), and Green's Non-Verbal MSVT, as part of a clinical neuropsychological assessment (n  = 147) or as part of a forensic neuropsychological evaluation (n  = 36). Replicating methodology utilized by Silverberg et al. (2007) for the development of the Effort Index within the Repeatable Battery for the Assessment of Neuropsychological Status, an Embedded Validity Indictor (EVI) for the NAB was developed in the present study based on Digits Forward and List Learning Long Delayed Forced-Choice Recognition (list recognition) subtests. Results Receiver operating characteristic curve analyses indicated the newly developed NAB EVI was able to significantly differentiate between valid and invalid status on stand-alone performance-validity tests, with area under the curve values ranging from 0.797 to 0.977. Optimal cutoffs for medical, forensic, and mixed samples were identified. Conclusions The newly developed NAB EVI shows promise as an embedded performance validity measure; however, due to moderate sensitivity, it should be used in combination with stand-alone performance validity tests to detect invalid performance. [ABSTRACT FROM AUTHOR]

Objective The current study aimed to validate the Performance Validity Test Coin in Hand-Extended Version (CIH-EV) in groups of healthy older adults and older adults with dementia. Method Using an analog simulation paradigm, the healthy control group and the clinical group were instructed to perform to the best of their ability, whereas the feigning older adults were instructed to simulate a memory deficit to obtain allowance, financial aid, or early retirement. Results Results showed that the control and clinical groups performed more optimally than the feigning group, although the clinical group had superior response times. The CIH-EV was insensitive to sociodemographic variables and neurocognitive functioning in all groups, demonstrated good convergent validity with other performance validity measures, and showed a reduced rate of false positives. Conclusions This study corroborates the CIH-EV's effectiveness in detecting the simulation of cognitive deficits in healthy older adults and older adults with dementia. [ABSTRACT FROM AUTHOR]

Objective Performance validity tests (PVTs) are an integral component of neuropsychological assessment. There is a need for the development of more PVTs, especially those employing covert determinations. The aim of the present study was to provide initial validation of a new computerized PVT, the Perceptual Assessment of Memory (PASSOM). Method Participants were 58 undergraduate students randomly assigned to a simulator (SIM) or control (CON) group. All participants were provided written instructions for their role prior to testing and were administered the PASSOM as part of a brief battery of neurocognitive tests. Indices of interest included response accuracy for Trials 1 and 2, and total errors across Trials, as well as response time (RT) for Trials 1 and 2, and total RT for both Trials. Results The SIM group produced significantly more errors than the CON group for Trials 1 and 2, and committed more total errors across trials. Significantly longer response latencies were found for the SIM group compared to the CON group for all RT indices examined. Linear regression modeling indicated excellent group classification for all indices studied, with areas under the curve ranging from 0.92 to 0.95. Sensitivity and specificity rates were good for several cut scores across all of the accuracy and RT indices, and sensitivity improved greatly by combining RT cut scores with the more traditional accuracy cut scores. Conclusion Findings demonstrate the ability of the PASSOM to distinguish individuals instructed to feign cognitive impairment from those told to perform to the best of their ability. [ABSTRACT FROM AUTHOR]

Objective: Cannabis is one of the most widely used substances, and although the literature shows that it affects users' cognition, it is unclear how much that impact is affected by factors such as motivation. Previous studies utilizing validity measures showed that user motivation to perform well positively impacts California Verbal Learning Test – II performance, which was higher in cannabis users who completed it immediately after a motivational statement (Macher & Earleywine, 2012). In the present study, the authors altered the order of test administration to further delineate the role motivation plays in cannabis user performance on neuropsychological measures. Method: Participants (48 cannabis users, 23 nonusers) completed a neuropsychological battery, including performance validity measures, with random assignment to a motivational or neutral condition. The test order was altered to evaluate whether a motivational statement had an effect on any subsequent test administered or a lasting effect throughout the battery. Results: Analyses revealed significant differences in performance, with users in the motivational condition performing better than users in the neutral condition on the Block Design (p = 0.006, partial eta squared = 0.157) and Digit Symbol Coding (p = 0.011, partial eta squared = 0.137) subtests of the WAIS-III (both indicating large effect sizes). Nonusers in the neutral condition performed better than nonusers in the motivational condition on multiple subtests. Conclusion: Results indicate that cannabis users exposed to the motivational statement performed better than those given a neutral statement on several neuropsychological tests. Findings suggest that cannabis users can demonstrate better cognitive performance when sufficiently motivated. [ABSTRACT FROM AUTHOR]

Objective To examine known-groups validity of a telephone administration of the total learning scores of the Rey Auditory Verbal Learning Test (RAVLT) in discriminating between people with subjective cognitive decline (SCD) and amnestic mild cognitive impairment (aMCI) and convergent validity of the telephone-RAVLT. Method In total, 83 older adults (age = 71.4 ± 7.0) with SCD or aMCI completed the RAVLT learning trials over the telephone and the Hopkins Verbal Learning Test (HVLT) in-person. Results Telephone-RAVLT total recall significantly correlated with HVLT total recall (r  = .49, p  < .001). Significant between group differences were found (effect size = 0.94). Conclusions This study provides support for known-groups and convergent validity of the telephone-RAVLT. [ABSTRACT FROM AUTHOR]

Objective Object location learning and memory may be important for older adults to successfully complete some everyday activities. Method This cross-sectional, correlational study investigated the ecological relevance of the Location Learning Test-Revised (LLT-R) in 195 community-dwelling, older adults in Western Australia. The LLT-R assesses object location learning and memory for everyday objects over five learning trials and after a 30-min delay. Knowledgeable informants provided structured ratings of participants' activities of daily living and memory symptoms. Results A greater number of errors on LLT-R total learning trials were associated with mild problems in activities of daily living (particularly in travel and household domains), but not with memory symptoms. The LLT-R's association with activities of daily living was accompanied by a small-to-medium effect size and was not better explained by demographics, global cognitive functioning, mood, or chronic medical conditions. Conclusions Findings provide some support for the ecological relevance of the LLT-R among older community-dwelling adults and suggest that object location learning may play a role in some everyday functioning problems that accompany typical aging. [ABSTRACT FROM AUTHOR]

Objective The night out task (NOT) was developed as a naturalistic, open-ended, multitasking measure that requires individuals to complete eight subtasks comparable to those encountered during real-world functioning (e.g. pack travel bag, prepare tea). We examined psychometric properties and administration feasibility of this direct observation measure within a clinic-like setting using a tablet-based coding application. Method A sample of 148 community-dwelling older adults (82% cognitively healthy; 18% mild cognitive impairment) and 57 younger adults completed the NOT along with other neurocognitive tests and questionnaires. Results Inter-rater reliability across NOT primary (i.e. time, accuracy, efficiency) and process-related (e.g. error-types, self-corrections) variables was mostly excellent. NOT primary measures showed expected patterns of convergent and discriminant validity with measures of cognition, demographics, and well-being. External validity was established by the NOT ability to distinguish between age and diagnostic (cognitively healthy vs. mild cognitive impairment) groups. Demonstrating incremental validity, the NOT primary variables (execution time in particular) were predictive of self-reported functional abilities and completion quality of in-home everyday tasks over and earlier variables such as demographics, cognition, and mobility. Conclusions These findings suggest that the NOT and its app interface, which allows for continuous logging of observations, are a feasible in-clinic measure to assess cognitive capacities important for real-world functioning. With further validation, the NOT may allow for earlier detection of functional difficulties. Understanding errors and strategies used during NOT performance could also have implications for individualized interventions. [ABSTRACT FROM AUTHOR]

Objective To assess the validity of embedded measures of performance validity, the effort index (EI) and effort scale (ES) of the repeatable battery for the assessment of neuropsychological status (RBANS), in Veterans with seizures; to compare the frequency of failure on the test of memory malingering (TOMM) in patients with epileptic versus psychogenic nonepileptic seizures (PNES). Methods Seizure diagnosis was established for 309 participants in epilepsy monitoring units using conventional diagnostic criteria who completed both the TOMM and RBANS. The criterion for performance invalidity was failure on any trial of the TOMM. We examined multiple EI and ES cutoffs to establish optimal sensitivity and specificity. Results An RBANS EI cutoff score of greater than three was optimal with specificity of.98, sensitivity of.19, and positive Likelihood Ratio of 10 but was not useful when below this cutoff. Confidence intervals indicate the need for confirmation of a failed EI with another performance validity test (PVT). No ES cutoff had sufficient specificity for clinical use. Invalid TOMM performance but not invalid RBANS performance was significantly more common in persons with PNES than in persons with epileptic seizures. Conclusions In Veterans undergoing seizure monitoring, the RBANS EI was useful as a screen when positive that requires confirmation with another PVT. The RBANS ES was not useful. Invalid performance on the TOMM was more common in persons with PNES than in persons with epileptic seizures. [ABSTRACT FROM AUTHOR]

Objective To increase sensitivity of the Test of Memory Malingering (TOMM), adjustments have been proposed, including adding consistency indices. The Invalid Forgetting Frequency Index (IFFI) is the most recently developed consistency index. While strong classification accuracy rates were originally reported, it currently lacks cross-validation. Method A sample of 184 outpatients was utilized. Valid performers passed all criterion performance validity tests (PVTs) and invalid performers failed two or more PVTs. Classification accuracy statistics were calculated. Results AUC for the IFFI was 0.80, demonstrating adequate discrimination between valid and invalid groups. A score of 3 or more inconsistent responses resulted in sensitivity and specificity rates of 63% and 92%, respectively. Conclusions This is the first article to cross-validate the IFFI. In both the original IFFI study and the current study, the same cut-off was found to maintain at least 90% specificity while producing higher sensitivity rates than those achieved by traditional TOMM indices. [ABSTRACT FROM AUTHOR]

Objective The limitations of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT)'s embedded validity measures (EVMs) are well-documented, as estimates suggest up to 35% of invalid baseline performances go undetected. Few studies have examined standalone performance validity tests (PVT) as a supplement to ImPACT's EVMs. Method College athletes (n  = 1,213) were administered a preseason baseline assessment that included ImPACT and the Rey Dot Counting Test (DCT), a standalone PVT, among other measures. Results Sixty-nine athletes (5.69%) met criteria for suboptimal effort on either ImPACT or the DCT. The DCT detected more cases of suboptimal effort (n  = 50) than ImPACT (n  = 21). A χ2 test of independence detected significant disagreement between the two measures, as only two individuals produced suboptimal effort on both (χ 2(2) = 1.568, p  = .210). Despite this disagreement, there were significant differences between the suboptimal effort DCT group and the adequate effort DCT group across all four ImPACT neurocognitive domains (U  = 19,225.000, p  < .001; U  = 17,859.000, p  < .001; U  = 13,854.000, p  < .001; U  = 17,850.500, p  < .001). Conclusions The DCT appears to detect suboptimal effort otherwise undetected by ImPACT's EVMs. [ABSTRACT FROM AUTHOR]

Objective Performance validity research has emphasized the need for briefer measures and, more recently, abbreviated versions of established free-standing tests to minimize neuropsychological evaluation costs/time burden. This study examined the accuracy of multiple abbreviated versions of the Dot Counting Test ("quick" DCT) for detecting invalid performance in isolation and in combination with the Test of Memory Malingering Trial 1 (TOMMT1). Method Data from a mixed clinical sample of 107 veterans (80 valid/27 invalid per independent validity measures and structured criteria) were included in this cross-sectional study; 47% of valid participants were cognitively impaired. Sensitivities/specificities of various 6- and 4-card DCT combinations were calculated and compared to the full, 12-card DCT. Combined models with the most accurate 6- and 4-card combinations and TOMMT1 were then examined. Results Receiver operator characteristic curve analyses were significant for all 6- and 4-card DCT combinations with areas under the curve of.868–.897. The best 6-card combination (cards, 1-3-5-8-11-12) had 56% sensitivity/90% specificity (E-score cut-off, ≥14.5), and the best 4-card combination (cards, 3-4-8-11) had 63% sensitivity/94% specificity (cut-off, ≥16.75). The full DCT had 70% sensitivity/90% specificity (cut-off, ≥16.00). Logistic regression revealed 95% classification accuracy when 6-card or 4-card "quick" combinations were combined with TOMMT1, with the DCT combinations and TOMMT1 both emerging as significant predictors. Conclusions Abbreviated DCT versions utilizing 6- and 4-card combinations yielded comparable sensitivity/specificity as the full DCT. When these "quick" DCT combinations were further combined with an abbreviated memory-based performance validity test (i.e. TOMMT1), overall classification accuracy for identifying invalid performance was 95%. [ABSTRACT FROM AUTHOR]

Objective The purpose of this study was to evaluate the presence of demographic, injury and neuropsychological correlates of distinct patterns of performance validity test and symptom validity test results in persons with mild traumatic brain injury (mTBI). Method One hundred and seventy-eight persons with mTBI completed the Test of Memory Malingering (TOMM; performance validity) and the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; symptom validity) within 1–12 months postinjury. Four groups were compared: (a) pass both TOMM and MMPI-2-RF validity criteria, (b) pass TOMM and fail MMPI-2-RF, (c) fail TOMM and pass MMPI-2-RF, and (d) fail both TOMM and MMPI-2-RF. Results Compared to Group a, participants in combined Groups b–d were more than twice as likely to be engaged in financial compensation-seeking and about four times less likely to have neuroimaging evidence of an intracranial lesion. The average performance of Group d on an independent test of verbal learning was more than 1.5 standard deviations below that of Group a. Participants in Group b were more likely to have intracranial lesions on neuroimaging than participants in Group c. Conclusion Performance and symptom validity tests provide complementary and non-redundant information in persons with mTBI. Whereas financial compensation-seeking is associated with increased risk of failure of either PVT or SVT, or both, the presence of intracranial findings on neuroimaging is associated with decreased risk of such. [ABSTRACT FROM AUTHOR]

Objective The present study explored both embedded symptom (SVT) and performance (PVT) validity test scores within a post-9/11 veteran sample to elucidate the degree to which there is concordance between validity indicators, as well as how frequently one SVT and four PVT indicators were failed in screened mild traumatic brain injury (mTBI) and diagnosed posttraumatic stress disorder (PTSD). Method A total of 114 post-9/11 veterans were evaluated utilizing the Neurobehavioral Symptom Inventory (NSI) Validity-10, four embedded PVTs, mTBI screening, and a diagnostic interview for PTSD. Results While we found concordance between embedded PVTs and the NSI Validity-10 at select cutoffs (i.e. ≥13, ≥19), symptom and performance validity indicators were clinically dissociable in that only SVT significantly predicted diagnosed PTSD and screened mTBI. Conclusions Dissociation between symptom and performance validity may be clinically useful when interpreting neuropsychological evaluation findings in post-9/11 veterans with a history of mTBI or PTSD. [ABSTRACT FROM AUTHOR]

Objective A reduction in lexical access is observed in normal aging and a few studies also showed that this ability is affected in individuals with subjective cognitive decline. Lexical access is also affected very early in mild cognitive impairment as well as in major neurocognitive disorders. The detection of word-finding difficulties in the earliest stages of pathological aging is particularly difficult because symptoms are often subtle or mild. Therefore, mild anomia is underdiagnosed, mainly due to the lack of sensitivity of naming tests. In this article, we present the TDQ-30, a new picture-naming test designed to detect mild word-finding deficits in adults and elderly people. Method The article comprises three studies aiming at the development of the test (Study 1), the establishment of its validity and reliability (Study 2), and finally, the production of normative data for French-speaking adults and elderly people from Quebec (Study 3). Results The results showed that the TDQ-30 has good convergent validity. Also, the TDQ-30 distinguished the performance of healthy controls from those of participants with mild cognitive impairment, Alzheimer's disease, and post-stroke aphasia. This suggests good discriminant validity. Finally, this study provides normative data computed from a study sample composed of 227 participants aged 50 years and over. Conclusions The TDQ-30 has the potential to become a valuable picture-naming test for the diagnosis of mild anomia associated with pathological aging. [ABSTRACT FROM AUTHOR]

Objective 85 years after the description of the Stroop interference effect, there is still a lack of consensus regarding the cognitive constructs underlying scores from standardized versions of the test. The present work aimed to clarify the cognitive mechanisms underlying direct (word-reading, color-naming, and color-word) and derived scores (interference, difference, ratio, and relative scores) from Golden's standardized version of the test. Method After a comprehensive review of the literature, five cognitive processes were selected for analysis: speed of visual search, phonemic verbal fluency, working memory, cognitive flexibility, and conflict monitoring. These constructs were operationalized by scoring five cognitive tasks (WAIS-IV Digit Symbol, phonemic verbal fluency [letter A], WAIS-IV Digit Span, TMT B-A, and reaction times to the incongruent condition of a computerized Stroop task, respectively). About 83 healthy individuals (mean age = 25.2 years) participated in the study. Correlation and regression analyses were used to clarify the contribution of the five cognitive processes on the prediction of Stroop scores. Results Data analyses revealed that Stroop word-reading reflected speed of visual search. Stroop color-naming reflected working memory and speed of visual search. Stroop color-word reflected working memory, conflict monitoring, and speed of visual search. Whereas the interference score was predicted by both conflict monitoring and working memory, the ratio score (color-word divided by color-naming) was predicted by conflict monitoring alone. Conclusion The present results will help neuropsychologists to interpret altered patient scores in terms of a failure of the cognitive mechanisms detailed here, benefitting from the solid background of preceding experimental work. [ABSTRACT FROM AUTHOR]

Objectives The purpose of this study was to generate normative data on the Symbol Digits Modalities Test (SDMT) for the written and oral versions in the Greek adult population. We also investigated the test's validity in discriminating the performance of healthy adults from two groups of adults diagnosed with relapsing remitting (RRMS) and secondary progressive (SPMS) multiple sclerosis. Method The sample consisted of 609 healthy men and women between the ages of 18 and 65. All participants were monolingual native Greek adult speakers. Each healthy participant was administered either the written (n  = 460) or oral (n  = 149) versions of the SDMT. Discriminant validity was examined by comparing 35 healthy participants who had completed the oral version of the SDMT to 35 age - and education-matched RRMS and SPMS patients. Results Linear regression models explained between 36% and 55% of the variance in the SDMT oral and written version scores. Age was the strongest predictor of difference in SDMT written and oral version performance, followed by education that also accounted for a further proportion of the SDMT variance. On the contrary, gender was found not to contribute significantly to the variance in the SDMT for either the written or the oral versions. As a result, age- and education-adjusted norms were generated. Regarding the tests discriminative validity, we found that both MS patient groups scored significantly lower than the healthy group. Conclusions This is the first study to provide comprehensive normative data for the SDMT in the adult population in Greece, impacting the future practice of neuropsychological assessment in this country. [ABSTRACT FROM AUTHOR]

Objective This is the first systematic review and meta-analysis of the Test of Memory Malingering (TOMM) in pediatric examinees. It adheres to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Method A systematic literature search was conducted using PsycINFO and PubMed, reviewing articles from January 1997 to July 2019. Books providing data on pediatric validity testing were also reviewed for references to relevant articles. Eligibility criteria included publication in a peer-reviewed journal, utilizing a pediatric sample, providing sufficient data to calculate specificity and/or sensitivity, and providing a means for evaluating validity status external to the TOMM. After selection criteria were applied, 9 articles remained for meta-analysis. Samples included clinical patients and healthy children recruited for research purposes; ages ranged from 5 to 18. Fixed and random effects models were used to calculate classification accuracy statistics. Results Traditional adult-derived cutoffs for Trial 2 and Retention were highly specific (0.96–0.99) in pediatric examinees for both clinical and research samples. Sensitivity was relatively strong (0.68–0.70), although only two studies reported sensitivity rates. A supplemental review of the literature corroborated these findings, revealing that traditional adult-based TOMM cutoffs are supported in most pediatric settings. However, limited research exists on the impact of very young age, extremely low cognitive functioning, and varying clinical diagnoses. Conclusions The TOMM, at traditional adult cutoffs, has strong specificity as a performance validity test in pediatric neuropsychological evaluations. This meta-analysis found that specificity values in children are comparable to those of adults. Areas for further research are discussed. [ABSTRACT FROM AUTHOR]

Objective Recently, in a mixed neuropsychological outpatient sample, a measure of cognitive response bias has been developed for the Personality Assessment Inventory (PAI) called the Cognitive Bias Scale (CBS). This study sought to cross-validate this measure in a military sample. Method Retrospective review of 197 active duty soldiers referred to an Army outpatient clinic for neuropsychological evaluation. Groups were created based on the number of failed performance validity tests (0, 1, or 2–3 performance validity testing [PVT] failures). Results The magnitude of effect for the 10-item CBS scale was medium-to-large when comparing those with one PVT failure to those with two to three (d  = .98) and those with no failures (d  = 1.21); however, effects between the 1 and 2–3 PVT failure groups were less pronounced. In 1 and 2–3 PVT failure groups, a score of |$\ge$| 16 had high specificity (.92 and.95, respectively) and low to moderate sensitivity (.20 and.55, respectively). Conclusions In a military sample, the CBS demonstrated high specificity with relatively low sensitivity. The measure operated similarly to the original study and the current data supports the CBS to rule in, but not rule out, over-reported cognitive symptoms on the PAI. [ABSTRACT FROM AUTHOR]

Objective Recent research has examined potential influences to performance validity testing beyond intentional feigning. The current study sought to examine the hypothesized relationships of two psychological constructs (self-efficacy and health locus of control) with performance validity testing (PVT). Method Retrospective review of 158 mild traumatic brain injury (mTBI) cases referred to an Army outpatient clinic for neuropsychological evaluation. The mTBI cases were classified according to passing or failing the Medical Symptom Validity Test (MSVT) or Non-Verbal Medical Symptom Validity Test (NV-MSVT). Group comparisons were performed utilizing one-way ANOVA to evaluate the differences between the PVT-Pass and PVT-Fail groups on self-efficacy (MMPI-2-RF Inefficacy scale) and locus of control (Multi-Dimensional Health Locus of Control). Results There was no relationship between self-efficacy or health locus of control and passing/failing PVTs. Conclusions Further research is warranted to explore potential influences on PVT performance, which we conceptualize as analogous to experimental nuisance variables that may be amenable to intervention. [ABSTRACT FROM AUTHOR]

Objectives: Empirically informed neuropsychological opinion is critical for determining whether cognitive deficits and symptoms are legitimate, particularly in settings where there are significant external incentives for successful malingering. The Slick, Sherman, and Iversion (1999) criteria for malingered neurocognitive dysfunction (MND) are considered a major milestone in the field's operationalization of neurocognitive malingering and have strongly influenced the development of malingering detection methods, including serving as the criterion of malingering in the validation of several performance validity tests (PVTs) and symptom validity tests (SVTs) (Slick, D.J., Sherman, E.M.S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13(4), 545–561). However, the MND criteria are long overdue for revision to address advances in malingering research and to address limitations identified by experts in the field. Method: The MND criteria were critically reviewed, updated with reference to research on malingering, and expanded to address other forms of malingering pertinent to neuropsychological evaluation such as exaggeration of self-reported somatic and psychiatric symptoms. Results: The new proposed criteria simplify diagnostic categories, expand and clarify external incentives, more clearly define the role of compelling inconsistencies, address issues concerning PVTs and SVTs (i.e., number administered, false positives, and redundancy), better define the role of SVTs and of marked discrepancies indicative of malingering, and most importantly, clearly define exclusionary criteria based on the last two decades of research on malingering in neuropsychology. Lastly, the new criteria provide specifiers to better describe clinical presentations for use in neuropsychological assessment. Conclusions: The proposed multidimensional malingering criteria that define cognitive, somatic, and psychiatric malingering for use in neuropsychological assessment are presented. [ABSTRACT FROM AUTHOR]

Objective Data for the use of embedded performance validity tests (ePVTs) with multiple sclerosis (MS) patients are limited. The purpose of the current study was to determine whether ePVTs previously validated in other neurological samples perform similarly in an MS sample. Methods In this retrospective study, the prevalence of below-criterion responding at different cut-off scores was calculated for each ePVT of interest among patients with MS who passed a stand-alone PVT. Results Previously established PVT cut-offs generally demonstrated acceptable specificity when applied to our sample. However, the overall cognitive burden of the sample was limited relative to that observed in prior large-scale MS studies. Conclusion The current study provides initial data regarding the performance of select ePVTs among an MS sample. Results indicate most previously validated cut-offs avoid excessive false positive errors in a predominantly relapsing remitting MS sample. Further validation among MS patients with more advanced disease is warranted. [ABSTRACT FROM AUTHOR]

Objective: To examine feasibility, convergent validity and biases associated with a mobile color-word interference test (mCWIT) among older persons living with HIV (PLHIV). Method: Over a 14-day period, 58 PLHIV and 32 HIV-uninfected individuals (aged 50–74) completed the mCWIT on smartphones once per day in real-world settings. Participants also completed a comprehensive laboratory-based neuropsychological evaluation. Results: A high rate of compliance was observed (86%) in the repeated administration of the mCWIT. A practice effect was observed in the overall sample concerning mCWIT subscores, and these learning effects were greater for PLHIV. Stabilization of performance was observed after 6 (HIV+) and 7 days (HIV−) for completion time and after 2 (HIV−) and 3 days (HIV+) for mCWIT errors. A minor fatigue effect was observed in the overall sample which was unassociated with group status. Moderate to strong correlations were found between mCWIT completion time and mCWIT errors with global neurocognition and with all of the individual neurocognitive domains. The strongest associations were with mCWIT completion time and laboratory-based global neurocognition, executive function, and working memory scores. Conclusions: Cognitive testing administered within the context of a person's daily life provides qualitatively different data than neuropsychological testing completed in clinical settings, and it may constitute a more ecologically valid indicator of cognitive performance than traditional methods. Mobile cognitive testing has potential to help characterize real-time cognitive performance and serve as a complementary assessment tool to traditional methods. [ABSTRACT FROM AUTHOR]

Objective The Sport Concussion Assessment Tool (SCAT), fifth Edition, Symptom Evaluation (S5SE) differs from previous versions by having examinees report trait (i.e. "typical" feelings) as opposed to state (i.e., "how you feel right now") concussion-like symptoms at baseline. This study assessed differences among, and convergent validity of, scores on the S5SE, SCAT3 Symptom Evaluation (S3SE), and the Brief Symptom Inventory (BSI-18). Methods A total of 113 University of Florida varsity athletes completed symptom questionnaires on the same day in a counterbalanced administration. The final sample consisted of 94 participants (mean age ± SD = 18.4 ± 0.8 years, 57% male, 65% white) from 17 sports. We assessed convergent validity using Spearman rank-order correlations. Within-participant differences were analyzed with Wilcoxon Signed-Rank tests. We qualitatively described free-response answers to the S5SE question that asks, "if not feeling 100%, why?". Results S5SE total severity score demonstrated adequate convergent validity with both the S3SE (rho =.407, p <.001) and BSI-18 (rho =.432, p <.001). Domain-specific analyses indicated variable convergent validity (rho < 0.4 to rho > 0.6). Severity scores did not differ between the S3SE and S5SE (p =.500), but 24.5% of participants reported S3SE > S5SE and 34.0% S5SE > S3SE. Three themes emerged from qualitative examination of reasons for "not feeling 100%": (1) tiredness/sleep, (2) adjustment difficulties, and (3) academic/athletic stress. Conclusions Adequate convergent validity exists between SCAT5 and SCAT3 symptom severity in collegiate athletes. However, most examinees report different baseline symptom severity when asked to describe their trait (S5SE) versus state symptoms (S3SE). Clinicians should consider using the new SCAT5 Symptom Evaluation as a screening tool for identifying otherwise healthy or "undiagnosed" individuals who would benefit from targeted interventions. [ABSTRACT FROM AUTHOR]

Objective This study was designed to evaluate the classification accuracy of a multivariate model of performance validity assessment using embedded validity indicators (EVIs) within the Wechsler Adult Intelligence Scale—Fourth Edition (WAIS-IV). Method Archival data were collected from 100 adults with traumatic brain injury (TBI) consecutively referred for neuropsychological assessment in a clinical setting. The classification accuracy of previously published individual EVIs nested within the WAIS-IV and a composite measure based on six independent EVIs were evaluated against psychometrically defined non-credible performance. Results Univariate validity cutoffs based on age-corrected scaled scores on Coding, Symbol Search, Digit Span, Letter-Number-Sequencing, Vocabulary minus Digit Span, and Coding minus Symbol Search were strong predictors of psychometrically defined non-credible responding. Failing ≥3 of these six EVIs at the liberal cutoff improved specificity (.91–.95) over univariate cutoffs (.78–.93). Conversely, failing ≥2 EVIs at the more conservative cutoff increased and stabilized sensitivity (.43–.67) compared to univariate cutoffs (.11–.63) while maintaining consistently high specificity (.93–.95). Conclusions In addition to being a widely used test of cognitive functioning, the WAIS-IV can also function as a measure of performance validity. Consistent with previous research, combining information from multiple EVIs enhanced the classification accuracy of individual cutoffs and provided more stable parameter estimates. If the current findings are replicated in larger, diagnostically and demographically heterogeneous samples, the WAIS-IV has the potential to become a powerful multivariate model of performance validity assessment. Brief Summary Using a combination of multiple performance validity indicators embedded within the subtests of theWechsler Adult Intelligence Scale, the credibility of the response set can be establishedwith a high level of confidence. Multivariatemodels improve classification accuracy over individual tests. Relying on existing test data is a cost-effective approach to performance validity assessment. [ABSTRACT FROM AUTHOR]

Objective Despite its brevity and face validity, little is known about the construct validity of the naturalistic "Key Task" of prospective memory (PM), in which an examinee is instructed to remind the examiner at a designated time to retrieve keys (or another belonging) placed out of sight. Method Study 1 included 162 HIV+ and 52 HIV− comparison participants who completed the Key Task alongside well-validated measures of PM and a comprehensive neuropsychological battery that included everyday functioning measures. Study 2 used broadly parallel methods in 168 older community-dwelling Australians. Results Overall, the Key Task was not reliably associated with neurocognitive functioning (including clinical and experimental measures of PM), PM symptoms, or everyday functioning in either sample. Conclusions The Key Task did not demonstrate compelling evidence of construct validity among persons living with HIV disease or older adults, which raises doubts regarding its clinical usefulness as a measure of PM. [ABSTRACT FROM AUTHOR]

Objective This study examined the test–retest reliability and construct validity of the Action Fluency Test (AFT) as a measure of executive functioning. Method Using a correlational design, 128 healthy college students (M Age = 19.24, SD = 2.01; M education = 13.29 years, SD = 0.81) completed the AFT, and measures of verbal and figural fluency, executive functioning and other relevant constructs (e.g. vocabulary, working memory, and attention). Results Coefficients of stability were acceptable for AFT correct words (r =.76; p <.01), but not for errors (r =.41) or perseverations (r =.14). No practice effects were observed upon repeat testing (M interval = 39.21 days). Divergent validity evidence was mixed. AFT scores were unrelated to working memory and perceptual-reasoning abilities; however, correlations with vocabulary (r =.32; p <.01) and information-processing speed (r =.30; p <.01) were greater than associations between AFT scores and executive measures. Regarding convergent validity, AFT scores correlated with other fluency tasks (r =.4 range), but correlations with measures of executive functioning were absent or small. Action and letter fluency correlated with measures of attentional control and inhibition; however, these associations were no longer significant after controlling for shared variance with information-processing speed. Conclusions Findings are consistent with previous research suggesting vocabulary and information-processing speed underlie effective fluency performance to a greater extent than executive functioning. The AFT measures unique variance not accounted for by semantic and letter fluency tasks, and therefore may be used for a variety of research and clinical purposes. [ABSTRACT FROM AUTHOR]

Objective The NIH Toolbox for Assessment of Neurological and Behavioral Function (NIHTB) was developed under contract from the National Institutes of Health to create a set of easy-to-administer neuropsychological measures, for use across the lifespan (ages 3-85). The NIHTB Cognition Battery (NIHTB-CB) includes two language measures that were developed, calibrated, and normed separately in English and Spanish. This analysis presents the test-retest reliability and construct validity of the Spanish-language picture vocabulary test (S-PVT) and oral reading recognition test (S-ORRT) among adults. Participants and Method Participants were adults age 18-85 who took part in the NIHTB norming study in Spanish (N = 408, Age: M = 44.1, SD = 16.7; Education: M = 10.7, SD = 4.3; 65.0% female). Of these, 48 repeated the battery 1 week later. Both the S-PVT and the S-ORRT were administered using computer adaptive testing and scored using item response theory. Spearman's correlations were used to evaluate test-retest reliability. Convergent validity was evaluated by correlating S-PVT scores with scores on the Batería-III Woodcock-Muñoz Vocabulario Sobre Dibujos, and by correlating S-ORRT scores with scores on a 48-item version of the Word Accentuation Test. Adjusted Spearman's correlations and general linear models related scores to age, education, and sex. Results Both the S-PVT (ρ = 0.87, p <.001) and the S-ORRT (ρ = 0.88, p <.001) demonstrated good test-retest reliability. Good convergent validity was found for both the S-PVT (ρ = 0.76, p <.001) and the S-ORRT (ρ = 0.65, p <.001). Scores on the S-PVT were positively related to education (ρ = 0.38, p <.001), and scores on the S-ORRT were negatively related to age (ρ = -0.18, p <.01) and positively related to education (ρ = 0.30, p <.001). Conclusions The Spanish language measures of the NIHTB-CB demonstrated acceptable reliability and validity, suggesting they can be used to measure language ability among Spanish-speaking adults in the United States. [ABSTRACT FROM AUTHOR]

Background Performance Validity Testing (PVT) decision-making rules may be indeterminate in patients with neurological disease in which PVT characteristics have not been adequately studied. We report a patient with multiple sclerosis (MS) who failed computerized PVT testing but had normal memory scores with a neuropsychological profile consistent with expected MS disease-related weaknesses. Method Neuropsychological testing was conducted on two occasions in a middle-aged woman with an established MS diagnosis to address concerns of possible memory decline. Testing was discontinued after PVT scores below recommended cut-points were obtained during the first evaluation. During the second assessment, subthreshold PVT scores on a different computerized PVT were obtained, but unlike the first assessment, the entire neuropsychological protocol was administered. Results Despite subthreshold computerized PVT scores, normal learning and memory performance was obtained providing objective data to answer the referral question. Other neuropsychological findings included decreased processing speed, poor working memory, and poor executive function consistent with her MS diagnosis. Embedded PVT scores were normal. Conclusions We speculate that poor computerized PVT scores resulted from the disease-related features of MS, although we also discuss approaches to reconcile apparently contradictory PVT versus neuropsychological results if the contributions of disease-related variables on PVTs scores are discounted. This case demonstrates the value of completing the assessment protocol despite obtaining PVT scores below publisher recommended cutoffs in clinical evaluations. If subthreshold PVT scores are considered evidence of performance invalidity, it is still necessary to have an approach for interpreting seemingly credible neuropsychological test results rather than simply dismissing them as invalid. [ABSTRACT FROM AUTHOR]