Search

Emotion understanding (EU) ability is associated with healthy social functioning and psychological well-being. Across three studies, we develop and present validity evidence for the Core Relational Themes of Emotions (CORE) Test. The test measures people's ability to identify relational themes underlying 19 positive and negative emotions. Relational themes are consistencies in the meaning people assign to emotional experiences. In Study 1, we developed and refined the test items employing a literature review, expert panel, and confusion matrix with a demographically diverse sample. Correctness criteria were determined using theory and prior research, and a progressive (degrees of correctness) paradigm was utilized to score the test. In Study 2, the CORE demonstrated high internal consistency and a confirmatory factor analysis supported the unidimensional factor structure. The CORE showed evidence of convergence with established EU ability measures and divergent relationships with verbal intelligence and demographic characteristics, supporting its construct validity. Also, the CORE was associated with less relational conflict. In Study 3, the CORE was associated with more adaptive and less maladaptive coping and higher well-being on multiple indicators. A set of effects remained, accounting for variance from a widely used EU test, supporting the CORE's incremental validity. Theoretical and methodological contributions are discussed. [ABSTRACT FROM AUTHOR]

Despite their known influence in science, technology, engineering, and mathematics (STEM) fields, spatial abilities remain an underassessed aspect of cognition, particularly in educational settings. One explanation could be a lack of affordable, valid instruments for measuring various aspects of spatial ability. We evaluate the validity of a set of public-domain, algorithmically generated two-dimensional rotation items using a sample from the Synthetic Aperture Personality Assessment (SAPA) Project (N = 1,020,195). We examine the psychometric properties of the items and their relationship with various other cognitive abilities and personality traits. In addition, we identify the highest performing college majors and occupations on the 2D rotation items and on a set of 3D rotation items. Findings suggest strong unidimensionality for the 2D rotation items and the presence of lower-order factors which reflect differences across items in mental rotation demands. The highest scoring majors and occupations were similar—but not identical—across the 2D and 3D rotation measures and point to potentially meaningful differences across areas of expertise. [ABSTRACT FROM AUTHOR]

Figural matrices tests are among the most popular and well-investigated tests used to assess inductive reasoning abilities. Solving these tests requires the selection of a target that completes a figural matrix among distractors. Despite their generally good psychometric properties, previous matrices tests have limitations associated with distractor construction that prevent them from realizing their full potential. Most tests allow participants to identify the correct response by eliminating distractors based on superficial features. The goal of this study was to develop a novel figural matrices test which is less prone to the use of response elimination strategies, and to test its psychometric properties. The new test consists of 48 items and was validated with N = 767 participants. Measurement models implied that the test is Rasch scalable, inferring a uniform underlying ability. The test showed good to very good reliability (retest-correlation: r = 0.88; Cronbach's alpha: α = 0.93; split-half reliability: r = 0.88) and good construct validity (r = 0.81 with the Raven Progressive Matrices Test, r = 0.73 with global intelligence scores of the Intelligence Structure Test 2000R, and r = 0.58 with the global score of the Berlin Intelligence Structure Test). It even superseded the Raven Progressive Matrices Tests in criterion-related validity (correlation with final year high school grades (r = −0.49 p <.001)). We conclude that this novel test has excellent psychometric properties and can be a valuable tool for researchers interested in reasoning assessment. [ABSTRACT FROM AUTHOR]

Most of the work examining the relationship between intelligence and job performance has conceptualized intelligence as g. Recent findings, however, have supported the claim that more specific factors of intelligence contribute to the prediction of job performance. The present study builds upon prior work on specific cognitive abilities by investigating the relationship between ability tilt, a measure representing differential strength between two specific abilities, and job performance. It was hypothesized that ability tilt would differentially relate to job performance based on whether or not the tilt matched the ability requirements of the job, and that ability tilt would provide incremental validity over g and specific abilities for predicting performance when the tilt matched job requirements. Hypotheses were tested using a large sample from the General Aptitude Test Battery (GATB) database. Ability tilt related with job performance in the expected direction for 27 of the 36 tilt-job combinations examined, with a mean effect size of.04 when the tilt matched job requirements. The mean incremental validities for ability tilt were.007 over g and.003 over g and specific abilities, and, on average, tilt explained 7.1% of the total variance in job performance. The results provide limited evidence that ability tilt may be a useful predictor in addition to ability level, and contribute to our understanding of the role of specific abilities in the workplace. [ABSTRACT FROM AUTHOR]

The construct validity of group factor models of personality, which are typically derived from factor analysis of questionnaire items, relies on the ability of each factor to predict meaningful and differentiated real-world outcomes. In a sample of 481 participants, we used the Big Five Aspect Scales (BFAS) personality questionnaire, two laboratory-measured reaction time (RT) tasks, and a short-form test of cognitive ability (ICAR-16) to test the hypothesis that the Intellect and Openness aspects of Big Five Openness to Experience differentially correlate with reaction time moments. We found that higher scores on the Intellect aspect significantly correlate with faster and less variable response times, while no such association is observed for the Openness aspect. Further, we found that this advantage lies solely in the decisional, but not perceptual, stage of information processing; no other Big Five aspect showed a similar pattern of results. In sum, these findings represent the largest and most comprehensive study to date on personality factors and reaction time, and the first to demonstrate a mechanistic validation of BFAS Intellect through a differential pattern of associations with RT and Big Five personality aspects. [ABSTRACT FROM AUTHOR]

Social skills are of key importance in everyday and work life. However, the way in which they are typically assessed via self-report questionnaires has one potential downside; self-reports assess individuals' global self-concepts, which do not necessarily reflect individuals' actual social behaviors. In this research, we aimed to investigate how self-concepts assessed via questionnaires relate to skill expression assessed via behavioral observations after short interpersonal simulations. For this, we used an alternative behavior-based skill assessment approach designed to capture expressions of predefined social skills. Self- and observer ratings were collected to assess three different social skills: agency (i.e., getting ahead in social situations), communion (i.e., getting along in social situations), and interpersonal resilience (i.e., staying calm in social situations). We explored how these skills were related to self-concepts by differentiating between a classic personality measure (i.e., Big Five Inventory 2; BFI-2) and a novel skill questionnaire (i.e., Behavioral, Emotional, and Social Skills Inventory; BESSI). The results (N = 137) showed that both personality and skill self-concepts predicted self-rated skill expression, with the BESSI showing incremental validity. For both personality and skills self-concepts, the relationships with observer-rated skill expression were significant for agency but not for communion or interpersonal resilience. We discuss these results and highlight the theoretical and practical importance of differentiating between skill self-concepts and actual skill expression. [ABSTRACT FROM AUTHOR]

Selection methods are commonly used in talent acquisition to predict future job performance and to find the best candidates, but questionnaire-based assessments can be lengthy and lead to candidate fatigue and poor engagement, affecting completion rates and producing poor data. Gamification can mitigate some of these issues through greater engagement and shorter testing times. One avenue of gamification is image-based tests. Although such assessments are starting to gain traction in personnel selection, few studies describing their validity and psychometric properties exist. The current study explores the potential of a five-minute, forced-choice, image-based assessment of the Big Five personality traits to be used in selection. Study 1 describes the creation of the image pairs and the selection of the 150 best-performing items based on a sample of 300 respondents. Study 2 describes the creation of machine-learning-based scoring algorithms and tests of their convergent and discriminate validity and adverse impact based on a sample of 431 respondents. All models showed good levels of convergent validity with the IPIP-NEO-120 (openness r = 0.71, conscientiousness r = 0.70, extraversion r = 0.78, agreeableness r = 0.60, and emotional stability r = 0.70) and were largely free from potential adverse impact. The implications for recruitment policy and practice and the need for further validation are discussed. [ABSTRACT FROM AUTHOR]

The Woodcock-Johnson IV Tests of Cognitive Abilities (WJ IV COG) is a comprehensive assessment battery designed to assess broad and narrow cognitive abilities, as defined by the Cattell-Horn-Carroll (CHC) theory of intelligence. Previous studies examined the invariance of the WJ assessments across sex and age groups using factor analytic methods. Psychometric network modeling is an alternative methodology that can address both direct and indirect relationships among the observed variables. In this study, we employed psychometric network modeling to examine the invariance of the WJ IV COG across sex and age groups. Using a normative sample (n = 4212 participants) representative of the United States population, we tested the extent to which the factorial structure of the WJ IV COG aligned with CHC theory for the school-aged sample. Next, we used psychometric network modeling as a data-driven method to investigate whether the network structure of the WJ IV COG remains similar across different sex and age (age 6 to 19, inclusively) groups. Our results showed that the WJ IV COG maintained the same network structure across all age and sex groups, although the network structure at younger ages indicated weaker relationships among some subtests. Overall, the results provide construct validity evidence for the WJ IV COG, based on both theoretical and data-driven methods. [ABSTRACT FROM AUTHOR]

We conducted two studies to replicate and extend, as well as test, the limits of previous findings regarding an apparent disconnect between scientific-reasoning skills in psychological science, on the one hand, and scores on standardized tests of general intelligence, on the other. In Study 1, we examined whether this disconnect would extend beyond psychological science to additional sciences as well, such as nutrition and agriculture. The results did indeed extend, suggesting that scientific reasoning across various natural sciences is comparable to scientific reasoning in psychological science, but different in kind from the reasoning required on conventional standardized tests. In Study 2, we examined whether these findings were linked to the format of presentation of scientific problems. Whereas real scientific-reasoning problems are open-ended, standardized tests tend to use multiple-choice format. We discovered that using multiple-choice format did indeed result in an apparently closer relation of the scientific-reasoning tests to two of the conventional ability measures (SAT Reading and Number Series) but not to two other tests (Letter Sets and SAT Math). Thus, one can increase the correlations of scientific-reasoning tests with at least some standardized ability tests but at the cost of content validity and ecological validity. [ABSTRACT FROM AUTHOR]

Current taxonomies of intelligence comprise two factors of mental speed, clerical speed (Gs), and elementary cognitive speed (Gt). Both originated from different research traditions and are conceptualized as dissociable constructs in current taxonomies. However, previous research suggests that tasks of one category can be transferred into the other category by simply changing the mode of administration, i.e., in form of a paper-and-pencil test or in from of a computer-based elementary cognitive task. However, cross-mode correlations for specific tasks are usually only moderate. In the present study, mental speed was assessed as a broad construct across different tasks and stimulus materials. This allowed modeling mental speed as a hierarchical construct for paper-and-pencil as well as for computer-based tests. Cross-mode correlations of the respective general factors were moderate (r = 0.64), while the cross-mode correlations of task-specific components depended on task type (r = 0.12 to r = 0.71). Only the g factors of mental speed, but not the task-specific components, were found to be related with working memory capacity as a marker of cognitive ability. The speed general factor modeled across computer-based tests was more highly correlated with working memory capacity (r = 0.66) than the general factor modeled across paper-and-pencil tests (r = 0.46). These findings corroborate a crucial role of the assessment method and imply that validity of speed tests is affected by the choice of the test format. [ABSTRACT FROM AUTHOR]

Taking up new approaches and calls for experimental test validation, in the present study we propose and validate a process model of sustained attention tests. Four sub-components were postulated: the perception of an item, a simple mental operation to solve the item, a motor reaction, and the shift to the next item. In two studies, several cognitive tasks and modified versions of the d2-R test of sustained attention were applied in order to determine performance in the proposed sub-components. Their contribution for the prediction of performance in sustained attention tests and tests of higher cognitive abilities was assessed. The sub-components of the process model explained a large amount of variance in sustained attention tests, namely 55–74%. More specifically, perceptual and mental operation speed were the strongest predictors, while there was a trend towards a small influence of motor speed on test performance. The measures of item shifting showed low reliabilities and did not predict test scores. In terms of discriminant validity, results of Study 1 indicated that the postulated sub-components were insufficient to explain a large amount of variance in working memory span tasks, in Study 2 the same was demonstrated for reasoning tasks. Altogether, the present study is the first to disentangle sub-components in sustained attention tests and to determine their role for test performance. [ABSTRACT FROM AUTHOR]

This study investigates the item properties of a newly developed Automatic Number Series Item Generator (ANSIG). The foundation of the ANSIG is based on five hypothesised cognitive operators. Thirteen item models were developed using the numGen R package and eleven were evaluated in this study. The 16-item ICAR (International Cognitive Ability Resource) short form ability test was used to evaluate construct validity. The Rasch Model and two Linear Logistic Test Model(s) (LLTM) were employed to estimate and predict the item parameters. Results indicate that a single factor determines the performance on tests composed of items generated by the ANSIG. Under the LLTM approach, all the cognitive operators were significant predictors of item difficulty. Moderate to high correlations were evident between the number series items and the ICAR test scores, with high correlation found for the ICAR Letter-Numeric-Series type items, suggesting adequate nomothetic span. Extended cognitive research is, nevertheless, essential for the automatic generation of an item pool with predictable psychometric properties. [ABSTRACT FROM AUTHOR]