Search

Purpose: Standardization of neuropsychological tests is crucial for consistency in cognitive assessment, as well as for validity and comparability of results across different populations. We examined the applicability and measurement equivalence of the Alzheimer Disease Research Centers' Neuropsychological Test Battery (version 3) (ADRC-NTB3) in Singapore. Methods: The ADRC-NTB3 was administered to 978 older persons with normal cognition in Singapore. To provide comparison between Singapore and US samples, a US sample with similar profile was retrieved from the National Alzheimer Coordinating Center (NACC) database. Patients: Scores were compared with 1853 participants with similar profile from the United States. Score-difference between the populations was computed using multiple linear regression (adjusted for covariates), with equivalent score considered present when 90% CI of the score-difference fell within the predefined margin of equivalence. Results: Tasks assessing for memory, processing speed, and executive functioning showed equivalence in scores between US and Singapore samples (adjusted-score difference=−0.94 to 0.09). Singapore sample performed marginally better on the visuospatial task (adjusted-score difference=0.50), but poorer on the language task (adjusted-score difference=−3.22). Discussion: Nonequivalence of visuospatial and language tasks, which may increase potential misinterpretation of cognitive profiles and misdiagnosis, are related to educational and cultural differences. This highlights the need for different normative data for more accurate diagnostic accuracy as well as research priorities. [ABSTRACT FROM AUTHOR]

Measurement invariance-the notion that the measurement properties of a scale are equal across groups, contexts, or time-is an important assumption underlying much of psychology research. The traditional approach for evaluating measurement invariance is to fit a series of nested measurement models using multiple-group confirmatory factor analyses. However, traditional approaches are strict, vary across the field in implementation, and present multiplicity challenges, even in the simplest case of two groups under study. The alignment method was recently proposed as an alternative approach. This method is more automated, requires fewer decisions from researchers, and accommodates two or more groups. However, it has different assumptions, estimation techniques, and limitations from traditional approaches. To address the lack of accessible resources that explain the methodological differences and complexities between the two approaches, we introduce and illustrate both, comparing them side by side. First, we overview the concepts, assumptions, advantages, and limitations of each approach. Based on this overview, we propose a list of four key considerations to help researchers decide which approach to choose and how to document their analytical decisions in a preregistration or analysis plan. We then demonstrate our key considerations on an illustrative research question using an open dataset and provide an example of a completed preregistration. Our illustrative example is accompanied by an annotated analysis report that shows readers, step-by-step, how to conduct measurement invariance tests using R and Mplus. Finally, we provide recommendations for how to decide between and use each approach and next steps for methodological research. [ABSTRACT FROM AUTHOR]

Background: Visual analogue scales (VASs) are used in a variety of patient-, observer- and clinician-reported outcome measures. While typically included in measures originally developed for pen-and-paper completion, a greater number of clinical trials currently use electronic approaches to their collection. This leads researchers to question whether the measurement properties of the scale have been conserved during the migration to an electronic format, particularly because electronic formats often use a different scale length than the 100 mm paper standard. Methods: We performed a review of published studies investigating the measurement comparability of paper and electronic formats of the VAS. Results: Our literature search yielded 26 studies published between 1997 and 2018 that reported comparison of paper and electronic formats using the VAS. After excluding 2 publications, 23 of the remaining 24 studies included in this review reported electronic formats of the VAS (eVAS) and paper formats (pVAS) to be equivalent. A further study concluded that eVAS and pVAS were both acceptable but should not be interchanged. eVAS length varied from 21 to 200 mm, indicating that 100 mm length is not a requirement. Conclusions: The literature supports the hypothesis that eVAS and pVAS provide comparable results regardless of the VAS length. When implementing a VAS on a screen-based electronic mode, we recommend following industry best practices for faithful migration to minimise the likelihood of non-comparability with pVAS. [ABSTRACT FROM AUTHOR]

A growing number of clinical trials employ electronic media, in particular smartphones and tablets, to collect patient-reported outcome data. This is driven by the ubiquity of the technology, and an increased awareness of associated improvements in data integrity, quality and timeliness. Despite this, there remains a lingering question relating to the measurement equivalence of an instrument when migrated from paper to a screen-based format. As a result, researchers often must provide evidence demonstrating the measurement equivalence of paper and electronic versions, such as that recommended by the ISPOR ePRO Good Research Practices Task Force. In the last decade, a considerable body of work has emerged that overwhelmingly supports the measurement equivalence of instruments using screen-based electronic formats. Our review of key works derives recommendations on evidence needed to support electronic implementation. We recommend application of best practice recommendations is sufficient to conclude measurement equivalence with paper PROMs. In addition, we recommend that previous usability evidence in a representative group is sufficient, as opposed to per-study testing. Further, we conclude that this also applies to studies using multiple screen-based devices, including bring-your-own-device, if a minimum device specification can be ensured and the instrument is composed of standard response scale types. [ABSTRACT FROM AUTHOR]

Copyright of Hacettepe University Journal of Education is the property of Hacettepe University Journal of Education and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This study proposed a model to explain the students' and teachers' intention to use (ITU) technology. A sample of 1,095 participants (503 students and 592 teachers) responded to a 15-item, 7-point scale designed to measure six variables: perceived usefulness (PU), perceived ease of use, attitude toward use (ATU), facilitating conditions, computer self-efficacy (CSE), and ITU technology. Results of this study showed that the six variables were valid in explaining the ITU technology for both student and teacher groups. Hypothesis tests revealed that eight of nine hypotheses were supported. Multigroup confirmatory factor analysis found support for full configural and metric invariance, and partial scalar invariance in the data. Finally, the results revealed that only two paths, PU → ATU and CSE → ATU were structurally invariant in the research model. Implications of this study are discussed and future research possibilities proposed. [ABSTRACT FROM AUTHOR]

In multigroup factor analysis, different levels of measurement invariance are accepted as tenable when researchers observe a nonsignificant (Δ)χ2 test after imposing certain equality constraints across groups. Large samples yield high power to detect negligible misspecifications, so many researchers prefer alternative fit indices (AFIs). Fixed cutoffs have been proposed for evaluating the effect of invariance constraints on change in AFIs (e.g., Chen, 2007; Cheung & Rensvold, 2002; Meade, Johnson, & Braddy, 2008). We demonstrate that all of these cutoffs have inconsistent Type I error rates. As a solution, we propose replacing χ2 and fixed AFI cutoffs with permutation tests. Randomly permuting group assignment results in average between-groups differences of zero, so iterative permutation yields an empirical distribution of any fit measure under the null hypothesis of invariance across groups. Our simulations show that the permutation test of configural invariance controls Type I error rates better than χ2 or AFIs when the model contains parsimony error (i.e., negligible misspecification) but the factor structure is equivalent across groups (i.e., the null hypothesis is true). For testing metric and scalar invariance, Δχ2 and permutation yield similar power and nominal Type I error rates, whereas ΔAFIs yield inflated errors in smaller samples. Permuting the maximum modification index among equality constraints control familywise Type I error rates when testing multiple indicators for lack of invariance, but provide similar power as using a Bonferroni adjustment. An applied example and syntax for software are provided. Researchers measuring psychological constructs may first want to examine whether the items used to measure these constructs are interpreted equivalently in different contexts. Multiple-group factor analysis is a popular tool for testing measurement equivalence/invariance across populations, but methods for detecting item differences, such as observing a nonsignificant (Δ)χ2 test after imposing equality constraints, may detect negligible differences in large samples. Researchers have instead suggested the use of alternative fit indices (AFIs) and have proposed fixed cutoffs for change in AFIs when evaluating invariance (e.g., Chen, 2007; Cheung & Rensvold, 2002; Meade, Johnson, & Braddy, 2008). Alternatively, we propose replacing χ2 and fixed AFI cutoffs with permutation tests. Our simulations show that permutation tests yielded well controlled Type I error rates even when the model does not fit perfectly, providing the only valid test of configural invariance across groups of which we are currently aware. In addition, regardless of which AFI is preferred for tests of metric (i.e., item factor loadings) or scalar (i.e., item intercepts) equivalence, permutation tests provide well controlled Type I error rates, with power to detect true differences that is comparable with Δχ2. Conversely, we do not recommend that researchers use fixed cutoffs for ΔAFIs because our results suggest these cutoffs lead to inflated Type I error rates at smaller sample sizes. To encourage applications of the permutation procedure for testing measurement equivalence, we provide a complete real-data example, including software syntax for analysis and an interpretation of the results. [ABSTRACT FROM AUTHOR]

Increasing globalization has resulted in an emerging line of research addressing the cross-national generalizability of job satisfaction measures and its correlates. In this study the authors tested the measurement equivalence of the Italian Managerial Job Satisfaction Survey (MJSS) in six countries. Study 1 involved a group of 800 Italian managers from a multinational firm based in Italy. The MJSS was validated and used to assess four dimensions of job satisfaction. Study 2 cross-nationally verified the findings of Study 1 in five countries: 3,886 managers from Germany, France, Poland, Spain, and Brazil provided data on the four satisfaction facets. Results showed that the fourfactor solution of the MJSS-16 was invariant across samples, with data supporting configural, metric, and factor variance and covariance invariance. The Managerial Job Satisfaction Scale may be used for future research to draw meaningful structure-level comparisons across countries (i.e., comparisons dealing with cause-effect relationships). [ABSTRACT FROM AUTHOR]

Copyright of Studia Socjologiczne is the property of Studia Socjologiczne and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Copyright of Contaduría y Administración is the property of Facultad de Contaduria y Administracion-Universidad Nacional Autonoma de Mexico and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

We investigated the psychometric properties of the Italian version of the Dutch Work Addiction Scale (DUWAS) by using an Italian sample (N = 1,027) and a comparable Dutch sample (N = 7,523). We first conducted multigroup confirmatory factor analysis and reliability analysis. We then examined the correlations of the DUWAS with job demands, work-family conflict, job-related affective well-being, and psychological and physical strain. Results showed that a two-factor solution of the DUWAS was equivalent across the Italian and Dutch samples, with data supporting factor variance and covariance equivalence in addition to metric equivalence. Internal consistencies of the DUWAS and its subscales were adequate, and test-retest reliability showed a strong stability of the measure at one year. The DUWAS and its subscales showed a pattern of correlations in the expected direction with the adopted criterion measures. Overall, the Italian version of the DUWAS shows adequate validity and reliability. [ABSTRACT FROM AUTHOR]

Aim of the present study was to examine the construct validity of the trauma-related coping self-efficacy (CSE) scale. While assessing the psychometric properties of this 20-item scale among four different samples (514 victims of disaster, 1325 bereaved individuals, 512 victims of acute critical incidents, 169 severe bum victims), we found no measurement equivalence across groups. A shortened version was composed using only those items that were applicable to all types of potentially traumatic events (PTEs). In contrast to the CSE-20, the CSE-7 has a robust factor structure; factor structure and factor loadings were similar across study samples, indicating that it measured the same construct across different PTEs. These results offer strong support for cross-event construct validity of the CSE-7. Associations of the CSE-7 with posttraumatic stress symptoms showed the same pattern as with the CSE-20, indicating that the reduction in items did not diminish the scales' power to predict posttraumatic stress. [ABSTRACT FROM AUTHOR]

There is consistent evidence of the importance of academic self-efficacy beliefs within educational research, as they are linked to critical academic outcomes. Ethnic and gender differences in academic self-efficacy have been found in nations outside of the United States, suggesting differences in how individual students perceive their academic abilities. However, if researchers are interested in making mean-level comparisons of academic self-efficacy across diverse subpopulations of students, it is imperative to assess the measurement equivalence of the scale used across these subgroups prior to drawing any conclusions based on score inferences. The current study assessed the measurement invariance of the academic self-efficacy scale of the Patterns of Adaptive Learning Scales (PALS; Midgley et al., 2000) across gender and race among 4,148 high school students in the Southeastern US. The results indicated partial measurement invariance across African American females, African American males, Caucasian females, and Caucasian males, providing initial support for the same factor structure across groups. However, caution should be taken in considering any mean-level differences, as support for only weak invariance was found. [ABSTRACT FROM AUTHOR]

Copyright of Canadian Journal of Education / Revue Canadienne de l'Éducation is the property of Canadian Society for the Study of Education and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Copyright of Hacettepe University Journal of Education is the property of Hacettepe University Journal of Education and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

This paper describes ways in which dialect variation may have important effects on the implementation and results of surveys in particular linguistic settings. Specifically, such differences of speech across populations within countries may significantly interfere with survey cooperation and with normal processes of understanding and responding to survey questions. The Swiss context is presented as a case study of how complications in survey implementation due to language and dialect variation may jeopardise data quality. Greater awareness among researchers of the potential impact of dialect variation on survey participation and responding is needed. Also, there is a need for more research internationally on the nature and scope of potential problems due to dialect, and on how to develop targeted strategies and remedies. [ABSTRACT FROM AUTHOR]

The Health and Safety Executive Stress Indicator Tool is a short questionnaire developed in the UK for the screening of common psychosocial risk factors leading to work-related stress. Previous research showed that in both the UK and Italy this test fits the same seven-factor solution. Building upon previous findings and by using multiple-group confirmatory factor analysis we investigated the degree of measurement equivalence of the Italian version of the test with its original UK version. Furthermore, we advanced the validation of the tool in Italy by exploring the correlations of its subscales with stress-related outcomes. Two samples of workers were available for analyses: 1,298 Italian employees of private-sector organizations and a sample of 7,589 UK employees from organizations of the same type. Results replicated previous findings: A 7-factor solution of the Indicator Tool was found to be equivalent across the Italian and UK samples. Furthermore, the analyses supported factor variance and factor covariance equivalence in addition to metric equivalence. The Indicator Tool subscales showed significant correlations in the expected direction with stress-related outcomes. The Italian version of the Indicator Tool behaves very consistently with its UK version and may be used for the screening of psychosocial risks in Italian workplaces. [ABSTRACT FROM AUTHOR]

Various consumer values and perceived product attributes trigger consumptive behaviors of athletic team merchandise (Lee, Trail, Kwon, & Anderson, 2011). Likewise, using a principal component analysis technique on a student sample, a measurement scale was proposed that consisted of nine factors affecting the purchase of athletic team merchandise. Using confirmatory factor analysis and multi-group invariance technique, the factorial structure and measurement equivalence of the model (included a new factor) was validated on a more generalizable sample in the current study. The overall model fit the data well. The overall findings of the current study contribute to the literature by exploring and filling the gap between existing studies and more generalizable data found in the present study. [ABSTRACT FROM AUTHOR]

Abstract: Background: β-blockers and calcium channel blockers are highly effective medications indicated for treatment and prevention of hypertension. However, the literature regarding the potential depressive effects of β-blockers and calcium channel blockers is equivocal regarding whether one or both are associated with depression. Objectives: To determine whether self-reported depressive symptoms of older persons with hypertension and coronary artery disease and who were randomly assigned to a verapamil-sustained-release-led (Ve-led) or atenolol-led (At-led) hypertension treatment strategy were similar using confirmatory factor analytical models of the Center for Epidemiologic Studies Depression Scale (CES-D). Methods: This study used a mail survey of patients enrolled in a substudy of an international randomized controlled clinical trial. Complete data on the CES-D after 1 year of treatment were obtained from 1019 study subjects. Multiple group confirmatory factor analysis (CFA) procedures were used to test for differences in the fit of the data to the initial 4-factor CES-D model among patients assigned to the 2 treatment groups after 12 months of therapy. A test of configural invariance was conducted by sequentially constraining various matrices to be equal across groups. The convergent validity of the model was tested by examining the standard errors of the lambda-X parameter estimates of the configural model. The factor loadings for like items were investigated across the 2 groups using a test of strong factorial invariance. Finally, the 2 treatment groups were compared on the 4 factors to detect differences in the model''s parameters. Results: Overall, the data fit the CFA models across the 2 treatment groups based on the 4-factor model. However, 3 items differed slightly, including appetite, depressed, and crying. The data suggested significant differences across groups on the positive affect, interpersonal relations, and somatic and retarded activity latent variables. Conclusions: The domains indicating less happiness and more depressive symptoms were most likely to be unfavorably impacted by the At-led treatment strategy. Given a choice between these equally effective high blood pressure treatment strategies, it may be prudent to use the Ve-led strategy. This is especially true if the risk of the occurrence of a mood-related side effect of the β-blocker outweighs its other benefits in comparison. [Copyright &y& Elsevier]

The Weinstein's Noise Sensitivity Scale (WNSS) is one of the most widely used questionnaires to measure noise sensitivity, the most important subjective factor moderating the impact of noise on perceived annoyance. The present study evaluates the psychometric properties of the Italian version of the WNSS, tests the measurement invariance of this scale as a function of internal and external factors, and evaluates the effect of age, sex, and context on noise sensitivity. The scale was administered to a sample of 413 adults (40% females) living in quiet or noisy contexts. Dimensionality, reliability, invariance, validity, and equivalence were analyzed. Results confirmed that the WNSS is a reliable, valid, and invariant scale. Furthermore, noise sensitivity is affected by both subjective factors, such as age and sex, and external factors, such as living context. [ABSTRACT FROM AUTHOR]

The author comments on the potential of integrative data analysis (IDA) as a new methodological activity and on some of the topics that were discussed in the 5 articles in this special issue. One topic is the extent to which IDA will be used to provide conclusive summaries regarding the strength of evidence for well-specified questions versus to provide new information that goes beyond the simple sum of individual studies. Another is the meaning of variances of effects that are observed over studies and sample strata. A 3rd is the potential to enhance understanding of construct validity by fitting measurement models described in the special issue. The author concludes by recommending critical examination of model-based inferences from IDA through sensitivity analyses and by noting that IDA can promote collaboration and networks that yield data that are more amenable to integrated analyses in the future. [ABSTRACT FROM AUTHOR]

This article describes a general item response theory-based factor analytic procedure that allows assessment of the equivalence between 2 administrative modes of a questionnaire: paper and pencil, and Internet based. The theoretical relations between the present procedure and other methods used in previous empirical research are shown, and the advantages of the procedure are discussed. An empirical application based on 2 personality questionnaires is given, and the results are compared with the results of using traditional procedures for assessing equivalence. The substantive implications of the results, as well as suggestions for further research and methodology, are discussed. [ABSTRACT FROM AUTHOR]

This article explores the cross-cultural equivalence of two composite measures of environmental concern derived from the International Social Survey Programme (ISSP): the pro-environmental views scale (PEVS) and the environmental awareness scale (EAS). Item response theory and multigroup confirmatory factor analysis were employed to evaluate comprehensively the target measures while focusing on a concrete cross-cultural comparison between Taiwan and the UK. The results indicated that both measures show nonequivalence to different extents. The PEVS presents substantial problems of validity in Taiwan, whereas in the UK it is a meaningful unidimensional measure if one item is excluded. Difficulties with construct equivalence, translation, and method bias were identified as potential causes of the scale's nonequivalence. The EAS is a suitable measure within both cultures, but it is affected by the cumulative effect of differential item functioning (DIF) that makes the comparison of group means imprecise. Taiwanese respondents' salient tendency to endorse higher response categories than expected for their latent levels of EA was determined as a potential cause of DIF, which may be related to bias induced by the response categories' labels. Above all, this study reminds the importance of examining carefully the measurements employed in cross-cultural research to avoid reporting findings that could be potentially misleading. • Two ISSP-based measures of environmental concern are nonequivalent across cultures. • The pro-environmental views scale is valid for the UK but not for Taiwan. • The environmental awareness scale (EAS) shows metric but not scalar equivalence. • DIF increases the group difference in scale scores on the EAS, favoring Taiwan. • Construct, method, and item biases were identified. [ABSTRACT FROM AUTHOR]

Background The 10-item Birth Satisfaction Scale-Revised (BSS-R) is being increasingly used internationally. The use of the measure and the concept has gathered traction in the United States following the development of a US version of the tool. A limitation of previous studies of the measurement characteristics of the BSS-R is modest sample size. Unplanned pregnancy is recognised as being associated with a range of negative birth outcomes, but the relationship to birth satisfaction has received little attention, despite the importance of birth satisfaction to a range of postnatal outcomes. Aim The current investigation sought to evaluate the measurement characteristics of the BSS-R in a large postpartum sample. Methods Multiple Groups Confirmatory Factor Analysis (MGCFA) was used to evaluate a series of measurement and structural models of the BSS-R to evaluate fundamental invariance characteristics using planned/unplanned pregnancy status to differentiate groups. Findings Complete data from N = 2116 women revealed that the US version of the BSS-R offers an excellent fit to data and demonstrates full measurement and structural invariance. Little difference was observed between women on the basis of planned/unplanned pregnancy stratification on measures of birth satisfaction. Discussion The established relationship between unplanned pregnancy and negative perinatal outcomes was not found to extend to birth satisfaction in the current study. The BSS-R demonstrated exemplary measurement and structural invariance characteristics. Conclusion The current study strongly supports the use of the US version of the BSS-R to compare birth satisfaction across different groups of women with theoretical and measurement confidence. [ABSTRACT FROM AUTHOR]