Search

Short scales are time‐efficient for participants and cost‐effective in research. However, researchers often mistakenly expect short scales to have the same reliability as long ones without considering the effect of scale length. We argue that applying a universal benchmark for alpha is problematic as the impact of low‐quality items is greater on shorter scales. In this study, we proposed simple guidelines for item reduction using the "alpha‐if‐item‐deleted" procedure in scale construction. An item can be removed if alpha increases or decreases by less than.02, especially for short scales. Conversely, an item should be retained if alpha decreases by more than.04 upon its removal. For reliability benchmarks,.80 is relatively safe in most conditions, but higher benchmarks are recommended for longer scales and smaller sample sizes. Supplementary analyses, including item content, face validity, and content coverage, are critical to ensure scale quality. [ABSTRACT FROM AUTHOR]

Objective: For Chinese students, learning is seen as their duty and obligation to the society and their parents. Thus, in contrast to the Western students, the effects of extrinsic motivation on academic performance may not necessarily be always negative. The present study examined the effects of intrinsic and extrinsic motivation, as well as their multiplicative effect among Chinese students.Method: A total of 13,799 students in China were followed longitudinally in three waves (Grade 10, beginning of school year, midyear, and end-of-year; 5-month interval each). The main and multiplicative effects of intrinsic and extrinsic motivations were used to predict academic growth in a latent growth model.Results: The multiplicative effect between intrinsic and extrinsic motivations showed that extrinsic motivation was detrimental to academic performance for students with high intrinsic motivation. For students with low intrinsic motivation, however, the extrinsic motivation helped to improve academic performance. Worth noting, intrinsic motivation also had a moderate positive effect on academic performance.Conclusions: For Chinese learners, interest is not the only key motive to learn. Extrinsic reasons could facilitate students' learning when they are not interested in the subject. Extrinsic motivation harms only for highly intrinsically motivated students. [ABSTRACT FROM AUTHOR]

The research examines possible differences in the mutual reinforcement (i.e. multiplicative) effect between intrinsic and instrumental motivation on academic performance across different cultures. Eight representative countries and economies from two large‐scale databases—the Trends in International Mathematics and Science Study (TIMSS) 2011 and the Programme for International Student Assessment (PISA) 2012—were used, respectively. Results showed that among the Confucian economies, instrumental motivation was more helpful in improving the mathematics performance of students with low intrinsic motivation than for those with high intrinsic motivation. This was shown by the multiplicative effect between intrinsic and instrumental motivation. Despite the difference, students in both Confucian and Western cultures with high intrinsic motivation had better mathematics performance than students with low intrinsic motivation. [ABSTRACT FROM AUTHOR]

Multistage adaptive testing (MST) has been recently adopted for international large‐scale assessments such as Programme for International Student Assessment (PISA). MST offers improved measurement efficiency over traditional nonadaptive tests and improved practical convenience over single‐item‐adaptive computerized adaptive testing (CAT). As a third alternative adaptive test design to MST and CAT, Zheng and Chang proposed the “on‐the‐fly multistage adaptive testing” (OMST), which combines the benefits of MST and CAT and offsets their limitations. In this study, we adopted the OMST design while also incorporating response time (RT) in item selection. Via simulations emulating the PISA 2018 reading test, including using the real item attributes and replicating PISA 2018 reading test's MST design, we compared the performance of our OMST designs against the simulated MST design in (1) measurement accuracy of test takers’ ability, (2) test time efficiency and consistency, and (3) expected gains in precision by design. We also investigated the performance of OMST in item bank usage and constraints management. Results show great potential for the proposed RT‐incorporated OMST designs to be used for PISA and potentially other international large‐scale assessments. [ABSTRACT FROM AUTHOR]