Back to Search Start Over

Development of a High-Accuracy and Effective Online Calibration Method in CD-CAT Based on Gini Index

Authors :
Tan, Qingrong
Cai, Yan
Luo, Fen
Tu, Dongbo
Source :
Journal of Educational and Behavioral Statistics. Feb 2023 48(1):103-141.
Publication Year :
2023

Abstract

To improve the calibration accuracy and calibration efficiency of cognitive diagnostic computerized adaptive testing (CD-CAT) for new items and, ultimately, contribute to the widespread application of CD-CAT in practice, the current article proposed a Gini-based online calibration method that can simultaneously calibrate the Q-matrix and item parameters of new items. Three simulation studies with simulated and real item banks were conducted to investigate the performance of the proposed method and compare it with the joint estimation algorithm (JEA) and the single-item estimation (SIE) methods. The results indicated that the proposed Gini-based online calibration method yielded higher calibration efficiency than those of the SIE method and outperformed the JEA method on item calibration tasks in terms of both accuracy and efficiency under most experimental conditions.

Details

Language :
English
ISSN :
1076-9986 and 1935-1054
Volume :
48
Issue :
1
Database :
ERIC
Journal :
Journal of Educational and Behavioral Statistics
Publication Type :
Academic Journal
Accession number :
EJ1361956
Document Type :
Journal Articles<br />Reports - Research
Full Text :
https://doi.org/10.3102/10769986221126741