1. Are script concordance tests suitable for the assessment of undergraduate students? A multicenter comparative study
- Author
-
Damien Roux, Alexandre Hertig, Olivier Palombi, Marie-Christine Renaud, Zahir Amoura, Thomas Papo, Alexandre Duguet, M. Braun, Olivier Steichen, and F. Cohen Aubart
- Subjects
medicine.medical_specialty ,Students, Medical ,020205 medical informatics ,Concordance ,Gastroenterology ,Clinical reasoning ,Reproducibility of Results ,02 engineering and technology ,Test (assessment) ,03 medical and health sciences ,0302 clinical medicine ,0202 electrical engineering, electronic engineering, information engineering ,Internal Medicine ,medicine ,Humans ,Medical physics ,Clinical Competence ,Educational Measurement ,030212 general & internal medicine ,Psychology ,Reliability (statistics) ,Education, Medical, Undergraduate ,Multiple choice - Abstract
Introduction Script concordance tests (SCTs) have been developed to assess clinical reasoning in uncertain situations. Their reliability for the evaluation of undergraduate medical students has not been evaluated. Methods Twenty internal medicine SCT cases were implemented in undergraduate students of two programs. The results obtained on the SCTs were compared to those obtained by the same students on clinical-based classical multiple-choice questions (MCQs). Results A total of 551/883 students (62%) answered the SCTs. The mean aggregate score (based on a total 20 points) was 11.54 (3.29). The success rate and mean score for each question did not differ depending on the modal response but the discrimination rate did. The results obtained by the students on the SCT test correlated with their scores on the MCQ tests. Among students, 446/517 (86%) considered the SCTs to be more difficult than classical MCQs, although the mean score did not differ between the SCT and MCQ tests. Conclusion The use of SCTs is a feasible option for the evaluation of undergraduate students. The SCT scores correlated with those obtained on classical MCQ tests.
- Published
- 2021