1. Evaluating the Effectiveness of Online Assessments and Their Parameters as Predictors of Academic Performance in Undergraduate Medical Education.
- Author
-
Mohanraj PS, Das A, Rajendran V, Gopal N, Saravanan K, and Balan Y
- Abstract
Background and objectives Considering the increasing utilization of online educational tools in medical education, it is essential to evaluate the reliability and validity of online assessments to accurately assess student proficiency and predict academic success. This study investigated the predictive efficacy of different online assessment methods in comparison to standard offline methods within the medical educational setting. Methods This study utilized a mixed-methods crossover design, involving 125 first-year medical students who were randomly assigned to either online or traditional examinations. The students then crossed over to the other type of assessment. The assessments consisted of multiple-choice questions (MCQs), viva voce, objective structured clinical examinations, and written theory examinations. Quantitative data on results, finishing times, and academic metrics were analyzed, along with qualitative data from student interviews exploring perceptions of each format. Results The online MCQs had the highest average scores and a moderately positive correlation with performance on the theory examination (r=0.326). Regression models indicated that online and offline MCQs were moderate positive predictors of theoretical marks (R
2 =0.106 and 0.107, respectively). Qualitative responses emphasized advantages such as flexibility and accessibility for online examinations but also concerns regarding technological challenges, interaction, and integrity compared to traditional formats. Conclusions Online MCQ assessments showed promise as indicators of medical student academic performance. However, additional online forms require improvement to match conventional assessments reliably. As medical education involves digital technologies, cautious implementation of online evaluations substantiated by further research is needed to preserve educational quality standards., Competing Interests: Human subjects: Consent was obtained or waived by all participants in this study. Institutional Human Ethics Committee issued approval IHEC/AIIMS-GKP/BMR l98/2022. Ethical approval was acquired from the Institute Ethics Committee (Human Studies), All India Institute of Medical Sciences, Gorakhpur, India, prior to the initiation of the study. Informed consent was obtained from all participants, ensuring they were fully aware of the study’s nature, the confidentiality of their data, and their right to withdraw at any moment without any repercussions. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work., (Copyright © 2024, Mohanraj et al.)- Published
- 2024
- Full Text
- View/download PDF