Back to Search Start Over

USING AI TO IMPROVE ANSWER EVALUATION IN AUTOMATED EXAMS.

Authors :
Cholakov, Georgi
Stoyanova-Doycheva, Asya
Source :
Mathematics & Informatics. 2024, Vol. 67 Issue 3, p289-304. 16p.
Publication Year :
2024

Abstract

The objective of the research is to enhance the functionality of the Evaluator software agent within the Distributed eLearning Center (DeLC), a platform providing extensive support for e-learning activities. This paper is focused on presenting the latest step in the evolution of one software agent (Evaluator Agent), which helps teachers during evaluating students' exams, being responsible for evaluation of short free text answers, provided by the students. To accomplish its job, the agent has its own dictionary, created from a set of words and expressions, provided by test creators for each question of that type, and from the words of each student's answer, marked as successful by the teacher. Now this agent's effectiveness could be increased by extending its dictionary with much larger knowledge base or so-called Large Language Models, made accessible through third party AI, as ChatGPT. Experiments and results are provided to compare the change in agent's behavior after the integration with the AI system. The results presented in this work are from first experiments and are deliberately limited in number to enable manual verification. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
13102230
Volume :
67
Issue :
3
Database :
Academic Search Index
Journal :
Mathematics & Informatics
Publication Type :
Academic Journal
Accession number :
178522218
Full Text :
https://doi.org/10.53656/math2024-3-4-imp