1. CHATGPT'NİN FARKLI BÜYÜK DİL MODELLERİ PERFORMANSLARININ TÜRKÇEDEKİ EŞ ADLI KELİMELER ÜZERİNDEN İNCELENMESİ.
- Author
-
AYTEKİN, Çiğdem and KARABİNA, Talha Bedir
- Subjects
- *
NATURAL language processing , *LANGUAGE models , *ARTIFICIAL intelligence , *CHATGPT , *HOMONYMS , *ACHIEVEMENT - Abstract
ChatGPT, the popular topic in recent periods, and its achievements show us how much artificial intelligence has developed and what it promises for the coming years. This study focuses on the differences between ChatGPT and its currently used Large Language Models. The performances of ChatGPT-3.5 and ChatGPT-4 are analyzed on Turkish homonyms. One major challenge faced by Natural Language Processing systems used in the generation of Large Language Models is identifying word-sense ambiguity. In order to detect these ambiguities, the 200 most commonly used synonyms in Turkish were selected as the sample. Then, sentences were formed by using a single homonym twice in the same sentence to convey two different meanings, and ChatGPT-3.5 and then ChatGPT-4 were asked to detect the different meanings. ChatGPTs generated outputs in which they could not know either of the two meanings and sometimes could not know both meanings. In line with the objective, the outputs from ChatGPT-3.5 and ChatGPT-4 models were compared. As expected, ChatGPT-4, with its larger parameters and datasets, outperformed ChatGPT-3.5. Success rate distribution analysis, performance variation based on the homonym, the number of characters of the homonym and the success rate are the other statistical tests carried out. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF