HOMOGENEITY OF TOKEN PROBABILITY DISTRIBUTIONS IN CHATGPT AND HUMAN TEXTS.

Authors :: Ljubisavljević, Dragica
Koprivica, Marko
Kostić, Aleksandar
Devedžić, Vladan
Source :: Proceedings of the IADIS International Conference on Cognition & Exploratory Learning in Digital Age; 2023, p207-213, 7p
Publication Year :: 2023
Abstract: This paper delves into statistical disparities between human-written and ChatGPT-generated texts, utilizing an analysis of Shannon's equitability values, and token frequency. Our findings indicate that Shannon's equitability can potentially be a differentiating factor between texts produced by humans and those generated by ChatGPT. Additionally, we uncover substantial distinctions when studying the most frequent tokens. [ABSTRACT FROM AUTHOR]

Subjects :: CHATGPT
UNCERTAINTY (Information theory)
EDUCATION
TOKENS
LANGUAGE models

Language :: English
Database :: Supplemental Index
Journal :: Proceedings of the IADIS International Conference on Cognition & Exploratory Learning in Digital Age
Publication Type :: Conference
Accession number :: 174156447

Tools