1. Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish
- Author
-
Emily Ajit‐Roger, Alexander Moise, Carolina Peralta, Ostap Orishchak, and Sam J. Daniel
- Subjects
artificial intelligence ,health education ,large language model ,Spanish ,sudden sensorineural hearing loss ,Otorhinolaryngology ,RF1-547 ,Surgery ,RD1-811 - Abstract
Abstract Objective This study investigates ChatGPT's accuracy, readability, understandability, and actionability in responding to patient queries on sudden sensorineural hearing loss (SSNHL) in English and Spanish, when compared to Google responses. The objective is to address concerns regarding its proficiency in addressing medical inquiries when presented in a language divergent from its primary programming. Study Design Observational. Setting Virtual environment. Methods Using ChatGPT 3.5 and Google, questions from the AAO‐HNSF guidelines were presented in English and Spanish. Responses were graded by 2 otolaryngologists proficient in both languages using a 4‐point Likert scale and the PEMAT‐P tool. To ensure uniform application of the Likert scale, a third independent evaluator reviewed the consistency in grading. Readability was evaluated using 3 different tools specific to each language. IBM SPSS Version 29 was used for statistical analysis using one‐way analysis of variance. Results Across both languages, the responses displayed a native‐level language proficiency. Accuracy was comparable between sources and languages. Google's Spanish responses had better readability (effect size 0.35, P
- Published
- 2024
- Full Text
- View/download PDF