Back to Search Start Over

Creating a large language model of a philosopher.

Authors :
Schwitzgebel, Eric
Schwitzgebel, David
Strasser, Anna
Source :
Mind & Language. Apr2024, Vol. 39 Issue 2, p237-259. 23p.
Publication Year :
2024

Abstract

Can large language models produce expert‐quality philosophical texts? To investigate this, we fine‐tuned GPT‐3 with the works of philosopher Daniel Dennett. To evaluate the model, we asked the real Dennett 10 philosophical questions and then posed the same questions to the language model, collecting four responses for each question without cherry‐picking. Experts on Dennett's work succeeded at distinguishing the Dennett‐generated and machine‐generated answers above chance but substantially short of our expectations. Philosophy blog readers performed similarly to the experts, while ordinary research participants were near chance distinguishing GPT‐3's responses from those of an "actual human philosopher". [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
02681064
Volume :
39
Issue :
2
Database :
Academic Search Index
Journal :
Mind & Language
Publication Type :
Academic Journal
Accession number :
176473809
Full Text :
https://doi.org/10.1111/mila.12466