1. Bits of Grass: Does GPT already know how to write like Whitman?
- Author
-
Sawicki, Piotr, Grzes, Marek, Goes, Fabricio, Brown, Dan, Peeperkorn, Max, and Khatun, Aisha
- Subjects
Computer Science - Computation and Language - Abstract
This study examines the ability of GPT-3.5, GPT-3.5-turbo (ChatGPT) and GPT-4 models to generate poems in the style of specific authors using zero-shot and many-shot prompts (which use the maximum context length of 8192 tokens). We assess the performance of models that are not fine-tuned for generating poetry in the style of specific authors, via automated evaluation. Our findings indicate that without fine-tuning, even when provided with the maximum number of 17 poem examples (8192 tokens) in the prompt, these models do not generate poetry in the desired style., Comment: short paper 5 pages
- Published
- 2023