Back to Search Start Over

Does word knowledge account for the effect of world knowledge on pronoun interpretation?

Authors :
Cameron R. Jones
Benjamin Bergen
Source :
Language and Cognition, Vol 16, Pp 1182-1213 (2024)
Publication Year :
2024
Publisher :
Cambridge University Press, 2024.

Abstract

To what extent can statistical language knowledge account for the effects of world knowledge in language comprehension? We address this question by focusing on a core aspect of language understanding: pronoun resolution. While existing studies suggest that comprehenders use world knowledge to resolve pronouns, the distributional hypothesis and its operationalization in large language models (LLMs) provide an alternative account of how purely linguistic information could drive apparent world knowledge effects. We addressed these confounds in two experiments. In Experiment 1, we found a strong effect of world knowledge plausibility (measured using a norming study) on responses to comprehension questions that probed pronoun interpretation. In experiment 2, participants were slower to read continuations that contradicted world knowledge-consistent interpretations of a pronoun, implying that comprehenders deploy world knowledge spontaneously. Both effects persisted when controlling for the predictions of GPT-3, an LLM, suggesting that pronoun interpretation is at least partly driven by knowledge about the world and not the word. We propose two potential mechanisms by which knowledge-driven pronoun resolution occurs, based on validation- and expectation-driven discourse processes. The results suggest that while distributional information may capture some aspects of world knowledge, human comprehenders likely draw on other sources unavailable to LLMs.

Details

Language :
English
ISSN :
18669808 and 18669859
Volume :
16
Database :
Directory of Open Access Journals
Journal :
Language and Cognition
Publication Type :
Academic Journal
Accession number :
edsdoj.f32a40045f548c8aa98898015120836
Document Type :
article
Full Text :
https://doi.org/10.1017/langcog.2024.2