Interpreting Logical Metonymy through Dense Paraphrasing

Compositionality has been argued to a necessary component of interpreting language, yet there appear to be many linguistic phenomena that do not overtly exhibit semantic compositional behavior. One of the challenges involves the phenomena of contextual modulations referred to collectively as semantic coercion or logical metonymy. In this paper, we present a computational model that provides the “compositional flexibility” in the interpretation of a verb with its arguments, for such coercive contexts in English. Specifically, we argue that such constructions typically have surface structural correlates in the form of dense paraphrases, and that these forms can be used to model the masked content in the coerced compositional context. We present preliminary results using a transformer architecture on a masked completion task. Our results show that modeling logical metonymy is a challenging task but can be substantially improved by fine-tuning through dense paraphrasing.