1. Meaning above (and in) the head: Combinatorial visual morphology from comics and emoji
- Author
-
Neil Cohn, Tom Foulsham, and Language, Communication and Cognition
- Subjects
Morphology ,Male ,Visual language ,Word ,Experimental and Cognitive Psychology ,Semantic Integration ,Vocabulary ,Evoked Potentials/physiology ,Affixation ,Arts and Humanities (miscellaneous) ,Reaction Time ,Compositionality ,Humans ,N400 ,Evoked Potentials ,Language ,Context ,Electroencephalography ,Predictability ,Event-related Potentials ,Semantics ,Recognition ,Neuropsychology and Physiological Psychology ,Reaction Time/physiology ,Electrophysiological Evidence ,Female ,Comprehension - Abstract
Compositionality is a primary feature of language, but graphics can also create combinatorial meaning, like with items above faces (e.g., lightbulbs to mean inspiration). We posit that these “upfixes” (i.e., upwards affixes) involve a productive schema enabling both stored and novel face–upfix dyads. In two experiments, participants viewed either conventional (e.g., lightbulb) or unconventional (e.g., clover-leaves) upfixes with faces which either matched (e.g., lightbulb/smile) or mismatched (e.g., lightbulb/frown). In Experiment 1, matching dyads sponsored higher comprehensibility ratings and faster response times, modulated by conventionality. In Experiment 2, event-related brain potentials (ERPs) revealed conventional upfixes, regardless of matching, evoked larger N250s, indicating perceptual expertise, but mismatching and unconventional dyads elicited larger semantic processing costs (N400) than conventional-matching dyads. Yet mismatches evoked a late negativity, suggesting congruent novel dyads remained construable compared with violations. These results support that combinatorial graphics involve a constrained productive schema, similar to the lexicon of language.
- Published
- 2022