Back to Search
Start Over
Multimodal semantic revision during inferential processing: The role of inhibitory control in text and picture comprehension
- Source :
- Neuropsychologia. 138:107313
- Publication Year :
- 2020
- Publisher :
- Elsevier BV, 2020.
-
Abstract
- Although language comprehension usually requires multimodal information, no study to date has investigated how comprehenders deal with the revision of a text's interpretation when different modalities are involved. Twenty-four young adults listened to a story prompting an inference (e.g., polar bear), and then saw a picture that was either consistent (polar bear) or inconsistent but still plausible (penguin). Larger negativity (N400) in the inconsistent picture indicated successful inferential monitoring. Subsequently, a sentence carried the disambiguating word which was either expected (“bear”) or unexpected (“penguin”) in relation to the auditory-verbal information. Larger negativity in the unexpected word coming from the consistent picture suggested that comprehenders had difficulties selecting the unexpected concept when previous information was contradictory. More importantly, this effect was modulated by inhibitory control, where a higher resistance to distractor interference (flanker task) was associated with a better ability to suppress pictorial information, therefore preventing semantic competition. Similarly, accuracy measured in a final comprehension question demonstrated that higher inhibitory control was related to a more efficient ability to revise the situation model across modalities. Our findings speak to a relationship between story comprehension and mental flexibility during multimodal processing.
- Subjects :
- Adult
Male
Revision
Cognitive Neuroscience
Inference
Experimental and Cognitive Psychology
Resistance (psychoanalysis)
050105 experimental psychology
Task (project management)
Thinking
Executive Function
Young Adult
03 medical and health sciences
Behavioral Neuroscience
0302 clinical medicine
Inferential monitoring
Humans
Attention
0501 psychology and cognitive sciences
Inhibitory control
Evoked Potentials
Multimodal information
Modalities
05 social sciences
Cognitive flexibility
Electroencephalography
N400
Semantics
Comprehension
Inhibition, Psychological
Pattern Recognition, Visual
Text comprehension
Speech Perception
Female
Psychology
030217 neurology & neurosurgery
Sentence
Cognitive psychology
Subjects
Details
- ISSN :
- 00283932
- Volume :
- 138
- Database :
- OpenAIRE
- Journal :
- Neuropsychologia
- Accession number :
- edsair.doi.dedup.....74183e94560d288ebb6a2c2b58dcffea