1. The visual speech head start improves perception and reduces superior temporal cortex responses to auditory speech
- Author
-
John F. Magnotti, Lin L. Zhu, Michael S. Beauchamp, Daniel Yoshor, Patrick J. Karas, Kristen B Smith, and Brian Metzger
- Subjects
genetic structures ,speech ,cross-modal suppression ,Audiology ,0302 clinical medicine ,Biology (General) ,media_common ,Temporal cortex ,General Neuroscience ,05 social sciences ,General Medicine ,posterior superior temporal gyrus pSTG ,Temporal Lobe ,medicine.anatomical_structure ,Head start ,Auditory Perception ,Speech Perception ,Visual Perception ,Medicine ,Psychology ,Human ,medicine.medical_specialty ,Speech perception ,QH301-705.5 ,Science ,Movement ,media_common.quotation_subject ,050105 experimental psychology ,General Biochemistry, Genetics and Molecular Biology ,03 medical and health sciences ,Perception ,otorhinolaryngologic diseases ,medicine ,Humans ,audiovisual integration ,0501 psychology and cognitive sciences ,Human Biology and Medicine ,Mouth ,General Immunology and Microbiology ,multisensory integration ,Multisensory integration ,Visual cortex ,Auditory association cortex ,Auditory information ,Research Advance ,ECoG iEEG ,030217 neurology & neurosurgery ,Neuroscience - Abstract
Visual information about speech content from the talker’s mouth is often available before auditory information from the talker's voice. Here we examined perceptual and neural responses to words with and without this visual head start. For both types of words, perception was enhanced by viewing the talker's face, but the enhancement was significantly greater for words with a head start. Neural responses were measured from electrodes implanted over auditory association cortex in the posterior superior temporal gyrus (pSTG) of epileptic patients. The presence of visual speech suppressed responses to auditory speech, more so for words with a visual head start. We suggest that the head start inhibits representations of incompatible auditory phonemes, increasing perceptual accuracy and decreasing total neural responses. Together with previous work showing visual cortex modulation (Ozker et al., 2018b) these results from pSTG demonstrate that multisensory interactions are a powerful modulator of activity throughout the speech perception network.
- Published
- 2019
- Full Text
- View/download PDF