1. Fluidity in the perception of auditory speech: Cross-modal recalibration of voice gender and vowel identity by a talking face
- Author
-
Thijs van Laarhoven, Martijn Baart, Jean Vroomen, Merel A. Burgering, and Cognitive Neuropsychology
- Subjects
Adult ,Male ,medicine.medical_specialty ,SEX-DIFFERENCES ,INFORMATION ,SELECTIVE ADAPTATION ,Physiology ,media_common.quotation_subject ,Audiovisual integration ,Face (sociological concept) ,Experimental and Cognitive Psychology ,Adaptation (eye) ,Audiology ,recalibration ,050105 experimental psychology ,Identity (music) ,SPEAKER ,03 medical and health sciences ,Young Adult ,0302 clinical medicine ,Sex Factors ,ELECTROPHYSIOLOGICAL EVIDENCE ,Physiology (medical) ,Vowel ,Perception ,medicine ,gender ,Humans ,0501 psychology and cognitive sciences ,LIPREAD SPEECH ,General Psychology ,media_common ,IDENTIFICATION ,05 social sciences ,RECOGNITION ,EAR ,General Medicine ,selective adaptation ,Neuropsychology and Physiological Psychology ,Modal ,PHONETIC RECALIBRATION ,Social Perception ,Speech Perception ,Female ,Psychology ,vowel ,Facial Recognition ,030217 neurology & neurosurgery - Abstract
Article first published online: January 13, 2020 Humans quickly adapt to variations in the speech signal. Adaptation may surface as recalibration, a learning effect driven by error-minimisation between a visual face and an ambiguous auditory speech signal, or as selective adaptation, a contrastive aftereffect driven by the acoustic clarity of the sound. Here, we examined whether these aftereffects occur for vowel identity and voice gender. Participants were exposed to male, female, or androgynous tokens of speakers pronouncing /e/, /ø/, (embedded in words with a consonant-vowel-consonant structure), or an ambiguous vowel halfway between /e/ and /ø/ dubbed onto the video of a male or female speaker pronouncing /e/ or /ø/. For both voice gender and vowel identity, we found assimilative aftereffects after exposure to auditory ambiguous adapter sounds, and contrastive aftereffects after exposure to auditory clear adapter sounds. This demonstrates that similar principles for adaptation in these dimensions are at play. The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by Gravitation Grant 024.001.006 of the Language in Interaction Consortium from Netherlands Organization for Scientific Research. The third author was supported by The Netherlands Organization for Scientific Research (NWO: VENI Grant 275-89-027).
- Published
- 2020