Back to Search Start Over

Audiovisual Speech Scene Analysis in the Context of Competing Sources

Authors :
Attigodu Chandrashekara Ganesh
Jean-Luc Schwartz
Frédéric Berthommier
Association of Computer Electronics and Electrical Engineers (ACEEE)
Institute of Doctors Engineers and Scientists
GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD)
Département Parole et Cognition (GIPSA-DPC)
Grenoble Images Parole Signal Automatique (GIPSA-lab )
Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab )
Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])
European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014)
Source :
Proceedings Interspeech 2016, Interspeech 2016-17th Annual Conference of the International Speech Communication Association, Interspeech 2016-17th Annual Conference of the International Speech Communication Association, Sep 2016, San Francisco, United States. pp.47-51, ⟨10.21437/Interspeech.2016-62⟩, INTERSPEECH
Publication Year :
2016
Publisher :
HAL CCSD, 2016.

Abstract

International audience; Audiovisual fusion in speech perception is generally conceived as a process independent from scene analysis, which is supposed to occur separately in the auditory and visual domain. On the contrary, we have been proposing in the last years that scene analysis such as what takes place in the cocktail party effect was an audiovisual process. We review here a series of experiments illustrating how audiovisual speech scene analysis occurs in the context of competing sources. Indeed, we show that a short contextual audiovisual stimulus made of competing auditory and visual sources modifies the perception of a following McGurk target. We interpret this in terms of binding, unbinding and rebinding processes, and we show how these processes depend on audiovisual correlations in time, attentional processes and differences between junior and senior participants.

Details

Language :
English
Database :
OpenAIRE
Journal :
Proceedings Interspeech 2016, Interspeech 2016-17th Annual Conference of the International Speech Communication Association, Interspeech 2016-17th Annual Conference of the International Speech Communication Association, Sep 2016, San Francisco, United States. pp.47-51, ⟨10.21437/Interspeech.2016-62⟩, INTERSPEECH
Accession number :
edsair.doi.dedup.....b65a6677aa6b3e34c31e0c36baa99be0