Search

Your search keyword '"Schwartz, Jean-Luc"' showing total 230 results
Start Over Author "Schwartz, Jean-Luc" Search Limiters Full Text
230 results on '"Schwartz, Jean-Luc"'

1. Listeners' convergence towards an artificial agent in a joint phoneme categorization task

Author

Nguyen, Noël, Lancia, Leonardo, Huttner, Lena, Schwartz, Jean-Luc, and Diard, Julien

Abstract

This study focuses on inter-individual convergence effects in the perception and categorization of speech sounds. We ask to what extent two listeners can come to establish a shared set of categorization criteria in a phoneme identification task that they accomplish together. Several hypotheses  are  laid  out  in  the  framework  of  a  Bayesian  model  of  speech  perception  that  we  have  developed  to  account  for  how  two  listeners  may  each  infer  the  parameters  that  govern  their partner’s responses. In our experimental paradigm, participants were asked to perform a joint  phoneme  identification  task  with  a  partner  that,  unbeknownst  to  them,  was  an  artificial  agent, whose responses we manipulated along two dimensions, the location of the categorical boundary and the slope of the identification function. Convergence was found to arise for bias but not for slope. Numerical simulations suggested that lack of convergence in slope may stem from the listeners’ prior level of confidence in the variance in VOT for the two phonemic categories. This study sheds new light on perceptual convergence between listeners in the categorization of speech sounds, a phenomenon that has received little attention so far in spite of its central importance for speech communication.

Published
2024

2. Self-supervised speech unit discovery from articulatory and acoustic features using VQ-VAE

Author

Georges, Marc-Antoine, Schwartz, Jean-Luc, and Hueber, Thomas

Subjects
Computer Science - Computation and Language
Abstract

The human perception system is often assumed to recruit motor knowledge when processing auditory speech inputs. Using articulatory modeling and deep learning, this study examines how this articulatory information can be used for discovering speech units in a self-supervised setting. We used vector-quantized variational autoencoders (VQ-VAE) to learn discrete representations from articulatory and acoustic speech data. In line with the zero-resource paradigm, an ABX test was then used to investigate how the extracted representations encode phonetically relevant properties. Experiments were conducted on three different corpora in English and French. We found that articulatory information rather organises the latent representations in terms of place of articulation whereas the speech acoustics mainly structure the latent space in terms of manner of articulation. We show that an optimal fusion of the two modalities can lead to a joint representation of these phonetic dimensions more accurate than each modality considered individually. Since articulatory information is usually not available in a practical situation, we finally investigate the benefit it provides when inferred from the speech acoustics in a self-supervised manner.

Published
2022

3. Repeat after me: Self-supervised learning of acoustic-to-articulatory mapping by vocal imitation

Author

Georges, Marc-Antoine, Diard, Julien, Girin, Laurent, Schwartz, Jean-Luc, and Hueber, Thomas

Subjects
Computer Science - Sound, Computer Science - Computation and Language, Electrical Engineering and Systems Science - Audio and Speech Processing
Abstract

We propose a computational model of speech production combining a pre-trained neural articulatory synthesizer able to reproduce complex speech stimuli from a limited set of interpretable articulatory parameters, a DNN-based internal forward model predicting the sensory consequences of articulatory commands, and an internal inverse model based on a recurrent neural network recovering articulatory commands from the acoustic speech input. Both forward and inverse models are jointly trained in a self-supervised way from raw acoustic-only speech data from different speakers. The imitation simulations are evaluated objectively and subjectively and display quite encouraging performances.

Published
2022

4. Bayesian gates: a probabilistic modeling tool for temporal segmentation of sensory streams into sequences of perceptual accumulators

Author

Nabé, Mamady, Schwartz, Jean-Luc, and Diard, Julien

Subjects
Artificial Intelligence, Psychology, Perception, Sensory Processing, Speech recognition, Bayesian modeling, Computational Modeling
Abstract

To explain how perception processes are performed, understanding how continuous sensory streams are temporally segmented into discrete units is central. This is particularly the case in speech perception where temporal segmentation is key for identifying linguistic units contained between consecutive events in time. We propose an original probabilistic construct, that we call "Bayesian gates", to segment temporally continuous streams of sensory stimuli into sequences of decoders. We first define Bayesian gates mathematically and describe their properties. We then illustrate their behavior in the context of a model of word recognition in speech perception. We show that, based on an event detection module, they sequentially parse the acoustic stimulus, so that each syllable decoder only processes a segment of the sensory signal.

Published
2022

5. Learning robust speech representation with an articulatory-regularized variational autoencoder

Author

Georges, Marc-Antoine, Girin, Laurent, Schwartz, Jean-Luc, and Hueber, Thomas

Subjects
Computer Science - Sound, Computer Science - Computation and Language, Electrical Engineering and Systems Science - Audio and Speech Processing
Abstract

It is increasingly considered that human speech perception and production both rely on articulatory representations. In this paper, we investigate whether this type of representation could improve the performances of a deep generative model (here a variational autoencoder) trained to encode and decode acoustic speech features. First we develop an articulatory model able to associate articulatory parameters describing the jaw, tongue, lips and velum configurations with vocal tract shapes and spectral features. Then we incorporate these articulatory parameters into a variational autoencoder applied on spectral features by using a regularization technique that constraints part of the latent space to follow articulatory trajectories. We show that this articulatory constraint improves model training by decreasing time to convergence and reconstruction loss at convergence, and yields better performance in a speech denoising task.

Published
2021

8. Cued Speech Enhances Speech-in-Noise Perception

Author

Bayard, Clémence, Machart, Laura, Strauß, Antje, Gerber, Silvain, Aubanel, Vincent, and Schwartz, Jean-Luc

Abstract

Speech perception in noise remains challenging for Deaf/Hard of Hearing people (D/HH), even fitted with hearing aids or cochlear implants. The perception of sentences in noise by 20 implanted or aided D/HH subjects mastering Cued Speech (CS), a system of hand gestures complementing lip movements, was compared with the perception of 15 typically hearing (TH) controls in three conditions: audio only, audiovisual, and audiovisual + CS. Similar audiovisual scores were obtained for signal-to-noise ratios (SNRs) 11 dB higher in D/HH participants compared with TH ones. Adding CS information enabled D/HH participants to reach a mean score of 83% in the audiovisual + CS condition at a mean SNR of 0 dB, similar to the usual audio score for TH participants at this SNR. This confirms that the combination of lipreading and Cued Speech system remains extremely important for persons with hearing loss, particularly in adverse hearing conditions.

Published
2019
Full Text
View/download PDF

10. Audio Visual Integration with Competing Sources in the Framework of Audio Visual Speech Scene Analysis

Author

Ganesh, Attigodu Chandrashekara, Berthommier, Frédéric, Schwartz, Jean-Luc, COHEN, IRUN R., Series Editor, LAJTHA, ABEL, Series Editor, LAMBRIS, JOHN D., Series Editor, PAOLETTI, RODOLFO, Series Editor, REZAEI, NIMA, Series Editor, van Dijk, Pim, editor, Başkent, Deniz, editor, Gaudrain, Etienne, editor, de Kleine, Emile, editor, Wagner, Anita, editor, and Lanting, Cris, editor

Published
2016
Full Text
View/download PDF

12. Audio-visual integration of Cued-Speech (CS) gestures to speech sounds and the effect of CS perception on speech-in-noise understanding in hearing-impaired and in typically hearing adults

Author

Groupe de Contact FNRS en Psycholinguistique et Neurolinguistique (08 décembre: Louvain-la-Neuve), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Leybaert, Jacqueline, Colin, Cécile, Groupe de Contact FNRS en Psycholinguistique et Neurolinguistique (08 décembre: Louvain-la-Neuve), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Leybaert, Jacqueline, and Colin, Cécile

Abstract

info:eu-repo/semantics/nonPublished

Published
2023

13. Audio-visual integration of Cued Speech perception :impact on SPIN comprehension and listening effort

Author

Comm4CHILD final conference (10 novembre: Bruxelles), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Hoi Ning, Elaine, Fiedler, L, Leybaert, Jacqueline, Colin, Cécile, Comm4CHILD final conference (10 novembre: Bruxelles), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Hoi Ning, Elaine, Fiedler, L, Leybaert, Jacqueline, and Colin, Cécile

Abstract

info:eu-repo/semantics/published

Published
2023

16. Les sciences cognitives

Author

Schwartz, Jean-Luc

Subjects
GTG, sciences humaines et sociales, monde, questions contemporaines, recherche, SOC000000, Humanities, Multidisciplinary, Social Sciences, Interdisciplinary
Abstract

Les sciences cognitives désignent le projet et le programme de recherches qui visent à comprendre « la cognition », c’est-à-dire comment les humains – et le cas échéant les animaux – perçoivent, apprennent et interagissent avec leur environnement. Les sciences cognitives se sont constituées au cours de la seconde moitié du xxe siècle par une série de bouleversements théoriques et épistémologiques convergents, provenant à la fois de la psychologie, de la biologie, de la linguistique, de la phi...

Published
2023

17. Un monde commun

Author

Abélès, Marc, Abergel, Violette, Adamou, Evangelia, Adell, Nicolas, Albera, Dionigi, Bachrach, Asaf, Baneth-Nouailhetas, Émilienne, Bellanger, Emmanuel, Benoist, Jocelyn, Bérard, Reine-Marie, Bezes, Philippe, Bocquentin, Fanny, Borraz, Olivier, Bortolamiol, Sarah, Boudou, Benjamin, Bourgeois-Gironde, Sacha, Bretelle-Establet, Florence, Bridonneau, Marie, Bromberger, Christian, Candau, Joël, Cantù, Paola, Cecchetto, Carlo, Chottin, Marion, Clauzel, Céline, Clochard, Olivier, Copley, Bridget, Cornu, Marie, Dauchy, Serge, Déloye, Yves, Delpeuch, Thierry, Demoule, Jean-Paul, Derat, Marie-Laure, Devillers, Benoît, Didier, Emmanuel, Duclert, Vincent, d’Albis, Hippolyte, Espinosa, Romain, Fleurbaey, Marc, Fliche, Benoît, Fritz, Carole, Gaille, Marie, Gardent, Claire, Gesquière, Gilles, Gipouloux, François, Gollier, Christian, Grimaud, Emmanuel, Halpérin, Jean-Louis, Hochmann, Jean-Rémy, Imbert, Christophe, Inglebert, Hervé, Isnart, Cyril, Jacques, Guillaume, Jouitteau, Mélanie, Keck, Frédéric, Laborde, Denis, Lahire, Bernard, Laroche, Julien, Larrère, Catherine, Lemoine-Schonne, Marion, Le Bigot, Brenda, Le Bot, Olivier, Le Tourneau, François-Michel, Lhuilier, Dominique, Lucken, Michael, Mervant-Roux, Marie-Madeleine, Miret, Naïk, Monjaret, Anne, Moura, Jean-Marc, Musselin, Christine, Nguyen, Noël, Nikitina, Tatiana, Oberti, Marco, Pairault, Thierry, Parizot, Cédric, Paugam, Serge, Pons, Christophe, Poupin, Perrine, Prat, Sandrine, Puig, Nicolas, Quentin, Aurélie, Rainhorn, Judith, Raveneau, Gilles, Reboul, Anne, Roy, Isabelle, Rygiel, Philippe, Santoro, Mirko, Schaeffer, Jean-Marie, Schwartz, Jean-Luc, Simon, Anne, Sommier, Isabelle, Soulier, Alexandra, Tirole, Jean, Toussaint, Jean-Yves, Vaguet, Yvette, Vanden Eynde, Oliver, Verdeil, Éric, Vidal, Cécile, Vuattoux, Arthur, Zanfi, Caterina, Zecchini, Laetitia, and Gefen, Alexandre

Subjects
GTG, sciences humaines et sociales, monde, questions contemporaines, recherche, SOC000000, Humanities, Multidisciplinary, Social Sciences, Interdisciplinary
Abstract

Philosophie, sociologie, anthropologie, études littéraires, linguistique, histoire, géographie, psychologie, musicologie, esthétique, histoire de l’art, économie, sciences politiques, droit, archéologie… : les disciplines couvertes par les sciences humaines et sociales sont vastes et variées. À toutes incombent d’analyser, comprendre, décrire le monde et la façon dont les hommes, les femmes et plus largement le vivant l’ont habité, l’habitent et l’habiteront. Toutes partagent une réflexion sur un sujet rendu majeur par la crise environnementale, les bouleversements numériques, les inégalités sociales et les conflits : comment faire « monde commun », pour reprendre la formule de Hannah Arendt ? L’ouvrage propose une centaine de contributions portant sur des questions contemporaines, qui font écho aux objectifs de développement durable identifiés par l’Organisation des Nations unies (la réduction de la pauvreté, des inégalités éducatives, la protection de la planète, etc.) et explorent la manière dont la recherche actuelle en sciences humaines et sociales y répond. Méthodes, hypothèses et théorisations, mesures et approches ethnographiques, analyses et exégèses constituent autant d’outils permettant aux lecteurs de penser, d’habiter, de réparer ou de transformer nos univers communs. Un ouvrage richement illustré qui incarne une communauté de recherche dans toute sa diversité.

Published
2023

18. The effect Cued Speech (CS) perception on audiovisual speech processing with typically hearing adults who are naïve or experts towards CS

Author

3rd Workshop of Comm4CHILD (18-20 mai: Grenoble), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Leybaert, Jacqueline, Colin, Cécile, 3rd Workshop of Comm4CHILD (18-20 mai: Grenoble), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Leybaert, Jacqueline, and Colin, Cécile

Abstract

info:eu-repo/semantics/nonPublished

Published
2022

19. The effect of Cued Speech (CS) perception on auditory processing in typically hearing adults

Author

Annual meeting of the Belgian Association for Psychological Sciences (02-03 juin 2022: KUL), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, Colin, Cécile, Annual meeting of the Belgian Association for Psychological Sciences (02-03 juin 2022: KUL), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, and Colin, Cécile

Abstract

info:eu-repo/semantics/published

Published
2022

20. The effect of Cued Speech (CS) perception on auditory processing in typically hearing adults

Author

6th International Conference on Cognitive Hearing Science for Communication (12-15 juin 2022: Linköping), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, Colin, Cécile, 6th International Conference on Cognitive Hearing Science for Communication (12-15 juin 2022: Linköping), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, and Colin, Cécile

Abstract

info:eu-repo/semantics/published

Published
2022

21. The effect of Cued Speech (CS) perception on auditory processing with adults who are naive or experts in CS

Author

ITN meeting (02 mai 2022: Université libre de Bruxelles), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, Colin, Cécile, ITN meeting (02 mai 2022: Université libre de Bruxelles), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, and Colin, Cécile

Abstract

info:eu-repo/semantics/published

Published
2022

25. The effect of Cued Speech (CS) perception on auditory processing in typically hearing adults

Author

Annual meeting of the Groupe de contact FNRS “Psycholinguistique et Neurolinguistique” (26 novembre 2021: Université de Liège), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, Colin, Cécile, Annual meeting of the Groupe de contact FNRS “Psycholinguistique et Neurolinguistique” (26 novembre 2021: Université de Liège), Jirschik Caron, Cora, Schwartz, Jean-Luc, Vilain, Coriandre, Bayard, Clémence, Leybaert, Jacqueline, Calcus, Axelle, and Colin, Cécile

Abstract

info:eu-repo/semantics/published

Published
2021

26. Orofacial somatosensory inputs enhance speech intelligibility in noisy environments

Author

Ogane, Rintaro, Schwartz, Jean-Luc, Ito, Takayuki, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), GIPSA Pôle Parole et Cognition (GIPSA-PPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Grenoble Alpes (UGA), Haskins Laboratories, European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Ogane, Rintaro, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
[SCCO]Cognitive science, [SCCO] Cognitive science, ComputingMilieux_MISCELLANEOUS
Abstract

International audience

Published
2020

29. Chapitre 5. La parole, entre objets vocaux et objets du monde

Author

Schwartz, Jean-Luc and Lœvenbruck, Hélène

Subjects
cognition, psychologie cognitive, SCI090000, processus perceptivomoteur, Psychology, GTR
Abstract

La parole transdisciplinaire La parole est l’ensemble des mécanismes (de perception, d’action) qui permettent aux humains de communiquer par le langage oral. Elle est la prise en charge directe du langage par le corps. Corps perceptivo-moteur (percevoir, produire), corps audio-vocal (une bouche pour parler, une oreille pour entendre), ou plutôt audio-visuo-orofacial (l’œil perçoit les gestes du conduit vocal et de la face, autant que l’oreille les entend) et même audio-visuo-oro-facio-brachio...

Published
2019

30. La psychologie cognitive

Author

Auvray, Malika, Bonnefon, Jean-François, Bourdin, Christophe, Cordier, Françoise, Denis, Michel, Devaux, Damien, Lœvenbruck, Hélène, Lorenzi, Christian, Mermillod, Martial, Niedenthal, Paula, Perruchet, Pierre, Poulin-Charronnat, Bénédicte, Schwartz, Jean-Luc, Silvert, Lætitia, Tarroux, Philippe, Vercher, Jean-Louis, Vermeulen, Nicolas, and Denis, Michel

Subjects
cognition, psychologie cognitive, SCI090000, processus perceptivomoteur, Psychology, GTR
Abstract

La psychologie a pour mission de rendre compte des grandes fonctions par lesquelles le système cognitif humain interagit avec son environnement et crée de celui-ci des représentations utilisables dans des conduites adaptées. En reconnaissant le caractère partageable du concept de cognition, la psychologie a joué un rôle essentiel dans la création du courant des sciences cognitives, qui implique toutes les disciplines intéressées par les processus de traitement de l'information et de gestion des connaissances. L'ouvrage passe en revue les fonctions cognitives sur lesquelles des collaborations privilégiées ont été développées avec les autres disciplines cognitives. Après un chapitre introductif analysant la place de la psychologie dans le concert des sciences cognitives, les domaines abordés par les auteurs des neuf chapitres suivants vont de la perception au raisonnement en passant par la sensorimotricité, la cognition spatiale, le traitement de la parole, la compréhension du langage, la mémoire et l'apprentissage, sans omettre le domaine important des émotions. Chaque chapitre présente un tableau des formes de collaboration interdisciplinaires qui se sont illustrées ou qui sont en émergence, principalement avec la linguistique, l'intelligence artificielle et les neurosciences.

Published
2019

31. Orofacial Somatosensory Effects for the Word Segmentation Judgement

Author

Ogane, Rintaro, Schwartz, Jean-Luc, Ito, Takayuki, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Haskins Laboratories, European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Ogane, Rintaro, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
temporal timing, [SCCO]Cognitive science, speech production, multisensory integration, [SCCO] Cognitive science, lexical perception
Abstract

International audience; Word segmentation is one of the initial processes for lexical perception. While visual inputs can help it in acoustically ambiguous situations, the effect of orofacial somatosensory inputs to this process is unknown. We here tested how orofacial somatosensory inputs affect word segmentation for lexical perception. We carried out identification tests using a French phrase consisting of a definitive and a noun, segmented differently according to the place of the accents in the phrase. In the test applying somatosensory stimulation at various timings along the phrase with neutral accent, we found that the lexical perception was significantly and systematically biased depending on the somatosensory stimulus timing. This bias effect was not seen when two somatosensory stimuli were applied to emphasize one accent position rather than the other by changing force amplitude between two positions. The results show and quantify the role the orofacial somatosensory system plays in lexical perception.

Published
2019

32. Orofacial somatosensory inputs improve speech sound detection in noisy environments

Author

Ogane, Rintaro, Schwartz, Jean-Luc, Ito, Takayuki, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Haskins Laboratories, European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Ogane, Rintaro, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
[SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, ComputingMilieux_MISCELLANEOUS
Abstract

International audience

Published
2018

33. What drives the perceptual change resulting from speech motor adaptation? Evaluation of hypotheses in a Bayesian modeling framework

Author

Patri, Jean-François, Perrier, Pascal, Schwartz, Jean-Luc, Diard, Julien, Laboratoire de Psychologie et NeuroCognition (LPNC ), Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry])-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), and European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014)

Subjects
Physiology, Sensory Physiology, Normal Distribution, Social Sciences, Phonology, Models, Biological, Speech Acoustics, Perturbation (Geology), [SCCO]Cognitive science, Hearing, Phonetics, Feedback, Sensory, Medicine and Health Sciences, Speech, Psychology, Humans, Computer Simulation, Vowels, lcsh:QH301-705.5, Auditory Pathway, Sedimentary Geology, Grammar, Models, Statistical, Biology and Life Sciences, Phonemes, Computational Biology, Linguistics, Geology, Bayes Theorem, Probability Theory, Probability Distribution, Sensory Systems, Auditory System, Somatosensory System, Acoustic Stimulation, lcsh:Biology (General), Motor Skills, Physical Sciences, Earth Sciences, Auditory Perception, Speech Perception, Sensory Perception, Mathematics, Research Article, Neuroscience
Abstract

Shifts in perceptual boundaries resulting from speech motor learning induced by perturbations of the auditory feedback were taken as evidence for the involvement of motor functions in auditory speech perception. Beyond this general statement, the precise mechanisms underlying this involvement are not yet fully understood. In this paper we propose a quantitative evaluation of some hypotheses concerning the motor and auditory updates that could result from motor learning, in the context of various assumptions about the roles of the auditory and somatosensory pathways in speech perception. This analysis was made possible thanks to the use of a Bayesian model that implements these hypotheses by expressing the relationships between speech production and speech perception in a joint probability distribution. The evaluation focuses on how the hypotheses can (1) predict the location of perceptual boundary shifts once the perturbation has been removed, (2) account for the magnitude of the compensation in presence of the perturbation, and (3) describe the correlation between these two behavioral characteristics. Experimental findings about changes in speech perception following adaptation to auditory feedback perturbations serve as reference. Simulations suggest that they are compatible with a framework in which motor adaptation updates both the auditory-motor internal model and the auditory characterization of the perturbed phoneme, and where perception involves both auditory and somatosensory pathways., Author summary Experimental evidence suggest that motor learning influences categories in speech perception. These observations are consistent with studies of arm motor control showing that motor learning alters the perception of the arm location in the space, and that these perceptual changes are associated with increased connectivity between regions of the motor cortex. Still, the interpretation of experimental findings is severely handicapped by a lack of precise hypotheses about underlying mechanisms. We reanalyze the results of the most advanced experimental studies of this kind in speech, in light of a systematic and computational evaluation of hypotheses concerning motor and auditory updates that could result from motor learning. To do so, we mathematically translate these hypotheses into a unified Bayesian model that integrates for the first time speech production and speech perception in a coherent architecture. We show that experimental findings are best accounted for when motor learning is assumed to generate updates of the auditory-motor internal model and the auditory characterization of phonemes, and when perception is assumed to involve both auditory and somatosensory pathways. This strongly reinforces the view that auditory and motor knowledge intervene in speech perception, and suggests likely mechanisms for motor learning in speech production.

Published
2018

36. Phoneme categorization depends on production abilities during the first year of life

Author

Dole, Marjorie, Loevenbruck, Hélène, Pascalis, O, Schwartz, Jean-Luc, Vilain, Anne, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Laboratoire de Psychologie et NeuroCognition (LPNC ), Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry])-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Schwartz, Jean-Luc, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
[SCCO]Cognitive science, phoneme categorisation, [INFO]Computer Science [cs], [SCCO] Cognitive science, [SHS] Humanities and Social Sciences, [INFO] Computer Science [cs], perceptuo-motor relationships, development, speech perception, [SHS]Humanities and Social Sciences
Abstract

International audience; An old-standing debate still not resolved in the field of speech communication concerns the nature of the representations underlying speech perception. On the one hand, auditory theories (e.g., Diehl et al., 2004) claim that the basic units in speech perception are purely auditory whereas the Motor Theory (Liberman et al., 1962; Galantucci et al., 2006) proposes that speech perception involves motor representations. Recently Schwartz et al. (2012), in a perceptuo-motor theory, claimed that perceptual and motor representations both play a role in the processing of speech units. To better understand the development of perceptuo-motor interactions during the first year of life, we examined the influence of speech production abilities on phonemic categorization in infants. We used an intersensory matching procedure in order to evaluate infants’ ability to bind auditory and visual information about a consonant category into a single representation. 6-to 12-month old French infants were familiarized with auditory syllables with different vowel contexts (e.g., /be/-/bi/-/bu). In the test phase, two side-by-side silent videos of faces repeatedly pronouncing consonants in a new vowel context (/ba/ on one side and /da/ on the other side) were presented and looking times (LTs) to each video were compared. In this protocol, infants who are able to extract the common (e.g., labial) gesture in the audio syllables, should be able to relate it to the same gesture in the visual stimuli and should show different LTs for the two test stimuli (/ba/ vs. /da/). Speech production abilities of each of the 6- to 12-month-old infants were assessed using a parental questionnaire. Infants were assigned to one of three production groups, Non Babbling, i.e. infants who did not produce the /b/-/d/ consonants, Canonical Babbling, i.e. infants who produced the consonants with only one vowel (e.g. ‘bababa’ or ‘dadada’), or Variegated Babbling, i.e. infants who produced the consonants with different vowels (e.g. ‘babibu’). We expected better categorization and better auditory-visual association in infants with greater production experience(i.e., infants in the Babbling phase), than in infants with fewer productions (Non Babbling infants). Results showed no main effect of age, however, 9-month old infants showed a significant categorization effect (one-sample t-test p

Published
2016

37. Somatosensory information affects word segmentation and perception of lexical information

Author

Ogane, Rintaro, Schwartz, Jean-Luc, Ito, Takayuki, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Haskins Laboratories, European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Ogane, Rintaro, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
[SCCO]Cognitive science, [SCCO] Cognitive science
Abstract

International audience; In the framework of perceptuo-motor theories of speech perception, it has been argued that speech articulation could play a role in speech perception. Indeed, recent finding demonstrates that somatosensory inputs associated with speaking motion changes the perception of speech sounds. However, it is still unknown whether somatosensory effects could go up to the level of lexical access in speech comprehension. Access to lexical information depends on a complex word segmentation process. This study aims to examine whether segmentation and lexical information processing could be changed by somatosensory inputs associated with facial skin deformation. We here focus on “elisions” between definite article and noun in French (e.g. “l’affiche” [the poster] or “la fiche” [the form]), which have the same pronunciation, but can be differentiated by hyper-articulation for the production of the first vowel in each word. If somatosensory information plays a role in lexical information processing, we reasoned that the perception of such sequences could be changed if somatosensory stimulation was applied in an appropriate timing associated to the corresponding speech gesture. To test this, we applied somatosensory perturbation associated with facial skin deformation at different timings along the presentation of the auditory stimulation. We tested native speakers of French who performed a two-alternative forced choice task between the two percepts associated to a single speech sequence. The stimulation sound was presented through headphones within the carrier phrase “C’est ___ (This is ___)”. Participants identified which word was presented (i.e. “affiche” vs. “fiche”) by pressing the left or right arrow button on the keyboard as quickly as possible. We used 17 different ambiguous speech sentences recorded by a native French speaker. Utterances were pronounced neutrally without adding hyper-articulation in any single vowel, that is, removing as much as possible acoustic information for decision. For each audio sentence, we applied a somatosensory stimulation consisting in facial skin stretch perturbation, generated by a robotic device. We varied the time of presentation of this facial skin stretch perturbation, with 8 different temporal positions within an acoustic sentence. These temporal positions were set relative to the timing of the first vowel peak amplitude (i.e. “a” in the previous example), separated by 100 ms intervals from -400 ms (around the vowel in “c’est”) to 300 ms (around the second vowel, i.e. “i” in the previous example). In each combination of audio and somatosensory stimulation, four subject’s responses were recorded, with a total of 544 stimuli (17 sentences * 8 timing conditions * 4 repetitions) presented in a random order. The judgement probability (i.e. percentage of “la fiche” responses) was calculated for each subject and each timing condition. It appears that the percentage of judgement probability was reduced when somatosensory stimulation was ahead of the first vowel (more “l’affiche” responses), and increased when somatosensory stimulation was delayed between the first and second vowel (more “la fiche” responses). This suggests that somatosensory information intervenes in the processing of lexical information, which corresponds to a relatively higher level of processing of speech perception.

Published
2017

38. Origins of Human Language: Continuities and Discontinuities with Nonhuman Primates

Author

Boë, Louis-Jean, Fagot, Joël, Perrier, Pascal, Schwartz, Jean-Luc, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Laboratoire de psychologie cognitive (LPC), Centre National de la Recherche Scientifique (CNRS)-Aix Marseille Université (AMU), ANR-16-CONV-0002,ILCB,ILCB: Institute of Language Communication and the Brain(2016), and Aix Marseille Université (AMU)-Centre National de la Recherche Scientifique (CNRS)

Subjects
0303 health sciences, [SCCO.NEUR]Cognitive science/Neuroscience, [SDV]Life Sciences [q-bio], Inferior frontal gyrus, respiratory system, [SHS]Humanities and Social Sciences, 03 medical and health sciences, [SCCO]Cognitive science, 0302 clinical medicine, [SCCO.PSYC]Cognitive science/Psychology, Language evolution, otorhinolaryngologic diseases, [INFO]Computer Science [cs], Broca's area, Psychology, Neuroscience, 030217 neurology & neurosurgery, ComputingMilieux_MISCELLANEOUS, 030304 developmental biology
Abstract

International audience; This book proposes a detailed picture of the continuities and ruptures between communication in primates and language in humans. It explores a diversity of perspectives on the origins of language, including a fine description of vocal communication in animals, mainly in monkeys and apes, but also in birds, the study of vocal tract anatomy and cortical control of the vocal productions in monkeys and apes, the description of combinatory structures and their social and communicative value, and the exploration of the cognitive environment in which language may have emerged from nonhuman primate vocal or gestural communication.

Published
2017

39. Perceptual learning of speech produced by a speaker with Down Syndrome

Author

Hennequin, Alexandre, Rochet-Capellan, Amélie, Schwartz, Jean-Luc, Dohen, Marion, HENNEQUIN, Alexandre, The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Grenoble Images Parole Signal Automatique (GIPSA-lab ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Institut Polytechnique de Grenoble - Grenoble Institute of Technology-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), and European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014)

Subjects
[SCCO]Cognitive science, [SCCO] Cognitive science, ComputingMilieux_MISCELLANEOUS
Abstract

International audience

Published
2017

41. Data and simulations about audiovisual asynchrony and predictability in speech perception

Author

Schwartz, Jean-Luc, Savariaux, Christophe, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), GIPSA-Services (GIPSA-Services), and Schwartz, Jean-Luc

Subjects
[SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology
Abstract

International audience; Since a paper by Chandrasekaran et al. (2009), an increasing number of neuroscience papers capitalize on the assumption that visual speech would be typically 150 ms ahead of auditory speech. It happens that the estimation of audiovisual asynchrony by Chandrasekaran et al. is valid only in very specific cases, for isolated CV syllables or at the beginning of a speech utterance. We present simple audiovisual data on plosive-vowel syllables (pa, ta, ka, ba, da, ga, ma, na) showing that audiovisual synchrony is actually rather precise when syllables are chained in sequences, as they are typically in most parts of a natural speech utterance. Then we discuss on the way the natural coordination between sound and image (combining cases of lead and lag of the visual input) is reflected in the so-called temporal integration window for audiovisual speech perception (van Wassenhove et al., 2007). We conclude by a computational proposal about predictive coding in such sequences, showing that the visual input may actually provide and enhance predictions even if it is quite synchronous with the auditory input.

Published
2013

42. COSMO ('Communicating about Objects using Sensory–Motor Operations'): A Bayesian modeling framework for studying speech communication and the emergence of phonological systems

Author

Moulin-Frier, Clément, Diard, Julien, Schwartz, Jean-Luc, Bessière, Pierre, Flowing Epigenetic Robots and Systems (Flowers), Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Laboratoire de Psychologie et NeuroCognition (LPNC), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry])-Centre National de la Recherche Scientifique (CNRS), GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), Institut des Systèmes Intelligents et de Robotique (ISIR), Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS), AMAC, Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS), FP7/2007-2013 Grant Agreement no. 339152 - 'Speech Unit(e)s', European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Unité d'Informatique et d'Ingénierie des Systèmes (U2IS), École Nationale Supérieure de Techniques Avancées (ENSTA Paris)-École Nationale Supérieure de Techniques Avancées (ENSTA Paris), Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry]), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), and Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)

Subjects
Self-organization, Speech and Hearing, Linguistics and Language, [SCCO]Cognitive science, [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG], Bayesian programming, [INFO.INFO-MA]Computer Science [cs]/Multiagent Systems [cs.MA], Cognitive modelling, [SCCO.COMP]Cognitive science/Computer science, Phonology, Language evolution, Language and Linguistics, Speech sound systems
Abstract

International audience; While the origin of language remains a somewhat mysterious process, understanding how human language takes specific forms appears to be accessible by the experimental method. Languages, despite their wide variety, display obvious regularities. In this paper, we attempt to derive some properties of phonological systems (the sound systems for human languages) from speech communication principles. We introduce a model of the cognitive architecture of a communicating agent, called COSMO (for “Communicating about Objects using Sensory–Motor Operations') that allows a probabilistic expression of the main theoretical trends found in the speech production and perception literature. This enables a computational comparison of these theoretical trends, which helps us to identify the conditions that favor the emergence of linguistic codes. We present realistic simulations of phonological system emergence showing that COSMO is able to predict the main regularities in vowel, stop consonant and syllable systems in human languages.

Published
2015

43. From Sensorimotor Experience To Speech Unit -Adaptation to altered auditory feedback in speech to assess transfer of learning in complex serial movements

Author

Caudrelier, Tiphaine, Schwartz, Jean-Luc, Perrier, Pascal, Savariaux, Christophe, Rochet-Capellan, Amélie, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), GIPSA-Services (GIPSA-Services), GIPSA - Cognitive Robotics, Interactive Systems, & Speech Processing (GIPSA-CRISSP), European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Caudrelier, Tiphaine, The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID, Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), and Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)

Subjects
Sensorimotor learning, Auditory perturbations, [SCCO.NEUR]Cognitive science/Neuroscience, [SCCO.NEUR] Cognitive science/Neuroscience, Speech unit, Generalization, Speech
Abstract

International audience; Using bird song as a model to understand generalization in motor learning, Hoffman and Sober recently found that adaptation to pitch-shift of birds’ vocal output transfered to the production of the same sounds embedded in a different serial context (J. Neurosc 2014). In humans, speech learning has been found to transfer as a function of the acoustical similarity between the training and the testing utterances (Cai et al. 2010, Rochet-Capellan et al. 2011) but it is unclear if transfer of learning is sensitive to serial order. We investigate the effects of serial order on transfer of speech motor learning using non-words sequences of CV syllables. Three groups of native speakers of French were trained to produce the syllable /be/ repetitively while their auditory feedback was altered in real time toward /ba/. They were then tested for transfer toward /be/ (control), /bepe/ or /pebe/ under normal feedback conditions. The training utterance was then produced again to test for after-effects. The auditory shift was achieved in real time using Audapter software (Cai et al. 2008). Adaptation and transfer effects were quantified in terms of changes in formants frequencies of the vowel /e/, as a function of its position and the preceding consonant in the utterance. Changes in formant frequencies in a direction opposite to the shift were significant for ~80% of the participants. Adaptation was still significant for the three groups in the after-effect block. Transfer effects in the /bepe/ and /pebe/ groups were globally smaller than that of the control group, particularly when the vowel /e/ came after /p/ and/or was in second position in the utterance. Taken together, the results suggest that transfer of speech motor learning is not homogenous and as observed by Hoffman and Sober, depends on the serial context of a sound within the utterance.Cai S, Boucek M, Ghosh SS, Guenther FH, Perkell JS. (2008). A system foronline dynamic perturbation of formant frequencies and results from perturbation of the Mandarin triphthong /iau/. In Proceedings of the 8th Intl. Seminar on Speech Production, Strasbourg, France, Dec. 8-12, 2008. pp. 65Cai, S., Ghosh, S. S., Guenther, F. H., & Perkell, J. S. (2010). Adaptive auditory feedback control of the production of formant trajectories in the Mandarin triphthong/iau/and its pattern of generalization. The Journal of the Acoustical Society of America, 128(4), 2033-2048.Hoffmann, L. A., & Sober, S. J. (2014). Vocal generalization depends on gesture identity and sequence. The Journal of Neuroscience, 34(16), 5564-5574.Rochet-Capellan, A., Richer, L., & Ostry, D. J. (2012). Nonhomogeneous transfer reveals specificity in speech motor learning. Journal of neurophysiology, 107(6), 1711-1717.

Published
2015

44. Visual lip information supports auditory word segmentation

Author

Strauss, Antje, Savariaux, Christophe, Kandel, Sonia, Schwartz, Jean-Luc, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), GIPSA-Services (GIPSA-Services), GIPSA - Cognitive Robotics, Interactive Systems, & Speech Processing (GIPSA-CRISSP), GIPSA - Voix Systèmes Linguistiques et Dialectologie (GIPSA-VSLD), European Project: 339152,EC:FP7:ERC,ERC-2013-ADG,SPEECH UNIT(E)S(2014), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), Strauss, Antje, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
[SHS.PSY] Humanities and Social Sciences/Psychology, audiovisual integration, [SHS.PSY]Humanities and Social Sciences/Psychology, speech segmentation, [SHS.LANGUE]Humanities and Social Sciences/Linguistics, [SHS.LANGUE] Humanities and Social Sciences/Linguistics
Abstract

International audience; Word segmentation is one of the initial processes that needs to be solved when acquiring the first or learning a second language. Acoustic cues like the fundamental frequency and segment durations have been shown to facilitate the detection of word boundaries. The role of visual speech and in particular of lip movements in word segmentation is still rather unknown. In French, liaisons, e.g. between determiner and noun, often pose a problem of several segmentation possibilities (e.g., the sequence /lafiS/ with liaison ("l’affiche") means the poster whereas without liaison ("la fiche") it means the file.). Here, we use 17 ambiguous French sequences with and without liaison. They were presented in carrier sentences either with clear acoustic cues for the first or the second segmentation possibility or with ambiguous acoustic cues. The three audio conditions were combined with lip movements hyper-articulating either the first or the second segmentation possibility in order to observe the influence of visual information on segmentation. Theparticipants had to indicate as quickly as possible which of the two versions they understood (e.g., "l’affiche" or "la fiche"?). Results show that lip information indeed biases the word segmentation decision. These data provide important implications for audiovisual integration processes.

Published
2015

45. Modulating fusion in the McGurk effect by binding processes and contextual noise

Author

Nahorna, Olha, Attigodu, Ganesh, Berthommier, Frédéric, Schwartz, Jean-Luc, Schwartz, Jean-Luc, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), and Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)

Subjects
[SCCO.PSYC]Cognitive science/Psychology, [SCCO.PSYC] Cognitive science/Psychology
Abstract

International audience; In a series of experiments we showed that the McGurk effect may be modulated by context: applying incoherent auditory and visual material before an audiovisual target made of an audio "ba" and a video "ga" significantly decreases the McGurk effect. We interpreted this as showing the existence of an audiovisual "binding" stage controlling the fusion process. Incoherence would produce "unbinding" and result in decreasing the weight of the visual input in the fusion process. In this study, we further explore this binding stage around two experiments. Firstly we test the "rebinding" process, by presenting a short period of either coherent material or silence after the incoherent "unbinding" context. We show that coherence provides "rebinding", resulting in a recovery of the McGurk effect. In contrary, silence provides no rebinding and hence "freezes" the unbinding process, resulting in no recovery of the McGurk effect. Capitalizing on this result, in a second experiment including an incoherent unbinding context followed by a coherent rebinding context before the target, we add noise all over the contextual period, though not in the McGurk target. It appears that noise uniformly increases the rate of McGurk responses compared to the silent condition. This suggests that contextual noise increases the weight of the visual input in fusion, even if there is no noise within the target stimulus where fusion is applied. We conclude on the role of audiovisual coherence and noise in the binding process, in the framework of audiovisual speech scene analysis and the cocktail party effect.

Published
2013

46. Modeling the concurrent development of speech perception and production in a Bayesian framework

Author

Barnaud, Marie-Lou, Diard, Julien, Bessière, Pierre, Schwartz, Jean-Luc, Barnaud, Marie-Lou, and The multisensory-motor unity of speech - SPEECH UNIT(E)S - - EC:FP7:ERC2014-09-01 - 2019-08-31 - 339152 - VALID

Subjects
Statistical Learning, and Communication Skills in Biological Systems and Robots, Social, Cognitive, Motor, General Principles of Development and Learning, [SCCO.COMP] Cognitive science/Computer science, Development of Perceptual, Emotional, [SCCO] Cognitive science
Abstract

It is now widely accepted that there is a functional relationship between the speech perception and production systems in the human brain. However, the precise mechanisms and role of this relationship still remain debated. The question of invariance and robustness in categorization are set at the center of the debate: how is stable information extracted from the variable sensory input in order to achieve speech comprehension? In this context, auditory (resp. motor, perceptuo-motor) theories propose that speech is categorized thanks to auditory (resp. motor, perceptuo-motor) processes. However, experimental evidence is still scarce and does not allow to clearly distinguish between the current theories and determine whether invariance in speech perception is of an auditory or motor type. This is why we developed COSMO, a Bayesian model comparing sensory and motor processes in the form of probability distributions which enable both theoretical developments and quantitative simulations. A first significant result in COSMO is an indistinguishability theorem: it is only by simulations of adverse conditions or partial learning that the specificity of sensory vs. motor processing can emerge and provide a basis for evaluation of the specific role of each sub-system. We present the COSMO model, and how its sensory and motor sub-systems are learned, then we describe simulations exploring the way these sub-systems differ during speech categorization. We discuss the experimental results in the light of a “narrowband vs. wideband” interpretation: the sensory sub-system is more precisely tuned to the frequently learned sensory input and hence more efficient in recognizing these inputs, providing a “narrowband” system. Conversely, the motor sub-system is less accurate to recognize learned sensory inputs but it has better generalization properties, making it more robust to unexpected variability which would provide it with “wideband” characteristics.

Published
2015

47. Les tendances des structures phonologiques : le poids de la forme sur la substance typologie, modélisation et ontogenèse

Author

Boë, Louis-Jean, Schwartz, Jean-Luc, and Vallée, Nathalie

Subjects
General Earth and Planetary Sciences
Abstract

Are the main tendencies of phonological systems of the world languages constrained by production and perception ? This question is discussed within the framework of the “substance-based” linguistic approach suggested by Liljencrants and Lindblom in 1972. The main tendencies of sound structures of the world languages seem to us a good framework to test the influences of production and perception constraints on phonological systems. We present several universal tendencies of vowel systems which could be explained by materiality of sound structures and predicted by the Dispersion Focalization Theory developed at ICP. Then we discuss consonant systems in light of ontogenetic data. Finally the link between phonetic sciences and phonology is discussed., En nous plaçant dans le cadre d’une linguistique orientée substance, nous tentons de montrer que les grandes tendances des structures sonores des langues du monde peuvent s ’expliquer, en partie, par des contraintes sensorimotrices. Nous replaçons cette hypothèse dans le cadre historique de l’émergence de la phonologie, à la fin des années 1920. Nous illustrons - dans la voie ouverte par Liljencrants et Lindblom en 1972 - la possibilité d’une substantialisation de la phonologie grâce aux avancées de la phonétique dans les domaines de la typologie des langues, de la prédiction des structures sonores et de l 'interprétation des données de l’ontogenèse de la parole. Autant d’éléments pour une nouvelle négociation forme/substance, rendue de plus en plus nécessaire par la remise en cause de l'arbitraire linguistique des distinctivités phonologiques., Boë Louis-Jean,Schwartz Jean-Luc,Vallée Nathalie. Les tendances des structures phonologiques : le poids de la forme sur la substance typologie, modélisation et ontogenèse. In: Scolia, N°16, 2003. Rencontres linguistiques en Pays Rhénan – 12. pp. 21-62.

Published
2003

48. Sensory-motor interactions in speech perception, production and imitation: behavioral evidence from close shadowing, perceptuo-motor phonemic organization and imitative changes

Author

Scarbel, Lucie, Beautemps, Denis, Schwartz, Jean-Luc, Sato, Marc, GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), GIPSA - Machines parlantes, Gestes oro-faciaux, Interaction Face-à-face, Communication augmentée (GIPSA-MAGIC), ANR-11-BSH2-0008,PlasMody,Plasticité et Multimodalité pour la Communication Orale chez le Sourd(2011), Beautemps, Denis, and BLANC - Plasticité et Multimodalité pour la Communication Orale chez le Sourd - - PlasMody2011 - ANR-11-BSH2-0008 - BLANC - VALID

Subjects
[SHS.INFO]Humanities and Social Sciences/Library and information sciences, [SHS.INFO] Humanities and Social Sciences/Library and information sciences
Abstract

International audience; Speech communication can be viewed as an interactive process involving a functional coupling between sensory and motor systems. In the present study, we combined three classical experimental paradigms to further test perceptuomotor interactions in both speech perception and production. In a first close shadowing experiment, auditory and audiovisual syllable identification led to faster oral than manual responses. In a second experiment, participants were asked to produce and to listen to French vowels, varying from height feature, in order to test perceptuo-motor phonemic organization and idiosyncrasies. In a third experiment, online imitative changes on the fundamental frequency in relation to acoustic vowel targets were observed in a non-interactive situation of communication during both unintentional and voluntary imitative production tasks. Altogether our results appear exquisitely in line with a functional coupling between action and perception speech systems and provide further evidence for a sensory-motor nature of speech representations.

Published
2014

49. Linking the Dispersion-Focalization Theory (DFT) and the Maximum Utilization of the Available Distinctive Features (MUAF) principle in a Perception-for-Action-Control Theory (PACT)

Author

Schwartz, Jean-Luc, Boë, Louis-Jean, Abry, Christian, GIPSA - Parole, Multimodalité, Développement (GIPSA-PMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), Centre de Recherche sur l'Imaginaire (CRI), Université Stendhal - Grenoble 3, M.J. Solé, P.S. Beddor, M. Ohala, Schwartz, Jean-Luc, and M.J. Solé, P.S. Beddor, M. Ohala

Subjects
[SCCO.LING] Cognitive science/Linguistics, [SCCO.LING]Cognitive science/Linguistics, [SHS.LANGUE]Humanities and Social Sciences/Linguistics, [SHS.LANGUE] Humanities and Social Sciences/Linguistics
Abstract

International audience; The ''substance-based'' approach to phonology was born some 35 years ago with two seminal contributions, one by Liljencrants and Lindblom (1972)--the first of Lindblom's many variations on dispersion and perceptual contrast (Dispersion Theories: Lindblom 1986, 1990b)--the other, Stevens's Quantal Theory (1972, 1989). These contributions constituted the starting point for a rich tradition of descriptive and theoretical phonetics, in which the aim is not to ref ute the existence of a formal phonological level with its intrinsic formal principles and rules, but, instead, to determine and, possibly, model how the emergence of such formal systems could be shaped by the perceptuo-motor substance of speech communication. The link between substance and form, however, is still not completely clear. In 1979, John Ohala questioned the role of maximization of perceptual dispersion, suggesting that with this principle ''we should undoubtedly reach the patently false prediction that a seven-consonant system should include something like the following set

Published
2007

50. Filling the perceptuo-motor gap

Author

Schwartz, Jean-Luc, Institut de la communication parlée (ICP), Institut National Polytechnique de Grenoble (INPG)-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3, Cécile Fougeron, Barbara Kühnert, Mariapaola D'Imperio, and Nathalie Vallée (eds.), GIPSA - Perception, Contrôle, Multimodalité et Dynamiques de la parole (GIPSA-PCMD), Département Parole et Cognition (GIPSA-DPC), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Stendhal - Grenoble 3-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), Fougeron, Cécile / Kuehnert, Barbara / Imperio, Mariapaola / Vallee, Nathalie, Schwartz, Jean-Luc, Cécile Fougeron, Barbara Kühnert, Mariapaola D'Imperio, and Nathalie Vallée (eds.), and Fougeron, Cécile / Kuehnert, Barbara / Imperio, Mariapaola / Vallee, Nathalie

Subjects
[SCCO.COMP] Cognitive science/Computer science, [SCCO.PSYC] Cognitive science/Psychology, [SCCO.PSYC]Cognitive science/Psychology, [SCCO.COMP]Cognitive science/Computer science, [SCCO.LING] Cognitive science/Linguistics, [SCCO.LING]Cognitive science/Linguistics, [SHS.LANGUE]Humanities and Social Sciences/Linguistics, [SHS.LANGUE] Humanities and Social Sciences/Linguistics
Abstract

International audience; The session under focus deals with phonetic articulatory-acoustic variation and with the link between phonetic detail and phonological modelling. The underlying question was to estimate the impact of phonetic detail on the phonological status of a given unit, and to attempt to better understand how details are produced by the speaker or exploited by the listener to access (encode or decode) the phonological level. But what is over and over at work in the four papers of this session is the possibility that there could exist a gap between the speaker's intention and the listener's perception, and that the phonetic variation is in some sense contained, produced or at least made possible by this gap. The present discussion will be focused on the perceptuo-motor gap. In an initial section, I will briefly recall how speech communication theories deal with the perceptuo-motor link. Then, I will discuss each of the four papers of the session, around a single question - What does a listener know about a speaker's gesture? - that is, what does the corresponding study tell us about the perceptuo-motor gap. Finally, I shall conclude around the theory that we have developed at ICP, called PACT (for "Perception-for-Action-Control Theory") in an attempt to show how it could indeed contribute to "fill the perceptuo-motor gap".

Published
2006

Catalog

Books, media, physical & digital resources
See catalog results