Back to Search Start Over

MRI Vocal Tract Sagittal Slices Estimation during Speech Production of CV

Authors :
Chrysanthi Dourou
Jacques Felblinger
Ajinkya Kulkarni
Pierre-André Vuissoz
Yu Xie
Yves Laprie
Karyna Isaieva
Ioannis Douros
Laprie, Yves
Speech Modeling for Facilitating Oral-Based Communication (MULTISPEECH)
Inria Nancy - Grand Est
Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Department of Natural Language Processing & Knowledge Discovery (LORIA - NLPKD)
Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA)
Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA)
Institut National de Recherche en Informatique et en Automatique (Inria)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Centre National de la Recherche Scientifique (CNRS)
Department of Neurology
Wuhan University [China]
School of of Electrical and Computer Engineering [Athens] (School of E.C.E)
National Technical University of Athens [Athens] (NTUA)
Centre d'investigation clinique [Nancy] (CIC)
Centre Hospitalier Régional Universitaire de Nancy (CHRU Nancy)-Institut National de la Santé et de la Recherche Médicale (INSERM)-Université de Lorraine (UL)
Imagerie Adaptative Diagnostique et Interventionnelle (IADI)
Institut National de la Santé et de la Recherche Médicale (INSERM)-Université de Lorraine (UL)
Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Lorrain de Recherche en Informatique et ses Applications (LORIA)
Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université de Lorraine (UL)
Source :
EUSIPCO 2020-28th European Signal Processing Conference, EUSIPCO 2020-28th European Signal Processing Conference, Jan 2021, Amsterdam / Virtual, Netherlands. ⟨10.23919/Eusipco47968.2020.9287834⟩, EUSIPCO 2020-28th European Signal Processing Conference, Jan 2021, Amsterdam / Virtual, Netherlands, EUSIPCO, HAL
Publication Year :
2021
Publisher :
HAL CCSD, 2021.

Abstract

International audience; In this paper we propose an algorithm for estimating vocal tract para sagittal slices in order to have a better overview of the behaviour of the articulators during speech production. The first step is to align the consonant-vowel (CV) data of the sagittal plains between them for the train speaker. Sets of transformations that connect the midsagittal frames with the neighbouring ones is acquired for the train speaker. Another set of transformations is calculated which transforms the midsagittal frames of the train speaker to the corresponding midsagittal frames of the test speaker and is used to adapt to the test speaker domain the previously computed sets of transformations. The newly adapted transformations are applied to the midsagittal frames of the test speaker in order to estimate the neighbouring sagittal frames. Several mono speaker models are combined to produce the final frame estimation. To evaluate the results, image cross-correlation between the original and the estimated frames was used. Results show good agreement between the original and the estimated frames.

Details

Language :
English
Database :
OpenAIRE
Journal :
EUSIPCO 2020-28th European Signal Processing Conference, EUSIPCO 2020-28th European Signal Processing Conference, Jan 2021, Amsterdam / Virtual, Netherlands. ⟨10.23919/Eusipco47968.2020.9287834⟩, EUSIPCO 2020-28th European Signal Processing Conference, Jan 2021, Amsterdam / Virtual, Netherlands, EUSIPCO, HAL
Accession number :
edsair.doi.dedup.....c840b8fadc070980388a8fff08938cb0
Full Text :
https://doi.org/10.23919/Eusipco47968.2020.9287834