1. 'Prediction of Sleepiness Ratings from Voice by Man and Machine': A Perceptual Experiment Replication Study
- Author
-
P. Martin, Vincent, Ferron, Aymeric, Rouas, Jean-Luc, Philip, Pierre, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS), Sommeil, Addiction et Neuropsychiatrie [Bordeaux] (SANPSY), Université de Bordeaux (UB)-CHU de Bordeaux Pellegrin [Bordeaux]-Centre National de la Recherche Scientifique (CNRS), Université de Bordeaux (UB), Popular interaction with 3d content (Potioc), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), CHU Bordeaux [Bordeaux], and ANR-10-LABX-0043,BRAIN,Bordeaux Region Aquitaine Initiative for Neuroscience(2010)
- Subjects
Experimental study replication ,Paralinguistic ,Sleepiness ,[INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD] ,Voice ,Perceptual study ,[SCCO.LING]Cognitive science/Linguistics - Abstract
International audience; Following the release of the SLEEP corpus during the Interspeech 2019 paralinguistic continuous sleepiness estimation challenge, a paper presented at Interspeech 2020 by Huckvale et al. examined the reasons for the poor performance of the models proposed for this task. Careful analyses of the corpus led to the conclusion that its bias makes it hazardous to use for training machine learning systems, but a perceptual experiment on a subset of this corpus seemed to indicate that human hearing is however able to estimate sleepiness on this corpus.In this study, we present the results of the Endymion replication study, in which the same samples were rated by thirty French-speaking naive listeners. We then discuss the causes of the differences between the two studies and examine the effect of listener and sample characteristics on annotation performances
- Published
- 2023