Search

Your search keyword '"Gibet, Sylvie"' showing total 311 results
Start Over Author "Gibet, Sylvie"

Refine your results

more »

more »

more »

more »
311 results on '"Gibet, Sylvie"'

2. A New Spatio-Temporal Loss Function for 3D Motion Reconstruction and Extended Temporal Metrics for Motion Evaluation

Author

Tchenegnon, Mansour, Gibet, Sylvie, and Naour, Thibaut Le

Subjects
Computer Science - Computer Vision and Pattern Recognition
Abstract

We propose a new loss function that we call Laplacian loss, based on spatio-temporal Laplacian representation of the motion as a graph. This loss function is intended to be used in training models for motion reconstruction through 3D human pose estimation from videos. It compares the differential coordinates of the joints obtained from the graph representation of the ground truth against the one of the estimation. We design a fully convolutional temporal network for motion reconstruction to achieve better temporal consistency of estimation. We use this generic model to study the impact of our proposed loss function on the benchmarks provided by Human3.6M. We also make use of various motion descriptors such as velocity, acceleration to make a thorough evaluation of the temporal consistency while comparing the results to some of the state-of-the-art solutions.

Published
2022

5. Adaptive Down-Sampling and Dimension Reduction in Time Elastic Kernel Machines for Efficient Recognition of Isolated Gestures

Author

Marteau, Pierre-François, Gibet, Sylvie, and Reverdy, Clément

Subjects
Computer Science - Computer Vision and Pattern Recognition, Computer Science - Learning
Abstract

In the scope of gestural action recognition, the size of the feature vector representing movements is in general quite large especially when full body movements are considered. Furthermore, this feature vector evolves during the movement performance so that a complete movement is fully represented by a matrix M of size DxT , whose element M i, j represents the value of feature i at timestamps j. Many studies have addressed dimensionality reduction considering only the size of the feature vector lying in R D to reduce both the variability of gestural sequences expressed in the reduced space, and the computational complexity of their processing. In return, very few of these methods have explicitly addressed the dimensionality reduction along the time axis. Yet this is a major issue when considering the use of elastic distances which are characterized by a quadratic complexity along the time axis. We present in this paper an evaluation of straightforward approaches aiming at reducing the dimensionality of the matrix M for each movement, leading to consider both the dimensionality reduction of the feature vector as well as its reduction along the time axis. The dimensionality reduction of the feature vector is achieved by selecting remarkable joints in the skeleton performing the movement, basically the extremities of the articulatory chains composing the skeleton. The temporal dimen-sionality reduction is achieved using either a regular or adaptive down-sampling that seeks to minimize the reconstruction error of the movements. Elastic and Euclidean kernels are then compared through support vector machine learning. Two data sets 1 that are widely referenced in the domain of human gesture recognition, and quite distinctive in terms of quality of motion capture, are used for the experimental assessment of the proposed approaches. On these data sets we experimentally show that it is feasible, and possibly desirable, to significantly reduce simultaneously the size of the feature vector and the number of skeleton frames to represent body movements while maintaining a very good recognition rate. The method proves to give satisfactory results at a level currently reached by state-of-the-art methods on these data sets. We experimentally show that the computational complexity reduction that is obtained makes this approach eligible for real-time applications.

Published
2016
Full Text
View/download PDF

7. Down-Sampling coupled to Elastic Kernel Machines for Efficient Recognition of Isolated Gestures

Author

Marteau, Pierre-François, Gibet, Sylvie, and Reverdy, Clement

Subjects
Computer Science - Learning, Computer Science - Human-Computer Interaction
Abstract

In the field of gestural action recognition, many studies have focused on dimensionality reduction along the spatial axis, to reduce both the variability of gestural sequences expressed in the reduced space, and the computational complexity of their processing. It is noticeable that very few of these methods have explicitly addressed the dimensionality reduction along the time axis. This is however a major issue with regard to the use of elastic distances characterized by a quadratic complexity. To partially fill this apparent gap, we present in this paper an approach based on temporal down-sampling associated to elastic kernel machine learning. We experimentally show, on two data sets that are widely referenced in the domain of human gesture recognition, and very different in terms of quality of motion capture, that it is possible to significantly reduce the number of skeleton frames while maintaining a good recognition rate. The method proves to give satisfactory results at a level currently reached by state-of-the-art methods on these data sets. The computational complexity reduction makes this approach eligible for real-time applications., Comment: ICPR 2014, International Conference on Pattern Recognition, Stockholm : Sweden (2014)

Published
2014

9. Toward a Motor Theory of Sign Language Perception

Author

Gibet, Sylvie, Marteau, Pierre-François, and Duarte, Kyle

Subjects
Computer Science - Computation and Language, Computer Science - Human-Computer Interaction
Abstract

Researches on signed languages still strongly dissociate lin- guistic issues related on phonological and phonetic aspects, and gesture studies for recognition and synthesis purposes. This paper focuses on the imbrication of motion and meaning for the analysis, synthesis and evaluation of sign language gestures. We discuss the relevance and interest of a motor theory of perception in sign language communication. According to this theory, we consider that linguistic knowledge is mapped on sensory-motor processes, and propose a methodology based on the principle of a synthesis-by-analysis approach, guided by an evaluation process that aims to validate some hypothesis and concepts of this theory. Examples from existing studies illustrate the di erent concepts and provide avenues for future work., Comment: 12 pages Partiellement financ\'e par le projet ANR SignCom

Published
2012
Full Text
View/download PDF

10. On Recursive Edit Distance Kernels with Application to Time Series Classification

Author

Marteau, Pierre-François and Gibet, Sylvie

Subjects
Computer Science - Learning, Computer Science - Information Retrieval
Abstract

This paper proposes some extensions to the work on kernels dedicated to string or time series global alignment based on the aggregation of scores obtained by local alignments. The extensions we propose allow to construct, from classical recursive definition of elastic distances, recursive edit distance (or time-warp) kernels that are positive definite if some sufficient conditions are satisfied. The sufficient conditions we end-up with are original and weaker than those proposed in earlier works, although a recursive regularizing term is required to get the proof of the positive definiteness as a direct consequence of the Haussler's convolution theorem. The classification experiment we conducted on three classical time warp distances (two of which being metrics), using Support Vector Machine classifier, leads to conclude that, when the pairwise distance matrix obtained from the training data is \textit{far} from definiteness, the positive definite recursive elastic kernels outperform in general the distance substituting kernels for the classical elastic distances we have tested., Comment: 14 pages

Published
2010
Full Text
View/download PDF

13. Coarticulation Analysis for Sign Language Synthesis

Author

Naert, Lucie, Larboulette, Caroline, Gibet, Sylvie, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Antona, Margherita, editor, and Stephanidis, Constantine, editor

Published
2017
Full Text
View/download PDF

16. The Ergonomic Analysis of the Workplace of Physically Disabled Individuals

Author

Aubry, Matthieu, Julliard, Frédéric, Gibet, Sylvie, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Goebel, Randy, editor, Siekmann, Jörg, editor, Wahlster, Wolfgang, editor, Sales Dias, Miguel, editor, Gibet, Sylvie, editor, Wanderley, Marcelo M., editor, and Bastos, Rafael, editor

Published
2009
Full Text
View/download PDF

17. A Qualitative and Quantitative Characterisation of Style in Sign Language Gestures

Author

Heloir, Alexis, Gibet, Sylvie, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Goebel, Randy, editor, Siekmann, Jörg, editor, Wahlster, Wolfgang, editor, Sales Dias, Miguel, editor, Gibet, Sylvie, editor, Wanderley, Marcelo M., editor, and Bastos, Rafael, editor

Published
2009
Full Text
View/download PDF

18. Approximation of Curvature and Velocity for Gesture Segmentation and Synthesis

Author

Gibet, Sylvie, Marteau, Pierre-François, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Goebel, Randy, editor, Siekmann, Jörg, editor, Wahlster, Wolfgang, editor, Sales Dias, Miguel, editor, Gibet, Sylvie, editor, Wanderley, Marcelo M., editor, and Bastos, Rafael, editor

Published
2009
Full Text
View/download PDF

19. Corpus Creation and Perceptual Evaluation of Expressive Theatrical Gestures

Author

Carreno-Medrano, Pamela, Gibet, Sylvie, Larboulette, Caroline, Marteau, Pierre-François, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Kobsa, Alfred, Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Weikum, Gerhard, Series editor, Goebel, Randy, Series editor, Tanaka, Yuzuru, Series editor, Wahlster, Wolfgang, Series editor, Siekmann, Jörg, Series editor, Bickmore, Timothy, editor, Marsella, Stacy, editor, and Sidner, Candace, editor

Published
2014
Full Text
View/download PDF

20. Adaptive Sampling of Motion Trajectories for Discrete Task-Based Analysis and Synthesis of Gesture

Author

Marteau, Pierre-François, Gibet, Sylvie, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Dough, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Carbonell, Jaime G., editor, Siekmann, Jörg, editor, Gibet, Sylvie, editor, Courty, Nicolas, editor, and Kamp, Jean-François, editor

Published
2006
Full Text
View/download PDF

21. Captured Motion Data Processing for Real Time Synthesis of Sign Language

Author

Heloir, Alexis, Gibet, Sylvie, Multon, Franck, Courty, Nicolas, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Dough, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Carbonell, Jaime G., editor, Siekmann, Jörg, editor, Gibet, Sylvie, editor, Courty, Nicolas, editor, and Kamp, Jean-François, editor

Published
2006
Full Text
View/download PDF

23. Actes des XXXIVe Journées d'Études sur la Parole -- JEP 2022

Author

Crouzet, Olivier, Delais-Roussarie, Elisabeth, Duniec, Agnieszka, Leprieur, Loriane, Rohrer, Patrick Louis, Tahon, Marie, Wottawa, Jane, Brabant, Mano, Riguidel, Hugo, Barbot, Nelly, Gibet, Sylvie, Lolive, Damien, Sini, Aghilas, Laboratoire de Linguistique de Nantes (LLING), Centre National de la Recherche Scientifique (CNRS)-Nantes Université - UFR Lettres et Langages (Nantes Univ - UFR LL), Nantes Université - pôle Humanités, Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ)-Nantes Université - pôle Humanités, Nantes Université (Nantes Univ)-Nantes Université (Nantes Univ), Universitat Pompeu Fabra [Barcelona] (UPF), Laboratoire d'Informatique de l'Université du Mans (LIUM), Le Mans Université (UM), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), École Nationale Supérieure des Sciences Appliquées et de Technologie (ENSSAT), and Learn&Go

Subjects
[SCCO]Cognitive science, [SPI]Engineering Sciences [physics], [SDV]Life Sciences [q-bio], [SHS]Humanities and Social Sciences
Published
2022

24. Fast Motion Retrieval with the Distance Input Space

Author

Le Naour, Thibaut, Courty, Nicolas, Gibet, Sylvie, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Kallmann, Marcelo, editor, and Bekris, Kostas, editor

Published
2012
Full Text
View/download PDF

26. Why Is the Creation of a Virtual Signer Challenging Computer Animation?

Author

Courty, Nicolas, Gibet, Sylvie, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Boulic, Ronan, editor, Chrysanthou, Yiorgos, editor, and Komura, Taku, editor

Published
2010
Full Text
View/download PDF

27. Modeling Joint Synergies to Synthesize Realistic Movements

Author

Aubry, Matthieu, Julliard, Frédéric, Gibet, Sylvie, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Goebel, Randy, editor, Siekmann, Jörg, editor, Wahlster, Wolfgang, editor, Kopp, Stefan, editor, and Wachsmuth, Ipke, editor

Published
2010
Full Text
View/download PDF

28. A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis

Author

Awad, Charly, Courty, Nicolas, Duarte, Kyle, Le Naour, Thibaut, Gibet, Sylvie, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Doug, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Goebel, Randy, editor, Siekmann, Jörg, editor, Wahlster, Wolfgang, editor, Ruttkay, Zsófia, editor, Kipp, Michael, editor, Nijholt, Anton, editor, and Vilhjálmsson, Hannes Högni, editor

Published
2009
Full Text
View/download PDF

29. Analysis of Human Motion, Based on the Reduction of Multidimensional Captured Data – Application to Hand Gesture Compression, Segmentation and Synthesis

Author

Gibet, Sylvie, Marteau, Pierre-François, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Perales, Francisco J., editor, and Fisher, Robert B., editor

Published
2008
Full Text
View/download PDF

33. A Low-Cost Motion Capture Corpus in French Sign Language for Interpreting Iconicity and Spatial Referencing Mechanisms

Author

Mertz, Clémence, Barreaud, Vincent, Le Naour, Thibaut, Lolive, Damien, Gibet, Sylvie, Expressiveness in Human Centered Data/Media (EXPRESSION), SIGNAL, IMAGE ET LANGAGE (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), and Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)

Subjects
Motion Capture, Kinect Azure, [INFO]Computer Science [cs], Corpus, French Sign Language, MotionUp software
Abstract

The automatic translation of sign language videos into transcribed texts is rarely approached in its whole, as it implies to finely model the grammatical mechanisms that govern these languages. The presented work is a first step towards the interpretation of French sign language (LSF) by specifically targeting iconicity and spatial referencing. This paper describes the LSF-SHELVES corpus as well as the original technology that was designed and implemented to collect it. Our final goal is to use deep learning methods to circumvent the use of models in spatial referencing recognition. In order to obtain training material with sufficient variability, we designed a lightweight (and low-cost) capture protocol that enabled us to collect data from a large panel of LSF signers. This protocol involves the use of a portable device providing a 3D skeleton, and of a software developed specifically for this application to facilitate the post-processing of handshapes. The LSF-SHELVES includes simple and compound iconic and spatial dynamics, organized in 6 complexity levels, representing a total of 60 sequences signed by 15 LSF signers.

Published
2022

34. Gesture Analysis: Invariant Laws in Movement

Author

Gibet, Sylvie, Kamp, Jean-François, Poirier, Franck, Goos, Gerhard, editor, Hartmanis, Juris, editor, van Leeuwen, Jan, editor, Carbonell, Jaime G., editor, Siekmann, Jörg, editor, Camurri, Antonio, editor, and Volpe, Gualtiero, editor

Published
2004
Full Text
View/download PDF

37. CVM-Net: Motion Reconstruction from a Single RGB Camera with a Fully Supervised DCNN

Author

Tchenegnon, Mansour, Le Naour, Thibaut, Gibet, Sylvie, Expressiveness in Human Centered Data/Media (EXPRESSION), MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), and Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)

Subjects
[SCCO.COMP]Cognitive science/Computer science
Abstract

National audience; Many solutions have been proposed for 3D human pose estimation from video data. However, only a few of them take into account temporal features. In this article, we present a method focusing on this temporal aspect and show promising results. Our approach consists of two parts. The first one concerns the creation of a dataset that contains a variety of motion features. Based on this dataset, the second one deals with the training of a DCNN-based model, which takes as input the 2D pose estimations directly computed from videos. Here we present the first training tasks and results obtained using our deep neural network model to directly estimate 3D poses. Three models were trained using the same architecture applied on several configurations of our dataset. Using a small benchmark, we evaluate our network architecture.

Published
2021

41. Avatars signeurs : quels défis pour la production de contenu en Langues des Signes ?

Author

Gibet, Sylvie, Expressiveness in Human Centered Data/Media (EXPRESSION), MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-CentraleSupélec-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), and Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Bretagne Sud (UBS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes)

Subjects
langues des signes, génératon, [SCCO.COMP]Cognitive science/Computer science, iconicité, avatar signeur, spatialisation, ComputingMilieux_MISCELLANEOUS, texte vers signes
Abstract

International audience; Cet article explore les défis relevés par les systèmes permettant de générer des contenus en langues des signes au moyen d’avatars signeurs 3D. Après avoir passé en revue les avatars signeurs existants et leurs spécificités, à la fois au niveau de la représentation linguistique et du système d’animation qu’ils proposent, nous décrivons quelques mécanismes de formation des signes et des énoncés, à la lumière de procédés de spatialisation et d’iconicité caractérisant ces langues visuo-gestuelles. Nous présentons ensuite les défis pour la génération de signes à partir de texte.

Published
2020

42. Elemental: a Gesturally Controlled System to Perform Meteorological Sounds

Author

Brizolara, Tiago, Gibet, Sylvie, Larboulette, Caroline, Expressiveness in Human Centered Data/Media (EXPRESSION), MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique Bretagne-Pays de la Loire (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes 1 (UR1), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-IMT Atlantique (IMT Atlantique), Institut Mines-Télécom [Paris] (IMT)-Institut Mines-Télécom [Paris] (IMT)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Michon, Romain, and Schroeder, Franziska

Subjects
Percep- tual evaluation, [SCCO.COMP]Cognitive science/Computer science, Gestural control, Audio environmental synthesis, ComputingMilieux_MISCELLANEOUS
Abstract

International audience; In this paper, we present and evaluate Elemental, a NIME (New Interface for Musical Expression) based on audio synthesis of sounds of meteorological phenomena, namely rain, wind and thunder, intended for application in contemporary music/sound art, performing arts and entertainment. We first describe the system, controlled by the performer’s arms through Inertial Measuring Units and Electromyography sensors. The produced data is analyzed and used through mapping strategies as input of the sound synthesis engine. We conducted user studies to refine the sound synthesis engine, the choice of gestures and the mappings between them, and to finally evaluate this proof of concept. Indeed, the users approached the system with their own awareness ranging from the manipulation of abstract sound to the direct simulation of atmospheric phenomena - in the latter case, it could even be to revive memories or to create novel situations. This suggests that the approach of instrumentalization of sounds of known source may be a fruitful strategy for constructing expressive interactive sonic systems.

Published
2020

47. Avatar signeur - Synthèse de la langue des signes française à partir de texte.

Author

Gibet, Sylvie

Subjects
SIGN language, FRENCH language, PHONOLOGICAL encoding, AVATARS (Virtual reality)
Abstract

Copyright of Traitement Automatique des Langues is the property of Association pour le Traitement Automatique des Langues (ATALA) and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Published
2022

48. Proximal-to-Distal Sequences of Attack and Release Movements of Expert Pianists during Pressed-Staccato Keystrokes.

Author

Verdugo, Felipe, Begon, Mickaël, Gibet, Sylvie, and Wanderley, Marcelo M.

Abstract

The aims of this study were to i) evaluate proximal-to-distal sequencing (PDS) in pianists' attack and release movements during pressed-staccato keystrokes, and ii) investigate if trunk motion facilitates PDS of upper-limb movements. Nine expert pianists performed a series of loud pressed-staccato keystrokes. Kinematic data was recorded with a 3 D motion capture system. PDS was assessed by comparing temporal organization of peak velocities from the pelvis to the wrist. Evidence of PDS was found across the kinematic chain. Pianists' use of PDS differed mainly between scapula and shoulder movements. Trunk motion facilitated PDS by increasing anticipatory shoulder movements and by preceding shoulder-girdle attack and release movements. Implications might relate to research on performance optimization and injury prevention strategies. [ABSTRACT FROM AUTHOR]

Published
2022
Full Text
View/download PDF

50. Per Channel Automatic Annotation of Sign Language Motion Capture Data

Author

Naert, Lucie, Reverdy, Clément, Larboulette, Caroline, Gibet, Sylvie, Expressiveness in Human Centered Data/Media (EXPRESSION), Université de Bretagne Sud (UBS)-MEDIA ET INTERACTIONS (IRISA-D6), Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), CentraleSupélec-Télécom Bretagne-Université de Rennes 1 (UR1), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Université de Bretagne Sud (UBS)-Centre National de la Recherche Scientifique (CNRS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-CentraleSupélec-Télécom Bretagne-Université de Rennes 1 (UR1), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Université de Rennes (UNIV-RENNES)-Université de Rennes (UNIV-RENNES)-Institut National de Recherche en Informatique et en Automatique (Inria)-École normale supérieure - Rennes (ENS Rennes)-Centre National de la Recherche Scientifique (CNRS)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Université de Rennes (UNIV-RENNES)-Institut National des Sciences Appliquées (INSA), Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-Télécom Bretagne-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-Université de Rennes (UR)-Institut National des Sciences Appliquées - Rennes (INSA Rennes), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-Université de Bretagne Sud (UBS)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-Télécom Bretagne-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS)-Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA), Institut National des Sciences Appliquées (INSA)-Institut National des Sciences Appliquées (INSA)-École normale supérieure - Rennes (ENS Rennes)-Institut National de Recherche en Informatique et en Automatique (Inria)-Télécom Bretagne-CentraleSupélec-Centre National de la Recherche Scientifique (CNRS), and Gibet, Sylvie

Subjects
automatic segmentation, [SCCO.COMP] Cognitive science/Computer science, linguistic channels, motion capture, [SCCO.COMP]Cognitive science/Computer science, French Sign Language, automatic annotation
Abstract

International audience; Manual annotation is an expensive and time consuming task partly due to the high number of linguistic channels that usually compose sign language data. In this paper, we propose to automatize the annotation of sign language motion capture data by processing each channel separately. Motion features (such as distances between joints or facial descriptors) that take advantage of the 3D nature of motion capture data and the specificity of the channel are computed in order to (i) segment and (ii) label the sign language data. Two methods of automatic annotation of French Sign Language utterances using similar processes are developed. The first one describes the automatic annotation of thirty-two hand configurations while the second method describes the annotation of facial expressions using a closed vocabulary of seven expressions. Results for the two methods are then presented and discussed.

Published
2018

Catalog

Books, media, physical & digital resources
See catalog results