Search

L'intelligibilité (mesure dans laquelle le message oral d'un locuteur est compris par un interlocuteur), la compréhensibilité (facilité/difficulté pour comprendre un message oral) et la perception de l'accent étranger (identification de la parole non-native) sont trois dimensions fondamentales dans l'enseignement de la prononciation d'une L2 (Munro & Derwin 1995, 2021). Dans des documents de référence tels que le CECRL, la compétence phonique d'un apprenant est définie en termes d'être compréhensible (A1), être compris avec une prononciation claire (A2), être intelligible (B1) ou maîtriser tout l'éventail des traits phonologiques de la langue cible de façon à être toujours intelligible (C2). Les études examinant ces aspects ont permis de mieux identifier les patrons phonétiques prioritaires à enseigner en anglais L2 (Levis 2020). Néanmoins, l'intelligibilité, la compréhensibilité et la perception de l'accent étranger ont été largement délaissées dans les recherches empiriques en français L2 (Didelot et al. 2019, Bergeron & Trofimovich 2017, Lappin-Fortin 2018).Cette contribution essaie d'étudier le rapport de ces trois dimensions avec le développement phonologique en FLE. Cette étude examine les effets de deux niveaux de maitrise de FLE dans l'intelligibilité, la compréhensibilité et le degré d'accent étranger chez des locuteurs natifs du français. Notre hypothèse est que la parole du groupe B1 serait plus intelligible, plus compréhensible et associée à accent étranger moins fort que celle du groupe A2. Pour ce faire, 12 apprenants hispanophones ayant un niveau A2 (n = 6) et B1 (n = 6) en FLE, ainsi que 5 locuteurs natifs (de région parisienne) ont été enregistrés lors d'une tâche d'interaction orale. 51 énoncés ont été extraits de ce corpus et ont été évalués par 20 locuteurs natifs du français(Île-de-France). Les juges ont d'abord transcrit orthographiquement les stimuli afin de calculer le pourcentage de mots reconnus (intelligibilité). Ils ont ensuite évalué le degré de difficulté pour comprendre les stimuli (compréhensibilité) et le degré d'accent étranger perçu via une échelle de Likert de 9 points.Nous avons également examiné les stimuli selon trois dimensions phonétiques : (i) taux d'erreurs dans la prononciation de segments via les distances de Levenshtein (Santiago 2018, Weiling et al. 2014), (ii) évaluation de la prosodie des stimuli manipulés avec un filtre passe-bas par 3 prosodistes natifs du français et (iii) des patrons rythmiques (débit d'articulation, nombre de pauses et leur durée).Les résultats des modèles linéaires mixtes montrent que les apprenants hispanophones du groupe B1 ont une tendance à être plus intelligibles et plus compréhensibles que le groupe A2, mais ces différences ne sont pas statistiquement significatives (Figures 1 & 2). Le degré d'accent étranger semble diminuer légèrement avec le niveau de langue, mais sans atteindre la significativité statistique non plus (Figure 3). Les corrélations (méthode Kendall) montrent que les aspects suprasegmentaux (prosodie et rythme) ont eu un des effets plus importants chez les juges que les erreurs au niveau segmental (niveau B1 seulement). Contrairement à notre hypothèse, la compétence phonétique entre ces deux groupes n'évolue pas de manière homogène. Nous discutons de l'importance de ces résultats dans la didactique de la prononciation en FLE.

International audience; In natural language settings, many interactions include more than two speakers, and real-life interpretation is based on all types of information available in all modalities. This constitutes a challenge for corpus-based analyses because the information in the audio and visual channels must be included in the coding. The goal of the DINLANG project is to tackle that challenge and analyze spontaneous interactions in family dinner settings (two adults and two to three children). The families use either French, or LSF (French sign language). Our aim is to compare how participants share language across the range of modalities found in vocal and visual languaging in coordination with dining. In order to pinpoint similarities and differences, we had to find a common coding tool for all situations (variations from one family to another) and modalities. Our coding procedure incorporates the use of the ELAN software. We created a template organized around participants, situations, and modalities, rather than around language forms. Spoken language transcription can be integrated, when it exists, but it is not mandatory. Data that has been created with another software can be injected in ELAN files if it is linked using time stamps. Analyses performed with the coded files rely on ELAN's structured search functionalities, which allow to achieve fine-grained temporal analyses and which can be completed by using spreadsheets or R language.

International audience; Suite au récent "Appel d’Amsterdam" pour développer l’accès aux publications scientifiques (Ministerie van Onderwijs, Cultuur en Wetenschap, 2016), le plan national pour la science ouverte (Ministère de l’Enseignement Supérieur, de la Recherche et de l’Innovation, 2018) invite les chercheurs à partager les données de la recherche et les connaissances afférentes, de leur acquisition à leur dépôt final. Pour rendre la phase de recueil de données plus facilement reproductible, nous avons entrepris de reprogrammer une batterie de tests développés initialement avec le logiciel commercial E-Prime (Schneider, Eschman et Zuccolotto, 2002) dans le cadre du projet VILLA sur les premières étapes d’acquisition d’une langue étrangère (Dimroth et al., 2013), avec le logiciel libre OpenSesame (Mathôt et al., 2012). Après avoir détaillé la démarche suivie pour notre reprogrammation, nous présenterons plus généralement les apports d’OpenSesame à l’acquisition et à la didactique des langues, y compris la possibilité de mettre en ligne les expériences, un point primordial à l’heure où les enregistrements de données en présentiel sont complexes. Le poster sera accompagné d’une démonstration d’OpenSesame, outil qu’il nous semble intéressant de faire découvrir à notre communauté de recherche.Dimroth, C., Rast, R., Starren, M., & Watorek, M. (2013). Methods for Studying the Acquisition of a New Language under Controlled Input Conditions : The VILLA Project. In Roberts, L., Ewert, A., Pawlak, M., & Wrembel, M. (Éds.), EUROSLA Yearbook (Vol. 13, p. 109 138). John Benjamins.Mathôt, S., Schreij, D., & Theeuwes, J. (2012). OpenSesame : An open-source, graphical experiment builder for the social sciences. Behavior Research Methods, 44(2), 314 324. https://doi.org/10.3758/s13428-011-0168-7Ministère de l’Enseignement Supérieur, de la Recherche et de l’Innovation. (2018). Plan national pour la Science Ouverte. https://www.ouvrirlascience.fr/plan-national-pour-la-science-ouverteMinisterie van Onderwijs, Cultuur en Wetenschap. (2016). Amsterdam Call for Action on Open Science [Rapport]. https://www.government.nl/documents/reports/2016/04/04/amsterdam-call-for-action-on-open-scienceSchneider, W., Eschman, A., & Zuccolotto, A. (2006). E-Prime (1.2) [Computer software]. Psychology Software Tools. https://support.pstnet.com/

International audience

International audience

International audience; Influence of an alternative construction on pronoun interpretation in French-speakingchildren with typical and atypical language development. In a visual world eye-tracking experiment,we observed strategies for interpreting an anaphoric pronoun in 4-year-old French-speaking children withtypical and atypical language development. We compared their interpretation of a construction with anambiguous pronoun such as "The rabbit tickles the fox before he imagines..." with their interpretation ofthe unambiguous alternative construction "The rabbit tickles the fox before imagining...". The results showthat while typically developing children interpret both constructions differently, this is not the case forchildren with language delay. On the other hand, even if they begin to distinguish the two constructions,children without language delay do not yet interpret them in an adult-like way. To account for theseresults, we propose that, unlike adults, 4-year-olds have not yet been sufficiently exposed to theunambiguous infinite construction to influence their interpretation of the construction with an ambiguouspronoun.; Dans une expérience d'enregistrement des mouvements oculaires pendant l'exploration de référents présentés visuellement, nous avons observé les stratégies d'interprétation d'un pronom anaphorique chez des enfants francophones de 4 ans au développement langagier typique et des enfants avec retard de langage. Nous avons comparé leur interprétation d'une construction avec un pronom ambigu telle que "Le lapin chatouille le renard avant qu'il imagine…" avec leur interprétation de la construction alternative non ambiguë "Le lapin chatouille le renard avant d'imaginer…". Les résultats montrent qu'alors que les enfants au développement typique interprètent différemment les 2 constructions, ce n'est pas le cas des enfants avec retard de langage. En revanche, même s'ils commencent à distinguer les 2 constructions, les enfants sans retard ne les interprètent pas encore tout à fait comme les adultes. Pour rendre compte de ces résultats, nous proposons que, contrairement aux adultes, les enfants de 4 ans n'ont pas encore été suffisamment exposés à la construction infinitive non ambiguë pour qu'elle influence leur interprétation de la construction avec un pronom ambigu.

International audience

International audience

International audience; For almost ten years, the marketing of low cost motion capture devices such as the Microsoft Kinect sensor has enabled numerous studies in real-life settings (Mousavi Hondori & Khademi, 2014; Webster & Celik, 2014; Springer & Yogev Seligmann, 2016). Whereas most of this work with elderly people is studying gait and fall risks (see Rougier, Auvinet, Rousseau, Mignotte, & Meunier, 2011 for example), in the present paper we propose to focus on the building of the SignAge corpus dedicated to the study of signing in elderly deaf participants with low cost motion capture devices. Up to now, a (preferably multi-)camera setup was considered a basic requirement in sign language studies, sometimes completed with much more intrusive or expensive equipment such as data gloves, optical motion capture systems (Channon, 2015, p. 132–133). But latest technology advancements allow us to quantify 3D-motions and their time derivatives at a reasonable price. Our newly built SignAge corpus1 of interactions between elderly deaf signers in LSF takes advantage of such advancements. The SignAge corpus combines data acquired by: - 2 digital video cameras, with a plan on the signing interviewee’s upper body and a plan on the whole interaction (similarly to the protocol developed in CorpAGEst, Bolly & Boutet, 2016) - 2 Noitom Perception Neuron body straps, each equipped with 25 IMU (Inertial Measurement Units), recorded with Axis Neuron software - 1 Kinect for Windows v2 (also known as Kinect for Xbox One) depth sensor centered on the interviewee, recorded with Brekel Pro Body v2. Thus, for each participant, our 5 timed data flows are: 2 video streams at 25 fps – synchronised, visualised and annotated in the ELAN software (Sloetjes & Seibert, 2016) –, and BioVision Hierarchy (BVH) files (see Meredith & Maddock, 2001). These BVH files are visualised in Motion Inspector, and the following descriptors are computed in Matlab for the three age groups in our sample: the global quantity of motion (Sarasúa & Guaus, 2014) and the variation of the signing amplitude for each joint of the upper limbs, with the attempt to establish a correlation between age and the articulatory segment involved. For now, after manually post-synchronising our flows thanks to start and end claps realised by both the interviewer and the interviewee during the recording session, we are assessing the quality of our data. Preliminary results show that temporal resolution can be questionable for the Kinect used in conjunction with Brekel, whereas in the Perception Neuron, spatial drift is a problem. Hence, these two devices seem to be complementary: the Kinect gives the absolute movements of the body, whereas the neuron is much precise for relative movements. Furthermore, a post interview feedback with each subject showed a high acceptance of the protocol by elderly signers (see figure below). As a conclusion, knowing the technical limitations it appears that Kinect and Neuron might still be an interesting choice to get usable additional 3D data in aging studies because of their portability and the ease with which participants get accustomed to wearing the body straps.

International audience; Sign languages corpora of LSFB (Meurant 2015) and LSQ (Parisot & Rinfret 2015; Luna 2015) include data from elderly signers. Parisot (2017) has given more details about the analysis of verb agreement in the senior LSQ signers suggesting that “ even if verb agreement is sometimes difficult to perceive in seniors’ productions, it seems to be rather a phonetic difference than a morphosyntactic one”. Our SignAge corpus of interactions between elderly deaf signers in LSF aims to test motion capture systems to complement analysis on the basis of video recordings. Motion capture has the advantage to capture three-dimensional data, including the possibility to change the point of view. It also allows to extract more abstract movement descriptors such as speed or acceleration of the different body parts. Furthermore, it is a step forward to get semi-automatic annotation since manual annotation is time consuming. We could not use a mocap system with many reflective markers and infrared cameras in a mocap studio and we needed a less invasive mocap setting. Then, we conducted complementary tests with Kinect and Inertial Measurement Unit sensors which permit measuring acceleration and relative position differences on xyz axis. Following some of the steps from the methodological protocol developed in CorpAGEst ( http://corpagest.org/ ), we tried to involve relatives or friends as interviewers; the 13 participants they interviewed are over 65 years old (Table 1) and use LSF as their main language in everyday life. Two deaf ‘complices’ conducted 6-min interviews on the themes of the evolution of transport, access to care, culture and new technologies (Fig. 1 and our companion paper for technical details). We explore gestural flow with a kinesiological model based on linguistics and we are currently analysing i) the variation of the signing amplitude per each degree of freedom, ii) the global movement quantity and iii) the way it is correlated with which articulatory segment is concerned, in each of the three age groups in our sample. One of the hypothesis is that the ranges of motion of degrees of freedom are reduced for elderly people compared to younger people. Consequently, the transfer of the movement is much more present than for the younger. The same for finger selection: the ratio of the inertial mass between the hand and the forearm is lower for elderly than for younger people. This fact exerts a motion further on the forearm and a smoother gesture. We expect also two tendencies: the signs which clearly respond to a proximal-distal flow engaging the arm, the forearm and the hand in the movement should show proportionally less movement on the hand than we have for younger people; for the signs which clearly respond to a distal-proximal flow engaging the hand and the forearm, the movement of the forearm should be more developed than the ones of the younger people. We will present some preliminary results and the contrast between elderly and younger people (inside the panel) is reinforced in each interaction when the interviewer is the younger signer.

International audience; Eye tracking (ET) methods become more and more popular in psycholinguistic research because they offer the possibility to record visual processing in real time, allowing for the study of the relation between cognition and language, two systems often considered independent (Pinker, 1994). In order to evaluate the impact of specific language properties on on-line visual processing we coupled a production task with an ET paradigm. 473 native speakers of two typologically different languages (234 English and 239 French) within three age groups (142 7-year-old children, 155 10-year-old children, and 176 adults) were tested in a production task involving 36 dynamic motion scenes (videos), that first had to be visually explored and then verbally described (e.g. “a man running up a hill”). With respect to the ET data, which is the main focus of the present paper, and in order to properly compare the gaze patterns of the groups, a thorough validity check (pre-processing and quality assessment) was necessary. Indeed, validity is an issue that is almost never addressed in psycholinguistic research, even though an increasing number of researchers report it as one of the main sources of methodological bias (Holmqvist et al., 2011). Apart from the fact that a recording may include segments that are irrelevant for the analysis (e.g., eye-blinks, off-screen fixations), it has been found that low quality data may misleadingly point to group differences in gaze behavior, for instance between adults and children (Wass et al., 2014). More specifically, low precision due to incorrect gaze detection may “flatten out” the gaze distribution across different areas of interest (AOI) or across groups, while low robustness (i.e. resulting from missing or fragmented data) can make visit durations seem shorter than they actually are, and thus bias interpretation of results. The present paper compares results obtained with a turnkey solution (namely Tobii Studio) to results obtained with in-house developed algorithms that: (a) carefully discard irrelevant parts of the recording; (b) exclude gaze initiation latencies; (c) detect and compensate for spatial inaccuracies of the ET data. The findings show that turnkey solutions may be only relevant for some designs (i.e. more appropriate for static/picture material). However, design-adapted validity checks (pre-processing the recordings and quality assessment) as well as target-related compensations of inaccuracies, as proposed in this paper, are crucial and should be common practice for researchers who wish to compare gaze patterns or to evaluate group differences objectively. Challenges related to typical ET measures, such as gaze proportions to different dynamic AOI and visit durations are also discussed as they seem to be sensitive and subject to change due to validity-related factors.

International audience; The co-presence of bodies inherent to live performance coupled with the movement qualities of the dancers underlies the audience’s kinesthetic empathy (Foster, 2011). We were interested to quantify a change in “body-mind” state of the spectators brought about by a live rendition of Gourfink’s unique choreography that uses a contemplative practice to produce an extremely slow and hypnotic dance. Phenomenological studies of her work report a number of body-mind effects including a change in temporal perception (Gioffredi, 2008). We wanted to quantify changes in temporal perception, test for their specificity and assess their relation to changes in physiological rhythms (Joufflineau & Bachrach 2016). We combined physiological monitoring and subjective reports with two measures of temporal cognition before and after a 40-min live performance (12 subjects): a Spontaneous Tempo Production (STP) task (McAuley et al., 2006) and a task assessing the temporal window inducing the Apparent Motion effect (AM) (Marusich & Gilden, 2014). The same temporal tasks (14 subjects) were tested with a control choreography with a distinctly different quality of movement. Post-performance, we observed a significant slowing down of STP (t=15.01, p

International audience; The co-presence of bodies in intersubjective situations can give rise to processes of kinesthetic empathy and physiological synchronisation, especially in the contexts of dance: the body and attention of the spectators are oriented towards the dancers. We investigate the processes of “bodymind’s states” contagion between dancers and spectators and its relation to subjective measures of attention. In the Labodanse project we worked closely with the French choreographer Myriam Gourfink who develops a unique movement based on slower breathing of the dancers, generating an extremely slow movement without rhythmic ruptures. Phenomenological studies of her work report changes in temporal perception (TP), and changes in bodily attentional states. In order to quantify this change in TP we had 12 spectators perform two TP protocols (Spontaneous Tempo Production - STP - and Apparent Motion effect - AM - tasks) Before and after a 40-min live performance. We performed a control experiment with a choreography of a distinctly different quality of movement (14 subjects). Subjective reports were collected at the end of the performance. Physiological data was recorded during the performance. Post-performance, we observed a significant slowing down of STP, while AM was reported with longer temporal intervals. Neither of these effects was observed in the control condition. Correlations with subjective reports show a link between paying attention to the breath of the dancer and the change in the perception of AM. Correlations with physiological data are analyzed. The results suggest an expansion of the “specious present” (Wittmann). The absence of similar results in the control condition argues that 1) these effects were due to the specificity of Gourfink’s choreography; 2) changes in TP is a working proxy to study contagion of body-mind states; 3) the role of conscious attention to the breathing of the other enhances intersubjective processes as "body-mind" contagion.

International audience; Leduc & Grenier (2015) examine the question of technology in relation to representations associated with deafness and aging. Their research contributes to challenging both the view of aging as a synonym for dependence or decline and the view of deafness as a disability. Their data include interviews with deaf seniors in Quebec Sign Language (LSQ) and in American Sign Language (ASL) (see http://actproject.ca/act/les-aines-sourds-et-latechnologie/).In parallel, the CLARe network proposes to contrast different approaches to the language of the elderly (Whitehouse 2013; Van der Linden & Juillerat Van der Linden 2014). Linguistic description, based on corpora of semi-guided interviews, focuses on the markers of typical aging and the compensatory and adaptive strategies used to achieve successful interactions (Bolly & Boutet to appear; Bolly & Thomas 2015). This approach takes into account the pragmatic dimension, including the multimodality of French, therefore considering a spoken language as an embodied language. Like Grenier and Leduc, this approach contests the view of aging as a decline (Baltes & Lindenberg 1997; Duboisdindien 2017).Work on sign languages was integrated into the data session of the 2nd CLARe workshop (Louvain), in connection with recently established corpora of LSFB (the sign language of French-speaking Belgium) and LSQ – both of which include data from elderly signers (Meurant 2015; Parisot & Rinfret 2015; Luna 2015).The SignAge project aims to create a corpus of interactions between elderly deaf signers (> 65 y.o) in French Sign Language (LSF) on the themes of the evolution of transport, access to care, culture and new technologies. As part of this project, we aim to test motion capture systems to complement analysis on the basis of video recordings. We expect motion capture to give us additional kinesiological information, allowing for articulatory measurements to study the use of space and the signers’ prosody, especially in interaction patterns.The literature indicates that the elderly use gestures with reduced amplitude (Carmeli, et al., 2003). We will also consider eye and hand coordination, which appears to be deficient for the elderly, as well as the forms of manual configurations. We will examine a possible link with peripheral dysarthria for co-verbal gestures or dyspraxia. Does reduced amplitude of gestures change their meaning?In the longer term, our aim is a more general study of (i) the linguistic specificities of LSF with respect to age in the productions collected in interaction (speech turn, signing space, lexical and morphosyntactic variations, prosody in LSF), (ii) the possible markers of aging, whetherordinary or disturbed, in connection with existing studies on the articulatory manifestations of language or cognitive disorders (Tyrone & Woll 2008; Tyrone 2014) and (iii) adaptive strategies of elderly signers.We follow some of the steps from the methodological protocol developed in the European project CorpAGEst (http://corpagest.org/): collection and processing of audiovisual data of the sample, annotation of segmental and suprasegmental markers (via the ELAN annotation software http://www.lat-mpi.eu/tools/elan), experimental study based on motion capture, functional linguistic interpretation of the results obtained. We had to adapt some of the recommendations to deafness. In the longer term, consideration will be given to adapting psychometric tests to deaf signers in order to diagnose participants’ risk of developing some cognitive impairment involving communication.We will present (i) our methodology and initial data (collected with two digital video cameras and a kinect, Figure1) and (ii) our adaptation of the original protocol to our research conditions (deaf participants) and the experimental issues. We also plan complementary tests with other types of sensors, such as accelerometers or digital gloves. We would like to take the opportunity of CLARe3 to submit these experimental tracks to the interdisciplinary expertise of the network members.

National audience; La science-fiction constitue un formidable moyen d’exploration de notre monde. Le cinéma de science-fiction permet non seulement d’imaginer les atmosphères visuelles mais également sonores de futurs possibles et de porter en retour un regard critique sur le présent et ses évolutions.Durant cet atelier, nous nous proposons de faire (re-)découvrir les différentes explorations esthétiques produites par Hollywood dans le domaine des voix artificielles (ordinateurs, robots, cyborgs...) depuis plus de 50 ans. Le présent travail s’efforcera aussi de mettre en évidence les liens étroits qui existent entre cinéma de science-fiction et recherche scientifique en synthèse vocale. Nous tenterons enfin de montrer que le soin constant apporté aux voix artificielles, au-delà de leur aspect ludique et anecdotique, invite, à l’heure du posthumanisme, à s’interroger sur la frontière entre l’humain et le non-humain.

International audience; Language-specific properties influence motion expression (Slobin 2004; Talmy 2000), but it is still debated whether they also influence non-verbal spatial cognition. We compare how English and French speakers perform three tasks involving motion events: non-verbal categorization based on cartoons during a dual task (articulatory suppression); verbal categorization involving target sentences; and descriptions of motion events. Descriptions show more manner expression in English and variation in both groups as a function of event properties. However, both groups frequently choose Path as categorization criterion, particularly in verbal categorization, but language effects do show that English speakers are more sensitive to event properties. Thus, typology has a strong impact on verbal cognition but also a partial influence on non-verbal cognition that must be taken into account in future research on the relation between language and thought.

International audience; CIGALE (Capture et Interaction avec des Gestes Artistiques, Langagiers et Expressifs) is an artistic and dialogical platform that explores the hybridization between human and virtual gestures in real time. This platform allows studying complementary aspects of gestures, from the linguistic field to the arts. CIGALE allows understanding the relationships between symbolic gestures (coverbal ones), expressive gestures (choral conducting and poetry) and full body gestures (mime). Starting from motion capture (1), we have created four databases of gestures. The platform allows to study and analyses gestures, strokes and meaning (2). We propose then to generate new gestures using genetic algorithm that converges to new gestures inspired by the ones of the database (3). In order to visualize the gestures, we can render the motion on different characters by changing body aspect(mesh), using particles effect or trails (4). At least, it’s possible to interact using gestures with the virtual characters that can answer autonomously to the user or to the audience (5).

International audience; It has been observed that in French sentences such as 'The facteur a appelé le pirate avant qu'il rentre à la maison' ('The postman called the pirate before he went home'), the N2 (the pirate) is strongly preferred as the antecedent of the ambiguous pronoun. This N2-preference in French has been explained by the fact that speakers take into account an alternative non-finite construction that is available in the language ('avant de rentrer à la maison', 'before going home') and that unambiguously refers to the N1.In a questionnaire and a Visual World eye-tracking experiment, we tested whether the explicit topicalization of the object by means of a passive construction ('Le pirate a été appelé par le facteur...') can change the N2-preference in favor of an N1-preference. Despite the fact that the non-finite construction is an unambiguous alternative for the active as well as the passive sentences, we observed a significant increase of N1-preferences in passive compared to active constructions in both the questionnaire (p

National audience; The study of spoken language prosody is partially based on the measurement of three parameters: sound duration, intensity and frequency. Sign languages use the visual-gestural channel and mobilize manual and non manual articulators (chest, head, facial features). Our study aims to establish tools that allow to compare, on the prosodic level, the translation of poetic sequences into French and their original versions in French Sign Language (LSF). We collected video and motion capture data – which offers wide avenues for exploration of LSF prosodic features – as well as audio data of French translations – that reveal the strategies of interpreters to convey prosodic variation.; L’étude de la prosodie des langues vocales repose en partie sur la mesure des paramètres de durée, d’intensité et de fréquence sonores. Les langues des signes, quant à elles, empruntent le canal visuo-gestuel et mobilisent des articulateurs manuels et non manuels (buste, tête, éléments du visage). Notre étude a pour objectif d’établir des outils permettant de comparer, au niveau prosodique, la traduction en français de séquences poétiques et la version originale en langue des signes française (LSF). Nous avons recueilli des données vidéo augmentées de capture de mouvement – qui offrent plusieurs pistes d’exploration des paramètres prosodiques pour la LSF – ainsi que des données audio des traductions en français – qui révèlent les stratégies des interprètes pour interpréter la variation prosodique.

National audience; La science-fiction est réputée être un formidable moyen d'explorer notre monde. Le cinéma de science-fiction permet quant à lui de représenter les atmosphères visuelles et sonores de futurs possibles et de délivrer, en retour, un regard critique sur le présent et ses évolutions. Nous nous proposons de présenter ici l'exploration esthétique réalisée sur la voix du personnage principal du film RoboCop (Verhoeven, 1987), particulièrement intéressant à notre sens : c'est en effet l'un des premiers du mouvement cyberpunk à mettre en scène un homme augmenté qui oscille entre les statuts d'humain et de robot. C'est principalement la persona vocale qui est prise en considération dans cette étude. Notre analyse montre que, du niveau sémantique aux effets audio en passant par la prosodie, tous les moyens à disposition sont mis en œuvre pour instiller chez le spectateur, via la voix, le doute quant à la part d'humanité du personnage.

International audience; Like human communication, gestural communication with a virtual actor (VA) depends on the environment and the type of interaction. This type of exchange tells us about human communication in a paradigm of "rediscovered body" as well as about the asymmetric communication strategies. The corpus designed in the CIGALE project consists of the recording and analysis of gestural interactions between a real actor (RA) and a VA. The perceptual system of this VA prevents the normal course of multimodality. In this gestural interaction model, modality asymmetry imposed by the VA sheds light on relational implications of the choice of gestures the real actor makes. The interaction loop is controlled by the VA which must detect (gestural) activity of the real person, to perform a (defined) action in response. The gesture analysis (carried out in ELAN) of 7 dyads, shows that during the interaction, the RA adapts to the VA stimuli by adopting speeds and amplitudes similar to those of the VA, by focusing on the arm movements and by more or less neutralizing distal movements (hands and fingers). This adjustment corresponds to the limited gestural production of the VA, by a perception / action internal connection based on the Microsoft Kinect sensor (no capture of finger movements or of pronosupination). In the real person this leads to a tendency to empathise, maintaining him/her in the imitative loop initiated by the VA. This mode of gesture exchange based on imitation incites the real actors to incorporate the limitations of the joints of the VA, down to the shape of the gesture. Moreover, empathy exceeds imitation, since the emerging gestural style of the real actors even appears in non-imitative productions. This empathy with the VA fosters arm and forearm movements of the real actors and thus directs the gesture to the movement of these proximal segments. By doing this, it resembles the gestures of children before 17 months and promotes relational gestures initiated by the arms, at the expense of manipulative actions, initiated by the hands. This interaction model sheds new light on gestural exchanges: Would the lack of vocal production and the limitations, including gestural and/or mimicry restriction, foster empathy in the interaction with the VA? Would there be, because of this type of gesture constraint, a relationship to build - as with a child?; A l’instar de la communication entre humains, la communication gestuelle avec un acteur virtuel (AV) dépend de l’environnement et du type d’interaction. Ce type d’échanges nous renseigne sur la communication humaine dans un paradigme du “corps retrouvé” autant que sur les stratégies de communication asymétrique. Le corpus conçu dans le projet CIGALE consiste dans l’enregistrement et l’analyse d’interactions gestuelles entre un acteur réel et un AV. Le système de perception de cet AV empêche le cours normal de la multimodalité. Dans ce dispositif d’interactions gestuelles, l’asymétrie de modalités qu’impose l’AV éclaire les implications relationnelles des choix de gestes de l’acteur réel. Les interactions sont régies par cet AV qui doit percevoir l'activité (gestuelle) de la personne réelle, afin d’exécuter une action (déterminée) en réponse. L’analyse gestuelle menée (sous ELAN) sur 7 dyades, montre que, dans l’interaction, les personnes réelles s’adaptent aux stimuli de l’AV en adoptant des vitesses et des amplitudes analogues à celles de l’AV, en se focalisant sur des mouvements des bras et en neutralisant plus ou moins les mouvements distaux (mains et doigts). Cette adaptation correspond à une production gestuelle limitée de l’AV, par un couplage interne perception/production basé sur un même dispositif, le capteur de mouvements Kinect (absence de captation des mouvements des doigts et de la pronosupination). Ceci entraîne, chez la personne réelle, une tendance à l’empathie, la maintenant dans la boucle imitative initiée par l’AV. Ce mode d’échanges gestuels basé sur l’imitation pousse les acteurs réels à intégrer les limitations des articulations de l’AV, jusque dans la forme de la gestualité. De plus, l’empathie dépasse l’imitation, puisque le style gestuel émergent des acteurs réels apparaît y compris dans les productions non imitatives. Cette empathie avec l’AV favorise les mouvements des bras et des avant-bras des acteurs réels et, ainsi, oriente la gestualité vers le mouvement de ces segments proximaux. Elle s’apparente en cela à la gestuelle des enfants avant 17 mois et promeut les gestes relationnels initiés sur les bras, au détriment des gestes manipulatoires, initiés sur les mains. Ce dispositif apporte un éclairage nouveau aux échanges gestuels : Est-ce l’absence de production vocale et la limitation y compris gestuelle et/ou le mimétisme qui favoriseraient l’empathie dans l’interaction avec l’AV ? Y aurait-il, en raison de ce type de gestualité contrainte, une relation à construire — comme avec un enfant ?

International audience; This paper presents a cross-linguistic study in progress that uses eye-tracking techniques to investigate how language-specific properties affect cognition. The motion domain shows systematic cross-linguistic variation in how frequently the semantic dimensions of PATH and MANNER are expressed and what linguistic means are used to encode them (inside vs. outside the main verb). Talmy (2000) captures this variation in his proposed dichotomous typology of satellite-framing (SF) vs. verb-framing (VF) languages: Whilst English speakers (SF) typically verbalize both PATH and MANNER together (e.g. ‘He ran across the street’), French speakers (VF) by default focus more on Path alone, which is typically expressed in the main verb (e.g. Il a traversé la rue – He crossed the road) whereas MANNER is often either omitted or encoded in peripheral constructions, such as gerunds (e.g. en courant – by/whilst running).The question as to whether these differences have a deeper cognitive impact going beyond language use has been approached from various angles in the past years, including the perspective of language acquisition and the so-called thinking-for-speaking approach (Slobin 1996). These approaches have generated significant progress in our understanding of how language-specific differences have long-lasting effects on first, second and bilingual language acquisition, and on on-line speech production processes. However, they nevertheless constitute only indirect evidence for the cognitive depth of language-specific variation, since they amount to showing us only how language patterns affect our language use. Few studies to date have tapped into non-verbal cognitive measures (e.g. Athanasopoulous 2013) to investigate whether a reliable correlation between linguistic and cognitive representations can be established. Furthermore, if language-specific properties are found to impact non-linguistic cognition, when and how do these differences arise in children’s event processing?In order to address these questions, we tested English and French adults (N = 150) and children (N = 100) in two age groups (7 and 11 yrs) across two tasks: (i) a categorization task and (ii) a memory task, each of which was administered either in a verbal condition (by prior verbalization) or a non-verbal condition (articulatory suppression), to which participants were assigned randomly. All tasks were coupled with remote eye-tracking (Tobii X120). In contrast to classic Visual World paradigms, our stimuli consisted of naturalistic videos showing human agents moving in different ways (e.g. run, cycle) along different trajectories (e.g. up, into, across). The prediction was that, in line with typology, English participants would attend more to MANNER than French speakers, reflected in both verbal and non-verbal measures. That is, English speakers should express MANNER more often in their event descriptions, but should also (i) use MANNER more frequently as a categorization criterion, and (ii) remember it better than French speakers. With respect to (iii) gaze patterns, we expected greater visual attention to the MANNER-relevant zones of interest (such as agents’ legs), translating into more fixations. Preliminary results suggest a weak effect of language on some, but not all aspects of cognition. We discuss the significance of these findings and the particular methodological challenges of analyzing eye-tracking data using dynamic stimuli.