Search

Introduction: Human emotions can be complex to interpret as they have multiple sources and are often times ambiguous, for example, when the signals sent by different channels of communication are inconsistent. Our study investigates the interaction of linguistic and facial expressions of emotions. Methods: In two experiments, participants read short scenarios in German containing a direct utterance with positive or negative emotive markers, in combination with different facial expressions as still images of the speaker (i.e., the protagonist in the story). They answered questions about their perception regarding the intensity of the emotions (e.g., happiness, sadness), the properties of the expresser (e.g., honesty, warmth, likeability) and their relation to the addressee (e.g., closeness), as well as the expresser intention (e.g., irony, joke). Results: The findings suggest that facial expressions have a more dominant role in the emotion perception in comparison to emotive markers. Furthermore, consistent and inconsistent combinations of emotive markers and facial expressions convey distinct social meanings and communicative intentions. Conclusion: This research points to the importance to consider emotive markers in the emotional context that they occur in. [ABSTRACT FROM AUTHOR]

Using speech to communicate pragmatic functions is challenging among individuals with Autism Spectrum Disorder (ASD). Given the role language plays in developing everyday skills, we traced the unique pragmatic profile of early words, seeking comparison to typically developing (TD) toddlers at similar lexical stages. Twenty-four mother-toddler dyads participated (9 ASD and 15 TD). Dyads were video recorded when toddlers reached a productive lexicon of 40–70 words. These recordings were captured three times during naturalistic interaction and at two consecutive visits with a 2-month interval. Seven thousand three hundred seventy-six productions were analyzed and classified into four communicative intentions (Declaratives, Requests, Objections, and Non-Communicative speech). ASD toddlers were delayed in the emergence of words compared to TD toddlers, with a greater within-group variability (median 28 months, IQR 24.5–35, median 17 months, IQR 17–18, respectively, p < 0.001). In both groups, the most common communicative intention was Declarative. However, the percentage of Declaratives was higher among TD toddlers across visits compared to ASD toddlers. In both groups, most productions were directed toward the communicative partner, but ASD toddlers used Non-Communicative speech more often than TD peers. Non-Communicative speech gradually decreased over time. We conclude that while TD toddlers begin to talk with an already-established knowledge of the main communicative functions of words, ASD toddlers seem to have only a partial understanding and gradually improve communicative use as they expand their lexicon. These findings bear theoretical and practical implications for early intervention in ASD. We suggest that communicative profiles are affected by individual characteristics and by the interaction style.

Using speech to communicate pragmatic functions is challenging among individuals with Autism Spectrum Disorder (ASD). Given the role language plays in developing everyday skills, we traced the unique pragmatic profile of early words, seeking comparison to typically developing (TD) toddlers at similar lexical stages. Twenty-four mother-toddler dyads participated (9 ASD and 15 TD). Dyads were video recorded when toddlers reached a productive lexicon of 40–70 words. These recordings were captured three times during naturalistic interaction and at two consecutive visits with a 2-month interval. Seven thousand three hundred seventy-six productions were analyzed and classified into four communicative intentions (Declaratives, Requests, Objections, and Non-Communicative speech). ASD toddlers were delayed in the emergence of words compared to TD toddlers, with a greater within-group variability (median 28 months, IQR 24.5–35, median 17 months, IQR 17–18, respectively, p < 0.001). In both groups, the most common communicative intention was Declarative. However, the percentage of Declaratives was higher among TD toddlers across visits compared to ASD toddlers. In both groups, most productions were directed toward the communicative partner, but ASD toddlers used Non-Communicative speech more often than TD peers. Non-Communicative speech gradually decreased over time. We conclude that while TD toddlers begin to talk with an already-established knowledge of the main communicative functions of words, ASD toddlers seem to have only a partial understanding and gradually improve communicative use as they expand their lexicon. These findings bear theoretical and practical implications for early intervention in ASD. We suggest that communicative profiles are affected by individual characteristics and by the interaction style. [ABSTRACT FROM AUTHOR]

Observing others’ gaze is most informative during social encounters between humans: We can learn about potentially salient objects in the shared environment, infer others’ mental states and detect their communicative intentions. We almost automatically follow the gaze of others in order to check the relevance of the target of the other’s attention. This phenomenon called gaze cueing can be conceptualized as a triadic interaction involving a gaze initiator, a gaze follower and a gaze target, i.e., an object or person of interest in the environment. Gaze cueing can occur as “gaze pointing” with a communicative or “social” intention by the initiator, telling the observer that she/he is meant to follow, or as an incidental event, in which the observer follows spontaneously without any intention of the observed person. Here, we investigate which gaze cues let an observer ascribe a social intention to the observed person’s gaze and whether and to which degree previous eye contact in combination with an object fixation contributes to this ascription. We varied the orientation of the starting position of gaze toward the observer and the orientation of the end position of a lateral gaze shift. In two experiments participants had to infer from the gaze behavior either mere approach (“the person looked at me”) vs. a social (“the person wanted to show me something”) or a social vs. a private motivation (“the person was interested in something”). Participants differentially attributed either approach behavior, a social, or a private intention to the agent solely based on the passive observation of the two specific gaze cues of start and end position. While for the attribution of privately motivated behavior, participants relied solely on the end position of the gaze shift, the social interpretation of the observed behavior depended additionally upon initial eye contact. Implications of these results for future social gaze and social cognition research in general are discussed.

Observing others' gaze is most informative during social encounters between humans: We can learn about potentially salient objects in the shared environment, infer others' mental states and detect their communicative intentions. We almost automatically follow the gaze of others in order to check the relevance of the target of the other's attention. This phenomenon called gaze cueing can be conceptualized as a triadic interaction involving a gaze initiator, a gaze follower and a gaze target, i.e., an object or person of interest in the environment. Gaze cueing can occur as "gaze pointing" with a communicative or "social" intention by the initiator, telling the observer that she/he is meant to follow, or as an incidental event, in which the observer follows spontaneously without any intention of the observed person. Here, we investigate which gaze cues let an observer ascribe a social intention to the observed person's gaze and whether and to which degree previous eye contact in combination with an object fixation contributes to this ascription. We varied the orientation of the starting position of gaze toward the observer and the orientation of the end position of a lateral gaze shift. In two experiments participants had to infer from the gaze behavior either mere approach ("the person looked at me") vs. a social ("the person wanted to show me something") or a social vs. a private motivation ("the person was interested in something"). Participants differentially attributed either approach behavior, a social, or a private intention to the agent solely based on the passive observation of the two specific gaze cues of start and end position. While for the attribution of privately motivated behavior, participants relied solely on the end position of the gaze shift, the social interpretation of the observed behavior depended additionally upon initial eye contact. Implications of these results for future social gaze and social cognition research in general are discussed. [ABSTRACT FROM AUTHOR]

The investigation of the ability to perceive, recognize and judge upon social intentions, such as communicative intentions, on the basis of body motion is a growing research area. Cross-cultural differences in ability to perceive and interpret biological motion, however, have been poorly investigated so far. Progress in this domain strongly depends on the availability of suitable stimulus material. In the present method paper, we describe the multilingual CID-5, an extension of the CID-5 database, allowing for the investigation of how non-conventional communicative gestures are classified and identified by speakers of different languages. The CID-5 database contains 14 communicative interactions and 7 non-communicative actions performed by couples of agents and presented as point-light displays. For each action, the database provides movie files with the point-light animation, text files with the 3-D spatial coordinates of the point-lights, and five different response alternatives. In the multilingual CID-5 the alternatives were translated into seven languages (Chinese, Dutch, English, French, German, Italian, and Polish). Preliminary data collected to assess the recognizability of the actions in the different languages suggest that, for most of the action stimuli, information presented in point-light displays is sufficient for the distinctive classification of the action as communicative vs. individual, as well as for identification of the specific communicative gesture performed by the actor in all the available languages.

The investigation of the ability to perceive, recognize, and judge upon social intentions, such as communicative intentions, on the basis of body motion is a growing research area. Cross-cultural differences in ability to perceive and interpret biological motion, however, have been poorly investigated so far. Progress in this domain strongly depends on the availability of suitable stimulus material. In the present method paper, we describe the multilingual CID-5, an extension of the CID-5 database, allowing for the investigation of how non-conventional communicative gestures are classified and identified by speakers of different languages. The CID-5 database contains 14 communicative interactions and 7 non-communicative actions performed by couples of agents and presented as point-light displays. For each action, the database provides movie files with the point-light animation, text files with the 3-D spatial coordinates of the point-lights, and five different response alternatives. In the multilingual CID-5 the alternatives were translated into seven languages (Chinese, Dutch, English, French, German, Italian, and Polish). Preliminary data collected to assess the recognizability of the actions in the different languages suggest that, for most of the action stimuli, information presented in point-light displays is sufficient for the distinctive classification of the action as communicative vs. individual, as well as for identification of the specific communicative gesture performed by the actor in all the available languages. [ABSTRACT FROM AUTHOR]