Search

Abstract Background Autism spectrum disorder (ASD) is characterized by atypical behaviors in social environments and in reaction to changing events. While this dyad of symptoms is at the core of the pathology along with atypical sensory behaviors, most studies have investigated only one dimension. A focus on the sameness dimension has shown that intolerance to change is related to an atypical pre-attentional detection of irregularity. In the present study, we addressed the same process in response to emotional change in order to evaluate the interplay between alterations of change detection and socio-emotional processing in children and adults with autism. Methods Brain responses to neutral and emotional prosodic deviancies (mismatch negativity (MMN) and P3a, reflecting change detection and orientation of attention toward change, respectively) were recorded in children and adults with autism and in controls. Comparison of neutral and emotional conditions allowed distinguishing between general deviancy and emotional deviancy effects. Moreover, brain responses to the same neutral and emotional stimuli were recorded when they were not deviants to evaluate the sensory processing of these vocal stimuli. Results In controls, change detection was modulated by prosody: in children, this was characterized by a lateralization of emotional MMN to the right hemisphere, and in adults, by an earlier MMN for emotional deviancy than for neutral deviancy. In ASD, an overall atypical change detection was observed with an earlier MMN and a larger P3a compared to controls suggesting an unusual pre-attentional orientation toward any changes in the auditory environment. Moreover, in children with autism, deviancy detection depicted reduced MMN amplitude. In addition in children with autism, contrary to adults with autism, no modulation of the MMN by prosody was present and sensory processing of both neutral and emotional vocal stimuli appeared atypical. Conclusions Overall, change detection remains altered in people with autism. However, differences between children and adults with ASD evidence a trend toward normalization of vocal processing and of the automatic detection of emotion deviancy with age.

A lack of response to voices, and a great interest for music are part of the behavioral expressions, commonly (self-)reported in Autism Spectrum Disorder (ASD). These atypical interests for vocal and musical sounds could be attributable to different levels of acoustical noise, quantified in the harmonic-to-noise ratio (HNR). No previous study has investigated explicit auditory pleasantness in ASD comparing vocal and non-vocal sounds, in relation to acoustic noise level. The aim of this study is to objectively evaluate auditory pleasantness. 16 adults on the autism spectrum and 16 neuro-typical (NT) matched adults rated the likeability of vocal and non-vocal sounds, with varying harmonic-to-noise ratio levels. A group by category interaction in pleasantness judgements revealed that participants on the autism spectrum judged vocal sounds as less pleasant than non-vocal sounds; an effect not found for NT participants. A category by HNR level interaction revealed that participants of both groups rated sounds with a high HNR as more pleasant for non-vocal sounds. A significant group by HNR interaction revealed that people on the autism spectrum tended to judge as less pleasant sounds with high HNR and more pleasant those with low HNR than NT participants. Acoustical noise level of sounds alone does not appear to explain atypical interest for voices and greater interest in music in ASD., (© 2023. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Somatosensory evoked potential (SEP) studies typically characterize short-latency components following median nerve stimulations of the wrist. However, these studies rarely considered 1 ) skin type (glabrous/hairy) at the stimulation site, 2 ) nerve being stimulated, and 3 ) middle-latency (>30 ms) components. Our aim was to investigate middle-latency SEPs following simple mechanical stimulation of two skin types innervated by two different nerves. Eighteen adults received 400 mechanical stimulations over four territories of the right hand (two nerves: radial/median; two skin types: hairy/glabrous skin) while their EEG was recorded. Four middle-latency components were identified: P50, N80, N130, and P200. As expected, significantly shorter latencies and larger amplitudes were found over the contralateral hemisphere for all components. A skin type effect was found for the N80; glabrous skin stimulations induced larger amplitude than hairy skin stimulations. Regarding nerve effects, median stimulations induced larger P50 and N80. Latency of the N80 was longer after median nerve stimulation compared with radial nerve stimulation. This study showed that skin type and stimulated nerve influence middle-latency SEPs, highlighting the importance of considering these parameters in future studies. These modulations could reflect differences in cutaneous receptors and somatotopy. Middle-latency SEPs can be used to evaluate the different steps of tactile information cortical processing. Modulation of SEP components before 100 ms possibly reflects somatotopy and differential processing in primary somatosensory cortex. NEW & NOTEWORTHY The current paper highlights the influences of stimulated skin type (glabrous/hairy) and nerve (median/radial) on cortical somatosensory evoked potentials. Mechanical stimulations were applied over four territories of the right hand in 18 adults. Four middle-latency components were identified: P50, N80, N130, and P200. A larger N80 was found after glabrous skin stimulations than after hairy skin ones, regardless of the nerve being stimulated. P50 and N80 were larger after median than radial nerve stimulations.

Early identification of children on the autism spectrum is crucial for early intervention with long-term positive effects on symptoms and skills. The need for improved objective autism detection tools is emphasized by the poor diagnostic power in current tools. Here, we aim to evaluate the classification performance of acoustic features of the voice in children with autism spectrum disorder (ASD) with respect to a heterogeneous control group (composed of neurotypical children, children with Developmental Language Disorder [DLD] and children with sensorineural hearing loss with Cochlear Implant [CI]). This retrospective diagnostic study was conducted at the Child Psychiatry Unit of Tours University Hospital (France). A total of 108 children, including 38 diagnosed with ASD (8.5 ± 0.25 years), 24 typically developing (TD; 8.2 ± 0.32 years) and 46 children with atypical development (DLD and CI; 7.9 ± 0.36 years) were enrolled in our studies. The acoustic properties of speech samples produced by children in the context of a nonword repetition task were measured. We used a Monte Carlo cross-validation with an ROC (Receiving Operator Characteristic) supervised k-Means clustering algorithm to develop a classification model that can differentially classify a child with an unknown disorder. We showed that voice acoustics classified autism diagnosis with an overall accuracy of 91% [CI95%, 90.40%-91.65%] against TD children, and of 85% [CI95%, 84.5%-86.6%] against an heterogenous group of non-autistic children. Accuracy reported here with multivariate analysis combined with Monte Carlo cross-validation is higher than in previous studies. Our findings demonstrate that easy-to-measure voice acoustic parameters could be used as a diagnostic aid tool, specific to ASD., (© 2023. The Author(s).)

Introduction: The COVID-19 pandemic has imposed to wear a face mask that may have negative consequences for social interactions despite its health benefits. A lot of recent studies focused on emotion recognition of masked faces, as the mouth is, with the eyes, essential to convey emotional content. However, none have studied neurobehavioral and neurophysiological markers of masked faces perception, such as ocular exploration and pupil reactivity. The purpose of this eye tracking study was to quantify how wearing a facial accessory, and in particular a face mask, affected the ocular and pupillary response to a face, emotional or not., Methods: We used videos of actors wearing a facial accessory to characterize the visual exploration and pupillary response in several occlusion (no accessory, sunglasses, scarf, and mask) and emotional conditions (neutral, happy, and sad) in a population of 44 adults., Results: We showed that ocular exploration differed for face covered with an accessory, and in particular a mask, compared to the classical visual scanning pattern of a non-covered face. The covered areas of the face were less explored. Pupil reactivity seemed only slightly affected by the mask, while its sensitivity to emotions was observed even in the presence of a facial accessory., Discussion: These results suggest a mixed impact of the mask on attentional capture and physiological adjustment, which does not seem to be reconcilable with its strong effect on behavioral emotional recognition previously described., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Rabadan, Ricou, Latinus, Aguillon-Hernandez and Wardak.)

With the COVID-19 pandemic, we have become used to wearing masks and have experienced how masks seem to impair emotion and speech recognition. While several studies have focused on facial emotion recognition by adding images of masks on photographs of emotional faces, we have created a video database with actors really wearing masks to test its effect in more ecological conditions. After validating the emotions displayed by the actors, we found that surgical mask impaired happiness and sadness recognition but not neutrality. Moreover, for happiness, this effect was specific to the mask and not to covering the lower part of the face, possibly due to a cognitive bias associated with the surgical mask. We also created videos with speech and tested the effect of mask on emotion and speech recognition when displayed in auditory, visual, or audiovisual modalities. In visual and audiovisual modalities, mask impaired happiness and sadness but improved neutrality recognition. Mask impaired the recognition of bilabial syllables regardless of modality. In addition, it altered speech recognition only in the audiovisual modality for participants above 70 years old. Overall, COVID-19 masks mainly impair emotion recognition, except for older participants for whom it also impacts speech recognition, probably because they rely more on visual information to compensate age-related hearing loss., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Aguillon-Hernandez, Jusiak, Latinus and Wardak.)

Early intervention programs positively affect key behaviors for children with autism spectrum disorder (ASD). However, most of these programs do not target children with severe autistic symptomatology associated with intellectual disability (ID). This study aimed to investigate the psychological and clinical outcomes of children with severe autism and ID enrolled in the Tailored and Inclusive Program for Autism-Tours (TIPA-T). The first step of the TIPA-T is the Exchange and Development Therapy (EDT): an individual neurofunctional intervention consisting of one-to-one exchanges between a child and a therapist taking place in a pared-down environment. It aims to rehabilitate psychophysiological abilities at the roots of social communication through structured sequences of "social play." Cognitive and socio-emotional skills and general development were evaluated with the Social Cognitive Evaluation Battery scale and the Brunet-Lézine Scale-Revised, respectively, before and after 9 months of intervention in 32 children with ASD and ID. Autistic symptomatology was evaluated with the Behavior Summarized Evaluation-Revised scale at five time-points in a subset of 14 children, both in individual and group settings. Statistically significant post-intervention improvements were found in cognitive and socio-emotional skills. All but one child showed improvements in at least one social domain, and 78% of children gained one level in at least four social domains. Twenty-nine children improved in cognitive domains, with 66% of children improving in at least three cognitive domains. Autistic symptomatology evaluated in one-to-one settings significantly decreased with therapy; this reduction was observed in more than 85% of children. In group settings, autistic symptomatology also decreased in more than 60% of children. Global developmental age significantly increased by 3.8 months. The TIPA-T, including EDT in particular, improves socio-emotional skills of most children with ASD and reduces autistic symptomatology, yet with heterogeneous outcomes profiles, in line with the strong heterogeneity of profiles observed in ASD. At the group level, this study highlights the benefits of the TIPA-T for children with severe autism and associated ID. Assessment of autistic core symptoms showed an improvement of social interaction, both in one-to-one and group evaluations, demonstrating the generalizability of the skills learned during the EDT., Competing Interests: J-LA is the author of the SCEB edited in the Pearson France-ECPA. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2021 Blanc, Latinus, Guidotti, Adrien, Roux, Dansart, Barthélémy, Rambault, Bonnet-Brilhault and Malvy.)

Background: Autism spectrum disorder (ASD) is characterized by impaired social communication and interaction, and stereotyped, repetitive behaviour and sensory interests. To date, there is no effective medication that can improve social communication and interaction in ASD, and effect sizes of behaviour-based psychotherapy remain in the low to medium range. Consequently, there is a clear need for new treatment options. ASD is associated with altered activation and connectivity patterns in brain areas which process social information. Transcranial direct current stimulation (tDCS) is a technique that applies a weak electrical current to the brain in order to modulate neural excitability and alter connectivity. Combined with specific cognitive tasks, it allows to facilitate and consolidate the respective training effects. Therefore, application of tDCS in brain areas relevant to social cognition in combination with a specific cognitive training is a promising treatment approach for ASD., Methods: A phase-IIa pilot randomized, double-blind, sham-controlled, parallel-group clinical study is presented, which aims at investigating if 10 days of 20-min multi-channel tDCS stimulation of the bilateral tempo-parietal junction (TPJ) at 2.0 mA in combination with a computer-based cognitive training on perspective taking, intention and emotion understanding, can improve social cognitive abilities in children and adolescents with ASD. The main objectives are to describe the change in parent-rated social responsiveness from baseline (within 1 week before first stimulation) to post-intervention (within 7 days after last stimulation) and to monitor safety and tolerability of the intervention. Secondary objectives include the evaluation of change in parent-rated social responsiveness at follow-up (4 weeks after end of intervention), change in other ASD core symptoms and psychopathology, social cognitive abilities and neural functioning post-intervention and at follow-up in order to explore underlying neural and cognitive mechanisms., Discussion: If shown, positive results regarding change in parent-rated social cognition and favourable safety and tolerability of the intervention will confirm tDCS as a promising treatment for ASD core-symptoms. This may be a first step in establishing a new and cost-efficient intervention for individuals with ASD., Trial Registration: The trial is registered with the German Clinical Trials Register (DRKS), DRKS00014732 . Registered on 15 August 2018., Protocol Version: This study protocol refers to protocol version 1.2 from 24 May 2019.

Background: Faces are crucial social stimuli, eliciting automatic processing associated with increased physiological arousal in observers. The level of arousal can be indexed by pupil diameter (the 'Event-Related Pupil Dilation', ERPD). However, many parameters could influence the arousal evoked by a face and its social saliency (e.g. virtual vs. real, neutral vs. emotional, static vs. dynamic). A few studies have shown an atypical ERPD in autism spectrum disorder (ASD) patients using several kinds of faces but no study has focused on identifying which parameter of the stimulus is the most interfering with face processing in ASD., Methods: In order to disentangle the influence of these parameters, we propose an original paradigm including stimuli along an ecological social saliency gradient: from static objects to virtual faces to dynamic emotional faces. This strategy was applied to 186 children (78 ASD and 108 typically developing (TD) children) in two pupillometric studies (22 ASD and 47 TD children in the study 1 and 56 ASD and 61 TD children in the study 2)., Results: Strikingly, the ERPD in ASD children is insensitive to any of the parameters tested: the ERPD was similar for objects, static faces or dynamic faces. On the opposite, the ERPD in TD children is sensitive to all the parameters tested: the humanoid, biological, dynamic and emotional quality of the stimuli. Moreover, ERPD had a good discriminative power between ASD and TD children: ASD had a larger ERPD than TD in response to virtual faces, while TD had a larger ERPD than ASD for dynamic faces., Conclusions: This novel approach evidences an abnormal physiological adjustment to socially relevant stimuli in ASD., (© 2019 Association for Child and Adolescent Mental Health.)

Autism Spectrum Disorder (ASD) is currently diagnosed by the joint presence of social impairments and restrictive, repetitive patterns of behaviors. While the co-occurrence of these two categories of symptoms is at the core of the pathology, most studies investigated only one dimension to understand underlying physiopathology. In this study, we analyzed brain hemodynamic responses in neurotypical adults (CTRL) and adults with autism spectrum disorder during an oddball paradigm allowing to explore brain responses to vocal changes with different levels of saliency (deviancy or novelty) and different emotional content (neutral, angry). Change detection relies on activation of the supratemporal gyrus and insula and on deactivation of the lingual area. The activity of these brain areas involved in the processing of deviancy with vocal stimuli was modulated by saliency and emotion. No group difference between CTRL and ASD was reported for vocal stimuli processing or for deviancy/novelty processing, regardless of emotional content. Findings highlight that brain processing of voices and of neutral/ emotional vocal changes is typical in adults with ASD. Yet, at the behavioral level, persons with ASD still experience difficulties with those cues. This might indicate impairments at latter processing stages or simply show that alterations present in childhood might have repercussions at adult age., (Copyright © 2020 The Author(s). Published by Elsevier Inc. All rights reserved.)

Atypical sensory behaviours represent a core symptom of autism spectrum disorder (ASD). Investigating early visual processing is crucial to deepen our understanding of higher-level processes. Visual evoked potentials (VEPs) to pattern-reversal checkerboards were recorded in ASD children and age-matched controls. Peak analysis of the P100 component and two types of single-trial analyses were carried out. P100 amplitude was reduced in the ASD group, consistent with previous reports. The analysis of the proportion of trials with a positive activity in the latency range of the P100, measuring inter-trial (in)consistency, allowed identifying two subgroups of ASD participants: the first group, as control children, showed a high inter-trial consistency, whereas the other group showed an inter-trial inconsistency. Analysis of median absolute deviation of single-trial P100 (st-P100) latencies revealed an increased latency variability in the ASD group. Both single-trial analyses revealed increased variability in a subset of children with ASD. To control for this variability, VEPs were reconstructed by including only positive trials or trials with homogeneous st-P100 latencies. These control analyses abolished group differences, confirming that the reduced P100 amplitude results from increased inter-trial variability in ASD. This increased variability in ASD supports the neural noise theory. The existence of subgroups in ASD suggests that the neural response variability is not a genuine characteristic of the entire autistic spectrum, but rather characterized subgroups of children. Exploring the relationship between sensory responsiveness and inter-trial variability could provide more precise bioclinical profiles in children with ASD, and complete the functional diagnostic crucial for the development of individualized therapeutical projects.

Although ASD (Autism Spectrum Disorder) diagnosis requires the co-occurrence of socio-emotional deficits and inflexible behaviors, the interaction between these two domains remains unexplored. We used an emotional Wisconsin Card Sorting Test adapted to fMRI to explore this question. ASD and control participants matched a central card (a face) with one of four surrounding cards according to one of three rules: frame color, facial identity or expression. Feedback informed participants on whether to change or maintain the current sorting rule. For each rule, we modeled feedback onsets to change, switch (confirming the newly found rule) and maintenance events. "Bias error", which measures participants' willingness to switch, was larger in ASD participants for the emotional sorting rule. Brain activity to change events showed no group differences. In response to switch events significantly larger activity was observed for ASD participants in bilateral Inferior Parietal Sulci. Inflexibility in ASD appears characterized by the unwillingness to switch toward processing socio-emotional information, rather than a major disruption in cognitive flexibility. However, a larger activity to switch events in ASD highlights the need for a higher level of certainty before setting into a stable processing stage, which may be particularly detrimental in the highly changeable socio-emotional environment., (Copyright © 2019 Elsevier Inc. All rights reserved.)

A relative indifference to the human voice is a characteristic of Autism Spectrum Disorder (ASD). Yet, studies of voice perception in ASD provided contradictory results: one study described an absence of preferential response to voices in ASD while another reported a larger activation to vocal sounds than environmental sounds, as seen in typically developed (TD) adults. In children with ASD, an absence of preferential response to vocal sounds was attributed to an atypical response to environmental sounds. To have a better understanding of these contradictions, we re-analyzed the data from sixteen children with ASD and sixteen age-matched TD children to evaluate both inter- and intra-subject variability. Intra-subject variability was estimated with a single-trial analysis of electroencephalographic data, through a measure of inter-trial consistency, which is the proportion of trials showing a positive activity in response to vocal and non-vocal sounds. Results demonstrate a larger inter-subject variability in response to non-vocal sounds, driven by a subset of children with ASD (7/16) who do not show the expected negative Tb peak in response to non-vocal sounds around 200 ms after the start of the stimulation due to a reduced inter-trial consistency. A logistic regression model with age and clinical parameters allowed demonstrating that not a single parameter discriminated the subgroups of ASD participants. Yet, the electrophysiologically-based groups differed on a linear combination of parameters. Children with ASD showing a reduced inter-trial consistency were younger and characterized by lower verbal developmental quotient and less attempt to communicate by voice. This data suggests that a lack of specialization for processing social signal may stem from an atypical processing of environmental sounds, linked to the development of general communication abilities. Discrepancy reported in the literature may arise from that heterogeneity and it may be inadequate to divide children with ASD based only on intellectual quotient or language abilities. This analysis could be a useful tool in providing complementary information for the functional diagnostic of ASD and evaluating verbal communication impairment.

Atypical visual exploration of both social and nonsocial scenes is often reported in Autism Spectrum Disorder (ASD) with less precise and longer saccades, potentially reflecting difficulties in oculomotor control. To assess a subset of oculomotor functions in ASD, 20 children with ASD and 21 age-matched typically developing (TD) children (2.6-11.5 years) partook in three tasks of increasing complexity, while no explicit instruction was provided: a prosaccade gap task, a color and a "categorical" visual search tasks (a face among butterflies and vice-versa). In addition to classical saccade metrics, we measured Distance error, (the distance between the target and the closest gaze position) and Time-to-target (the time taken to reach the target). In the prosaccade task, children with ASD were as accurate as TD children, yet faster to reach the stimulus. In the color visual search task, children with ASD were faster but less precise than TD children. In the categorical visual search, while TD children were more precise in orienting their gaze towards the face, children with ASD performed similarly in the two conditions; Time-to-target did not differ. Our results provide contradictory evidence regarding enhanced visual search ability in ASD: when considering response times, enhanced visual search performance was found in one task only, while when considering gaze precision no advantage was found. These three experiments demonstrate that the automatic saccadic system may function more rapidly in children with ASD. Nonetheless, a diminished sensitivity to bottom-up saliency and top-down influence might suppress this advantage in more complex visual environments. Autism Res 2019, 12: 212-224 © 2018 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Three experiments with no instructions were designed to assess oculomotor functions in children with Autism Spectrum Disorder (ASD). In a saccade task, children with ASD were faster than but as accurate as control children. In visual search tasks, accuracy and speed decreased with increasing complexity of visual environment. Children with ASD showed faster automatic visual orientation, but this might hinder exploratory behaviors, leading to difficulties in complex and social situations., (© 2018 International Society for Autism Research, Wiley Periodicals, Inc.)

Background: Autism spectrum disorder (ASD) is characterized by atypical behaviors in social environments and in reaction to changing events. While this dyad of symptoms is at the core of the pathology along with atypical sensory behaviors, most studies have investigated only one dimension. A focus on the sameness dimension has shown that intolerance to change is related to an atypical pre-attentional detection of irregularity. In the present study, we addressed the same process in response to emotional change in order to evaluate the interplay between alterations of change detection and socio-emotional processing in children and adults with autism., Methods: Brain responses to neutral and emotional prosodic deviancies (mismatch negativity (MMN) and P3a, reflecting change detection and orientation of attention toward change, respectively) were recorded in children and adults with autism and in controls. Comparison of neutral and emotional conditions allowed distinguishing between general deviancy and emotional deviancy effects. Moreover, brain responses to the same neutral and emotional stimuli were recorded when they were not deviants to evaluate the sensory processing of these vocal stimuli., Results: In controls, change detection was modulated by prosody: in children, this was characterized by a lateralization of emotional MMN to the right hemisphere, and in adults, by an earlier MMN for emotional deviancy than for neutral deviancy. In ASD, an overall atypical change detection was observed with an earlier MMN and a larger P3a compared to controls suggesting an unusual pre-attentional orientation toward any changes in the auditory environment. Moreover, in children with autism, deviancy detection depicted reduced MMN amplitude. In addition in children with autism, contrary to adults with autism, no modulation of the MMN by prosody was present and sensory processing of both neutral and emotional vocal stimuli appeared atypical., Conclusions: Overall, change detection remains altered in people with autism. However, differences between children and adults with ASD evidence a trend toward normalization of vocal processing and of the automatic detection of emotion deviancy with age.

Voices transmit social signals through speech and/or prosody. Emotional prosody conveys key information about the emotional state of a speaker and is thus a crucial cue that one has to detect in order to develop efficient social communication. Previous studies in adults reported different brain responses to emotional than to neutral prosodic deviancy. The aim of this study was to characterize such specific emotional deviancy effects in school-age children. The mismatch negativity (MMN) and P3a evoked potentials, reflecting automatic change detection and automatic attention orienting, respectively, were obtained for neutral and emotional angry deviants in both school-age children (n = 26) and adults (n = 14). Shorter latencies were found for emotional than for neutral preattentional responses in both groups. However, whereas this effect was observed on the MMN in adults, it appeared in an early discriminative negativity preceding the MMN in children. A smaller P3a amplitude was observed for the emotional than for the neutral deviants at all ages. Overall, the brain responses involved in specific emotional change processing are already present during childhood, but responses have not yet reached an adult pattern. We suggest that these processing differences might contribute to the known improvement of emotional prosody perception between childhood and adulthood.

Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.

Autism and Autism Spectrum Disorder (ASD) cover a large variety of clinical profiles which share two main dimensions: social and communication impairment and repetitive behaviors or restricted interests, which are present during childhood. There is now no doubt that genetic factors are a major component in the etiology of autism but precise physiopathological pathways are still being investigated. Furthermore, developmental trajectories combined with compensatory mechanisms will lead to various clinical and neurophysiological profiles which together constitute this Autism Spectrum Disorder. To better understand the pathophysiology of autism, comprehension of key neurophysiological mechanisms and brain circuits underlying the different bioclinical profiles is thus crucial. To achieve this goal we propose a strategy which investigates different levels of information processing from sensory perception to complex cognitive processing, taking into account the complexity of the stimulus and whether it is social or non-social in nature. In order to identify different developmental trajectories and to take into account compensatory mechanisms, we further propose that such protocols should be carried out in individuals from childhood to adulthood representing a wide variety of clinical forms., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Recovery of stress-induced structural alterations in Posttraumatic Stress Disorder (PTSD) remains largely unexplored. This study aimed to determine whether symptoms improvement is associated with grey matter (GM) density changes of brain structures involved in PTSD. Two groups of PTSD patients were involved in this study. The first group was treated with Eye Movement Desensitization and Reprocessing (EMDR) therapy and recovered from their symptoms (recovery group) (n = 11); Patients were scanned prior to therapy (T1), one week (T2) and five months after the end of therapy (T3). The second group included patients which followed a supportive therapy and remained symptomatic (wait-list group) (n = 7). They were scanned at three time-steps mimicking the same inter-scan intervals. Voxel-based morphometry (VBM) was used to characterize GM density evolution. GM density values showed a significant group-by-time interaction effect between T1 and T3 in prefrontal cortex areas. These interaction effects were driven by a GM density increase in the recovery group with respect to the wait-list group. Symptoms removal goes hand-in-hand with GM density enhancement of structures involved in emotional regulation., (Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.)

The ability to recognize an individual from their voice is a widespread ability with a long evolutionary history. Yet, the perceptual representation of familiar voices is ill-defined. In two experiments, we explored the neuropsychological processes involved in the perception of voice identity. We specifically explored the hypothesis that familiar voices (trained-to-familiar (Experiment 1), and famous voices (Experiment 2)) are represented as a whole complex pattern, well approximated by the average of multiple utterances produced by a single speaker. In experiment 1, participants learned three voices over several sessions, and performed a three-alternative forced-choice identification task on original voice samples and several "speaker averages," created by morphing across varying numbers of different vowels (e.g., [a] and [i]) produced by the same speaker. In experiment 2, the same participants performed the same task on voice samples produced by familiar speakers. The two experiments showed that for famous voices, but not for trained-to-familiar voices, identification performance increased and response times decreased as a function of the number of utterances in the averages. This study sheds light on the perceptual representation of familiar voices, and demonstrates the power of average in recognizing familiar voices. The speaker average captures the unique characteristics of a speaker, and thus retains the information essential for recognition; it acts as a prototype of the speaker.

Background: Individuals with autism spectrum disorder (ASD) show a relative indifference to the human voice. Accordingly, and contrarily to their typically developed peers, adults with autism do not show a preferential response to voices in the superior temporal sulcus; this lack of voice-specific response was previously linked to atypical processing of voices. In electroencephalography, a slow event-related potential (ERP) called the fronto-temporal positivity to voice (FTPV) is larger for vocal than for non-vocal sounds, resulting in a voice-sensitive response over right fronto-temporal sites. Here, we investigated the neurophysiological correlates of voice perception in children with and without ASD., Methods: Sixteen children with autism and 16 age-matched typically developing children heard vocal (speech and non-speech) and non-vocal sounds while their electroencephalographic activity was recorded; overall IQ was smaller in the group of children with ASD. ERP amplitudes were compared using non-parametric statistical tests at each electrode and in successive 20-ms time windows. Within each group, differences between conditions were assessed using a non-parametric Quade test between 0 and 400 ms post-stimulus. Inter-group comparisons of ERP amplitudes were performed using non-paired Kruskal-Wallis tests between 140 and 180 ms post-stimulus., Results: Typically developing children showed the classical voice-sensitive response over right fronto-temporal electrodes, for both speech and non-speech vocal sounds. Children with ASD did not show a preferential response to vocal sounds. Inter-group analysis showed no difference in the processing of vocal sounds, both speech and non-speech, but significant differences in the processing of non-vocal sounds over right fronto-temporal sites., Conclusions: Our results demonstrate a lack of voice-preferential response in children with autism spectrum disorders. In contrast to observations in adults with ASD, the lack of voice-preferential response was attributed to an atypical response to non-vocal sounds, which was overall more similar to the event-related potentials evoked by vocal sounds in both groups. This result suggests atypical maturation processes in ASD impeding the specialization of temporal regions in voice processing.

One thousand one hundred and twenty subjects as well as a developmental phonagnosic subject (KH) along with age-matched controls performed the Glasgow Voice Memory Test, which assesses the ability to encode and immediately recognize, through an old/new judgment, both unfamiliar voices (delivered as vowels, making language requirements minimal) and bell sounds. The inclusion of non-vocal stimuli allows the detection of significant dissociations between the two categories (vocal vs. non-vocal stimuli). The distributions of accuracy and sensitivity scores (d') reflected a wide range of individual differences in voice recognition performance in the population. As expected, KH showed a dissociation between the recognition of voices and bell sounds, her performance being significantly poorer than matched controls for voices but not for bells. By providing normative data of a large sample and by testing a developmental phonagnosic subject, we demonstrated that the Glasgow Voice Memory Test, available online and accessible from all over the world, can be a valid screening tool (~5 min) for a preliminary detection of potential cases of phonagnosia and of "super recognizers" for voices.

Detection of changes in facial emotional expressions is crucial to communicate and to rapidly and automatically process possible threats in the environment. Recent studies suggest that expression-related visual mismatch negativity (vMMN) reflects automatic processing of emotional changes. In the present study we used a controlled paradigm to investigate the specificity of emotional change-detection. In order to disentangle specific responses to emotional deviants from that of neutral deviants, we presented neutral expression as standard stimulus ( p = 0.80) and both angry and neutral expressions as deviants ( p = 0.10, each). In addition to an oddball sequence, an equiprobable sequence was presented, to control for refractoriness and low-level differences. Our results showed that in an early time window (100-200 ms), the controlled vMMN was greater than the oddball vMMN only for the angry deviant, suggesting the importance of controlling for refractoriness and stimulus physical features in emotion related studies. Within the controlled vMMN, angry and neutral deviants both elicited early and late peaks occurring at 140 and 310 ms, respectively, but only the emotional vMMN presented sustained amplitude after each peak. By directly comparing responses to emotional and neutral deviants, our study provides evidence of specific activity reflecting the automatic detection of emotional change. This differs from broader "visual" change processing, and suggests the involvement of two partially-distinct pre-attentional systems in the detection of changes in facial expressions.

Gaze direction, a cue of both social and spatial attention, is known to modulate early neural responses to faces e.g. N170. However, findings in the literature have been inconsistent, likely reflecting differences in stimulus characteristics and task requirements. Here, we investigated the effect of task on neural responses to dynamic gaze changes: away and toward transitions (resulting or not in eye contact). Subjects performed, in random order, social (away/toward them) and non-social (left/right) judgment tasks on these stimuli. Overall, in the non-social task, results showed a larger N170 to gaze aversion than gaze motion toward the observer. In the social task, however, this difference was no longer present in the right hemisphere, likely reflecting an enhanced N170 to gaze motion toward the observer. Our behavioral and event-related potential data indicate that performing social judgments enhances saliency of gaze motion toward the observer, even those that did not result in gaze contact. These data and that of previous studies suggest two modes of processing visual information: a 'default mode' that may focus on spatial information; a 'socially aware mode' that might be activated when subjects are required to make social judgments. The exact mechanism that allows switching from one mode to the other remains to be clarified., (© The Author (2015). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.)

fMRI studies increasingly examine functions and properties of non-primary areas of human auditory cortex. However there is currently no standardized localization procedure to reliably identify specific areas across individuals such as the standard 'localizers' available in the visual domain. Here we present an fMRI 'voice localizer' scan allowing rapid and reliable localization of the voice-sensitive 'temporal voice areas' (TVA) of human auditory cortex. We describe results obtained using this standardized localizer scan in a large cohort of normal adult subjects. Most participants (94%) showed bilateral patches of significantly greater response to vocal than non-vocal sounds along the superior temporal sulcus/gyrus (STS/STG). Individual activation patterns, although reproducible, showed high inter-individual variability in precise anatomical location. Cluster analysis of individual peaks from the large cohort highlighted three bilateral clusters of voice-sensitivity, or "voice patches" along posterior (TVAp), mid (TVAm) and anterior (TVAa) STS/STG, respectively. A series of extra-temporal areas including bilateral inferior prefrontal cortex and amygdalae showed small, but reliable voice-sensitivity as part of a large-scale cerebral voice network. Stimuli for the voice localizer scan and probabilistic maps in MNI space are available for download., (Crown Copyright © 2015. Published by Elsevier Inc. All rights reserved.)

Background: In recent years, analyses of event related potentials/fields have moved from the selection of a few components and peaks to a mass-univariate approach in which the whole data space is analyzed. Such extensive testing increases the number of false positives and correction for multiple comparisons is needed., Method: Here we review all cluster-based correction for multiple comparison methods (cluster-height, cluster-size, cluster-mass, and threshold free cluster enhancement - TFCE), in conjunction with two computational approaches (permutation and bootstrap)., Results: Data driven Monte-Carlo simulations comparing two conditions within subjects (two sample Student's t-test) showed that, on average, all cluster-based methods using permutation or bootstrap alike control well the family-wise error rate (FWER), with a few caveats., Conclusions: (i) A minimum of 800 iterations are necessary to obtain stable results; (ii) below 50 trials, bootstrap methods are too conservative; (iii) for low critical family-wise error rates (e.g. p=1%), permutations can be too liberal; (iv) TFCE controls best the type 1 error rate with an attenuated extent parameter (i.e. power<1)., (Crown Copyright © 2014. Published by Elsevier B.V. All rights reserved.)

Our brains readily decode facial movements and changes in social attention, reflected in earlier and larger N170 event-related potentials (ERPs) to viewing gaze aversions vs. direct gaze in real faces (Puce et al., 2000). In contrast, gaze aversions in line-drawn faces do not produce these N170 differences (Rossi et al., 2014), suggesting that physical stimulus properties or experimental context may drive these effects. Here we investigated the role of stimulus-induced context on neurophysiological responses to dynamic gaze. Sixteen healthy adults viewed line-drawn and real faces, with dynamic eye aversion and direct gaze transitions, and control stimuli (scrambled arrays and checkerboards) while continuous electroencephalographic (EEG) activity was recorded. EEG data from 2 temporo-occipital clusters of 9 electrodes in each hemisphere where N170 activity is known to be maximal were selected for analysis. N170 peak amplitude and latency, and temporal dynamics from Event-Related Spectral Perturbations (ERSPs) were measured in 16 healthy subjects. Real faces generated larger N170s for averted vs. direct gaze motion, however, N170s to real and direct gaze were as large as those to respective controls. N170 amplitude did not differ across line-drawn gaze changes. Overall, bilateral mean gamma power changes for faces relative to control stimuli occurred between 150-350 ms, potentially reflecting signal detection of facial motion. Our data indicate that experimental context does not drive N170 differences to viewed gaze changes. Low-level stimulus properties, such as the high sclera/iris contrast change in real eyes likely drive the N170 changes to viewed aversive movements.

The human voice carries speech as well as important nonlinguistic signals that influence our social interactions. Among these cues that impact our behavior and communication with other people is the perceived emotional state of the speaker. A theoretical framework for the neural processing stages of emotional prosody has suggested that auditory emotion is perceived in multiple steps (Schirmer and Kotz, 2006) involving low-level auditory analysis and integration of the acoustic information followed by higher-level cognition. Empirical evidence for this multistep processing chain, however, is still sparse. We examined this question using functional magnetic resonance imaging and a continuous carry-over design (Aguirre, 2007) to measure brain activity while volunteers listened to non-speech-affective vocalizations morphed on a continuum between anger and fear. Analyses dissociated neuronal adaptation effects induced by similarity in perceived emotional content between consecutive stimuli from those induced by their acoustic similarity. We found that bilateral voice-sensitive auditory regions as well as right amygdala coded the physical difference between consecutive stimuli. In contrast, activity in bilateral anterior insulae, medial superior frontal cortex, precuneus, and subcortical regions such as bilateral hippocampi depended predominantly on the perceptual difference between morphs. Our results suggest that the processing of vocal affect recognition is a multistep process involving largely distinct neural networks. Amygdala and auditory areas predominantly code emotion-related acoustic information while more anterior insular and prefrontal regions respond to the abstract, cognitive representation of vocal affect., (Copyright © 2014 Bestelmeyer et al.)

The integration of emotional information from the face and voice of other persons is known to be mediated by a number of "multisensory" cerebral regions, such as the right posterior superior temporal sulcus (pSTS). However, whether multimodal integration in these regions is attributable to interleaved populations of unisensory neurons responding to face or voice or rather by multimodal neurons receiving input from the two modalities is not fully clear. Here, we examine this question using functional magnetic resonance adaptation and dynamic audiovisual stimuli in which emotional information was manipulated parametrically and independently in the face and voice via morphing between angry and happy expressions. Healthy human adult subjects were scanned while performing a happy/angry emotion categorization task on a series of such stimuli included in a fast event-related, continuous carryover design. Subjects integrated both face and voice information when categorizing emotion-although there was a greater weighting of face information-and showed behavioral adaptation effects both within and across modality. Adaptation also occurred at the neural level: in addition to modality-specific adaptation in visual and auditory cortices, we observed for the first time a crossmodal adaptation effect. Specifically, fMRI signal in the right pSTS was reduced in response to a stimulus in which facial emotion was similar to the vocal emotion of the preceding stimulus. These results suggest that the integration of emotional information from face and voice in the pSTS involves a detectable proportion of bimodal neurons that combine inputs from visual and auditory cortices., (Copyright © 2014 the authors 0270-6474/14/346813-09$15.00/0.)

The functional role of the superior temporal sulcus (STS) has been implicated in a number of studies, including those investigating face perception, voice perception, and face-voice integration. However, the nature of the STS preference for these 'social stimuli' remains unclear, as does the location within the STS for specific types of information processing. The aim of this study was to directly examine properties of the STS in terms of selective response to social stimuli. We used functional magnetic resonance imaging (fMRI) to scan participants whilst they were presented with auditory, visual, or audiovisual stimuli of people or objects, with the intention of localising areas preferring both faces and voices (i.e., 'people-selective' regions) and audiovisual regions designed to specifically integrate person-related information. Results highlighted a 'people-selective, heteromodal' region in the trunk of the right STS which was activated by both faces and voices, and a restricted portion of the right posterior STS (pSTS) with an integrative preference for information from people, as compared to objects. These results point towards the dedicated role of the STS as a 'social-information processing' centre., (Copyright © 2013 Elsevier Ltd. All rights reserved.)

In the everyday environment, affective information is conveyed by both the face and the voice. Studies have demonstrated that a concurrently presented voice can alter the way that an emotional face expression is perceived, and vice versa, leading to emotional conflict if the information in the two modalities is mismatched. Additionally, evidence suggests that incongruence of emotional valence activates cerebral networks involved in conflict monitoring and resolution. However, it is currently unclear whether this is due to task difficulty-that incongruent stimuli are harder to categorize-or simply to the detection of mismatching information in the two modalities. The aim of the present fMRI study was to examine the neurophysiological correlates of processing incongruent emotional information, independent of task difficulty. Subjects were scanned while judging the emotion of face-voice affective stimuli. Both the face and voice were parametrically morphed between anger and happiness and then paired in all audiovisual combinations, resulting in stimuli each defined by two separate values: the degree of incongruence between the face and voice, and the degree of clarity of the combined face-voice information. Due to the specific morphing procedure utilized, we hypothesized that the clarity value, rather than incongruence value, would better reflect task difficulty. Behavioral data revealed that participants integrated face and voice affective information, and that the clarity, as opposed to incongruence value correlated with categorization difficulty. Cerebrally, incongruence was more associated with activity in the superior temporal region, which emerged after task difficulty had been accounted for. Overall, our results suggest that activation in the superior temporal region in response to incongruent information cannot be explained simply by task difficulty, and may rather be due to detection of mismatching information between the two modalities.

Listeners exploit small interindividual variations around a generic acoustical structure to discriminate and identify individuals from their voice-a key requirement for social interactions. The human brain contains temporal voice areas (TVA) involved in an acoustic-based representation of voice identity, but the underlying coding mechanisms remain unknown. Indirect evidence suggests that identity representation in these areas could rely on a norm-based coding mechanism. Here, we show by using fMRI that voice identity is coded in the TVA as a function of acoustical distance to two internal voice prototypes (one male, one female)-approximated here by averaging a large number of same-gender voices by using morphing. Voices more distant from their prototype are perceived as more distinctive and elicit greater neuronal activity in voice-sensitive cortex than closer voices-a phenomenon not merely explained by neuronal adaptation. Moreover, explicit manipulations of distance-to-mean by morphing voices toward (or away from) their prototype elicit reduced (or enhanced) neuronal activity. These results indicate that voice-sensitive cortex integrates relevant acoustical features into a complex representation referenced to idealized male and female voice prototypes. More generally, they shed light on remarkable similarities in cerebral representations of facial and vocal identity., (Copyright © 2013 Elsevier Ltd. All rights reserved.)

Normal listeners effortlessly determine a person's gender by voice, but the cerebral mechanisms underlying this ability remain unclear. Here, we demonstrate 2 stages of cerebral processing during voice gender categorization. Using voice morphing along with an adaptation-optimized functional magnetic resonance imaging design, we found that secondary auditory cortex including the anterior part of the temporal voice areas in the right hemisphere responded primarily to acoustical distance with the previously heard stimulus. In contrast, a network of bilateral regions involving inferior prefrontal and anterior and posterior cingulate cortex reflected perceived stimulus ambiguity. These findings suggest that voice gender recognition involves neuronal populations along the auditory ventral stream responsible for auditory feature extraction, functioning in pair with the prefrontal cortex in voice gender perception.

Social interactions involve more than "just" language. As important is a more primitive nonlinguistic mode of communication acting in parallel with linguistic processes and driving our decisions to a much higher degree than is generally suspected. Amongst the "honest signals" that influence our behavior is perceived vocal attractiveness. Not only does vocal attractiveness reflect important biological characteristics of the speaker, it also influences our social perceptions according to the "what sounds beautiful is good" phenomenon. Despite the widespread influence of vocal attractiveness on social interactions revealed by behavioral studies, its neural underpinnings are yet unknown. We measured brain activity while participants listened to a series of vocal sounds ("ah") and performed an unrelated task. We found that voice-sensitive auditory and inferior frontal regions were strongly correlated with implicitly perceived vocal attractiveness. While the involvement of auditory areas reflected the processing of acoustic contributors to vocal attractiveness ("distance to mean" and spectrotemporal regularity), activity in inferior prefrontal regions (traditionally involved in speech processes) reflected the overall perceived attractiveness of the voices despite their lack of linguistic content. These results suggest the strong influence of hidden nonlinguistic aspects of communication signals on cerebral activity and provide an objective measure of this influence.

The "temporal voice areas" (TVAs; Belin et al., 2000) of the human brain show greater neuronal activity in response to human voices than to other categories of non-vocal sounds. However, a direct link between TVA activity and voice perception behavior has not yet been established. Here we show that a functional magnetic resonance imaging measure of activity in the TVAs predicts individual performance at a separately administered voice memory test. This relation holds when general sound memory ability is taken into account. These findings provide the first evidence that the TVAs are specifically involved in voice cognition.

Gender is salient, socially critical information obtained from faces and voices, yet the brain processes underlying gender discrimination have not been well studied. We investigated neural correlates of gender processing of voices in two ERP studies. In the first, ERP differences were seen between female and male voices starting at 87 ms, in both spatial-temporal and peak analyses, particularly the fronto-central N1 and P2. As pitch differences may drive gender differences, the second study used normal, high- and low-pitch voices. The results of these studies suggested that differences in pitch produced early effects (27-63 ms). Gender effects were seen on N1 (120 ms) with implicit pitch processing (study 1), but were not seen with manipulations of pitch (study 2), demonstrating that N1 was modulated by attention. P2 (between 170 and 230 ms) discriminated male from female voices, independent of pitch. Thus, these data show that there are two stages in voice gender processing; a very early pitch or frequency discrimination and a later more accurate determination of gender at the P2 latency.

Humans can identify individuals from their voice, suggesting the existence of a perceptual representation of voice identity. We used perceptual aftereffects--shifts in perceived stimulus quality after brief exposure to a repeated adaptor stimulus--to further investigate the representation of voice identity in two experiments. Healthy adult listeners were familiarized with several voices until they reached a recognition criterion. They were then tested on identification tasks that used vowel stimuli generated by morphing between the different identities, presented either in isolation (baseline) or following short exposure to different types of voice adaptors (adaptation). Experiment 1 showed that adaptation to a given voice induced categorization shifts away from that adaptor's identity even when the adaptors consisted of vowels different from the probe stimuli. Moreover, original voices and caricatures resulted in comparable aftereffects, ruling out an explanation of identity aftereffects in terms of adaptation to low-level features. In Experiment 2, we show that adaptors with a disrupted configuration, i.e., altered fundamental frequency or formant frequencies, failed to produce perceptual aftereffects showing the importance of the preserved configuration of these acoustical cues in the representation of voices. These two experiments indicate a high-level, dynamic representation of voice identity based on the combination of several lower-level acoustical features into a specific voice configuration.

Temporal voice areas showing a larger activity for vocal than non-vocal sounds have been identified along the superior temporal sulcus (STS); more voice-sensitive areas have been described in frontal and parietal lobes. Yet, the role of voice-sensitive regions in representing voice identity remains unclear. Using a functional magnetic resonance adaptation design, we aimed at disentangling acoustic- from identity-based representations of voices. Sixteen participants were scanned while listening to pairs of voices drawn from morphed continua between 2 initially unfamiliar voices, before and after a voice learning phase. In a given pair, the first and second stimuli could be identical or acoustically different and, at the second session, perceptually similar or different. At both sessions, right mid-STS/superior temporal gyrus (STG) and superior temporal pole (sTP) showed sensitivity to acoustical changes. Critically, voice learning induced changes in the acoustical processing of voices in inferior frontal cortices (IFCs). At the second session only, right IFC and left cingulate gyrus showed sensitivity to changes in perceived identity. The processing of voice identity appears to be subserved by a large network of brain areas ranging from the sTP, involved in an acoustic-based representation of unfamiliar voices, to areas along the convexity of the IFC for identity-related processing of familiar voices.

Voices carry large amounts of socially relevant information on persons, much like 'auditory faces'. Following Bruce and Young (1986)'s seminal model of face perception, we propose that the cerebral processing of vocal information is organized in interacting but functionally dissociable pathways for processing the three main types of vocal information: speech, identity, and affect. The predictions of the 'auditory face' model of voice perception are reviewed in the light of recent clinical, psychological, and neuroimaging evidence., (©2011 The British Psychological Society.)

We used perceptual aftereffects induced by adaptation with anti-voice stimuli to investigate voice identity representations. Participants learned a set of voices then were tested on a voice identification task with vowel stimuli morphed between identities, after different conditions of adaptation. In Experiment 1, participants chose the identity opposite to the adapting anti-voice significantly more often than the other two identities (e.g., after being adapted to anti-A, they identified the average voice as A). In Experiment 2, participants showed a bias for identities opposite to the adaptor specifically for anti-voice, but not for non-anti-voice adaptors. These results are strikingly similar to adaptation aftereffects observed for facial identity. They are compatible with a representation of individual voice identities in a multidimensional perceptual voice space referenced on a voice prototype.

We are all voice experts. First and foremost, we can produce and understand speech, and this makes us a unique species. But in addition to speech perception, we routinely extract from voices a wealth of socially-relevant information in what constitutes a more primitive, and probably more universal, non-linguistic mode of communication. Consider the following example: you are sitting in a plane, and you can hear a conversation in a foreign language in the row behind you. You do not see the speakers' faces, and you cannot understand the speech content because you do not know the language. Yet, an amazing amount of information is available to you. You can evaluate the physical characteristics of the different protagonists, including their gender, approximate age and size, and associate an identity to the different voices. You can form a good idea of the different speaker's mood and affective state, as well as more subtle cues as the perceived attractiveness or dominance of the protagonists. In brief, you can form a fairly detailed picture of the type of social interaction unfolding, which a brief glance backwards can on the occasion help refine - sometimes surprisingly so. What are the acoustical cues that carry these different types of vocal information? How does our brain process and analyse this information? Here we briefly review an emerging field and the main tools used in voice perception research., (Copyright © 2011 Elsevier Ltd. All rights reserved.)

Perception of faces and voices plays a prominent role in human social interaction, making multisensory integration of cross-modal speech a topic of great interest in cognitive neuroscience. How to define potential sites of multisensory integration using functional magnetic resonance imaging (fMRI) is currently under debate, with three statistical criteria frequently used (e.g., super-additive, max and mean criteria). In the present fMRI study, 20 participants were scanned in a block design under three stimulus conditions: dynamic unimodal face, unimodal voice and bimodal face-voice. Using this single dataset, we examine all these statistical criteria in an attempt to define loci of face-voice integration. While the super-additive and mean criteria essentially revealed regions in which one of the unimodal responses was a deactivation, the max criterion appeared stringent and only highlighted the left hippocampus as a potential site of face- voice integration. Psychophysiological interaction analysis showed that connectivity between occipital and temporal cortices increased during bimodal compared to unimodal conditions. We concluded that, when investigating multisensory integration with fMRI, all these criteria should be used in conjunction with manipulation of stimulus signal-to-noise ratio and/or cross-modal congruency., (Koninklijke Brill NV, Leiden, 2011.)

Background: Processing of multimodal information is a critical capacity of the human brain, with classic studies showing bimodal stimulation either facilitating or interfering in perceptual processing. Comparing activity to congruent and incongruent bimodal stimuli can reveal sensory dominance in particular cognitive tasks., Results: We investigated audiovisual interactions driven by stimulus properties (bottom-up influences) or by task (top-down influences) on congruent and incongruent simultaneously presented faces and voices while ERPs were recorded. Subjects performed gender categorisation, directing attention either to faces or to voices and also judged whether the face/voice stimuli were congruent in terms of gender. Behaviourally, the unattended modality affected processing in the attended modality: the disruption was greater for attended voices. ERPs revealed top-down modulations of early brain processing (30-100 ms) over unisensory cortices. No effects were found on N170 or VPP, but from 180-230 ms larger right frontal activity was seen for incongruent than congruent stimuli., Conclusions: Our data demonstrates that in a gender categorisation task the processing of faces dominate over the processing of voices. Brain activity showed different modulation by top-down and bottom-up information. Top-down influences modulated early brain activity whereas bottom-up interactions occurred relatively late.

Vocal attractiveness has a profound influence on listeners-a bias known as the "what sounds beautiful is good" vocal attractiveness stereotype [1]-with tangible impact on a voice owner's success at mating, job applications, and/or elections. The prevailing view holds that attractive voices are those that signal desirable attributes in a potential mate [2-4]-e.g., lower pitch in male voices. However, this account does not explain our preferences in more general social contexts in which voices of both genders are evaluated. Here we show that averaging voices via auditory morphing [5] results in more attractive voices, irrespective of the speaker's or listener's gender. Moreover, we show that this phenomenon is largely explained by two independent by-products of averaging: a smoother voice texture (reduced aperiodicities) and a greater similarity in pitch and timbre with the average of all voices (reduced "distance to mean"). These results provide the first evidence for a phenomenon of vocal attractiveness increases by averaging, analogous to a well-established effect of facial averaging [6, 7]. They highlight prototype-based coding [8] as a central feature of voice perception, emphasizing the similarity in the mechanisms of face and voice perception., (Copyright 2010 Elsevier Ltd. All rights reserved.)

Background: Previous electrophysiological studies have identified a "voice specific response" (VSR) peaking around 320 ms after stimulus onset, a latency markedly longer than the 70 ms needed to discriminate living from non-living sound sources and the 150 ms to 200 ms needed for the processing of voice paralinguistic qualities. In the present study, we investigated whether an early electrophysiological difference between voice and non-voice stimuli could be observed., Results: ERPs were recorded from 32 healthy volunteers who listened to 200 ms long stimuli from three sound categories - voices, bird songs and environmental sounds - whilst performing a pure-tone detection task. ERP analyses revealed voice/non-voice amplitude differences emerging as early as 164 ms post stimulus onset and peaking around 200 ms on fronto-temporal (positivity) and occipital (negativity) electrodes., Conclusion: Our electrophysiological results suggest a rapid brain discrimination of sounds of voice, termed the "fronto-temporal positivity to voices" (FTPV), at latencies comparable to the well-known face-preferential N170.

Cognitive models of face perception suggest parallel levels of processing yet there is little evidence of these levels in studies of brain function. Series of faces that engage different processes ((photographs, schematic and Mooney faces (incomplete two-tone faces)) were presented upright, inverted and scrambled; subjects performed a face/non-face discrimination while event-related potentials (ERPs) were recorded. Different patterns in N170 latency and amplitude provided evidence of multiple steps in face processing, which can be seen at the ERP level. We showed that first-order configural and holistic processing were evident at the N170. N170 latency indexed task difficulty for the upright faces, yet the face inversion effect was independent of difficulty. N170 amplitude inversion effect was unique to photographic faces. Separable ERP effects were found for the processing engaged by the three face types, although the P1 and N170 sources did not differ. Thus, it appears that common brain sources underlie the early processing stages for faces (reflected in the P1 and N170), whereas the P2 showed activation of primary visual areas for the non-photographic faces and reactivation of the same regions as the N170 for the photographic faces.

We investigated the human face specificity by comparing the effects of inversion and contrast reversal, two manipulations known to disrupt configural face processing, on human and ape faces, isolated eyes and objects, using event-related potentials. The face sensitive marker, N170, was shortest to human faces and delayed by inversion and contrast reversal for all categories and not only for human faces. Most importantly, N170 to inverted or contrast-reversed faces was not different from N170 to eyes that did not differ across manipulations. This suggests the disruption of facial configuration by these manipulations isolates the eye region from the face context, to which eye neurons respond. Our data suggest that (i) the inversion and contrast reversal effects on N170 latency are not specific to human faces and (ii) the similar increase of N170 amplitude by inversion and contrast reversal is unique to human faces and is driven by the eye region. Thus, while inversion and contrast reversal effects on N170 latency are not category-specific, their effects on amplitude are face-specific and reflect mainly the contribution of the eye region.

The specialness of faces is seen in the face inversion effect, which disrupts the configural, but not the analytic, processing of faces. Mooney faces, which are processed holistically, allowed us to determine the contribution of holistic processing to the face inversion effect. As inverted Mooney faces are difficult to recognize as faces, we also included an intermediary training period for Mooney face recognition for half of the subjects. Early face-sensitive ERPs (N170 and P1) and P2 were measured. Behavioral data showed an increase in correct responses to inverted and upright Mooney faces after the learning phase for the experimental group. No effects were seen on P1. N170 latency did not vary with stimulus type before the intermediary phase, however, N170 amplitude was consistently larger for upright than inverted Mooney faces. After the intermediary exercise, N170 was delayed for inverted compared to upright Mooney faces. In contrast, for both groups of subjects P2 amplitude was larger for nonface stimuli, and P2 amplitude decreased after the intermediate task only for the subjects trained to recognize Mooney faces. As the usual inversion effect seen with photographic faces (delayed and larger N170) was not seen with Mooney faces, these data suggest that this effect on N170 is due to the recruitment of analytic processing. P2 reflected learning and a deeper processing of the stimuli that were not identifiable as faces.