Electro-cortical correlates of multisensory integration using ecologically valid emotional stimuli: Differential effects for fear and disgust

Multisensory integration (MSI) is crucial for human communication and social interaction and has been investigated in healthy populations and neurodevelopmental disorders. However, the use of stimuli with high ecological validity is sparse, especially in event-related potential (ERP) studies. The present study examined the ERP correlates of MSI in healthy adults using short (500 ms) ecologically valid professional actor-produced emotions of fear or disgust as vocal exclamation or facial expression (unimodal conditions) or both (bimodal condition). Behaviourally, our results show a general visual dominance effect (similarly fast responses following bimodal and visual stimuli) and an MSI-related speedup of responses only for fear. Electrophysiologically, both P100 and N170 showed MSI-related amplitude increases only following fear, but not disgust stimuli. Our results show for the first time that the known differential neural processing of fear and disgust also holds for the integration of dynamic auditory and visual information.