Search

Multisensory facilitation is known to improve the perceptual performances and reaction times of participants in a wide range of tasks, from detection and discrimination to memorization. We asked whether a multimodal signal can similarly improve action inhibition using the stop-signal paradigm. Indeed, consistent with a crossmodal redundant signal effect that relies on multisensory neuronal integration, the threshold for initiating behavioral responses is known for being reached faster with multisensory stimuli. To evaluate whether this phenomenon also occurs for inhibition, we compared stop signals in unimodal (human faces or voices) versus audiovisual modalities in natural or degraded conditions. In contrast to the expected multisensory facilitation, we observed poorer inhibition efficiency in the audiovisual modality compared with the visual and auditory modalities. This result was corroborated by both response probabilities and stop-signal reaction times. The visual modality (faces) was the most effective. This is the first demonstration of an audiovisual impairment in the domain of perception and action. It suggests that when individuals are engaged in a high-level decisional conflict, bimodal stimulation is not processed as a simple multisensory object improving the performance but is perceived as concurrent visual and auditory information. This absence of unity increases task demand and thus impairs the ability to revise the response.

Modern neuroimaging represents three-dimensional brain activity, which varies across brain regions. It remains unknown whether activity of different brain regions has similar spatial organization to reflect similar cognitive processes. We developed a rotational cross-correlation method allowing a straightforward analysis of spatial activity patterns distributed across the brain in stimulation specific contrast images. Results of this method were verified using several statistical approaches on real and simulated random datasets. We found, for example, that the seed patterns in the fusiform face area were robustly correlated to brain regions involved in face-specific representations. These regions differed from the non-specific visual network meaning that activity structure in the brain is locally preserved in stimulus-specific regions. Our findings indicate spatially correlated perceptual representations in cerebral activity and suggest that the 3D coding of the processed information is organized using locally preserved activity patterns across the brain. More generally, our results demonstrate that information is represented and shared in the local spatial configurations of brain activity.

In children, single-sided deafness (SSD) affects the development of linguistic and social skills and can impede educational progress. These difficulties may relate to cortical changes that occur following SSD, such as reduced inter-hemispheric functional asymmetry and maladaptive brain plasticity. To investigate these neuronal changes and their evolution in children, a non-invasive technique is required that is little affected by motion artifacts. Here, we present a research protocol that uses functional near-infrared spectroscopy (fNIRS) to evaluate the reorganization of cortical auditory asymmetry in children with SSD; it also examines how the cortical changes relate to auditory and language skills. The protocol is designed for children whose SSD has not been treated, because hearing restoration can alter both brain reorganization and behavioral performance. We propose a single-center, cross-sectional study that includes 30 children with SSD (congenital or acquired moderate-to-profound deafness) and 30 children with normal hearing (NH), all aged 5–16 years. The children undergo fNIRS during monaural and binaural stimulation, and the pattern of cortical activity is analyzed using measures of the peak amplitude and area under the curve for both oxy- and deoxyhemoglobin. These cortical measures can be compared between the two groups of children, and analyses can be run to determine whether they relate to binaural hearing (speech-in-noise and sound localization), speech perception and production, and quality of life (QoL). The results could be of relevance for developing individualized rehabilitation programs for SSD, which could reduce patients’ difficulties and prevent long-term neurofunctional and clinical consequences.

This article uses the ideas of neuroenergetic and neural field theories to detect stimulation-driven energy flows in the brain during face and auditory word processing. In this analysis, energy flows are thought to create the stable gradients of the fMRI weighted summary images. The sources, from which activity spreads in the brain during face processing, were detected in the occipital cortex. The following direction of energy flows in the frontal cortex was described: the right inferior frontal = >the left inferior frontal = >the triangular part of the left inferior frontal cortex = >the left operculum. In the left operculum, a localized circuit was described. For auditory word processing, the sources of activity flows were detected bilaterally in the middle superior temporal regions, they were also detected in the left posterior superior temporal cortex. Thus, neuroenergetic assumptions may give a novel perspective for the analysis of neuroimaging data.

The article aims to test the hypothesis that audiovisual integration can improve spatial hearing in monaural conditions when interaural difference cues are not available. We trained one group of subjects with an audiovisual task, where a flash was presented in parallel with the sound and another group in an auditory task, where only sound from different spatial locations was presented. To check whether the observed audiovisual effect was similar to feedback, the third group was trained using the visual feedback paradigm. Training sessions were administered once per day, for 5 days. The performance level in each group was compared for auditory only stimulation on the first and the last day of practice. Improvement after audiovisual training was several times higher than after auditory practice. The group trained with visual feedback demonstrated a different effect of training with the improvement smaller than the group with audiovisual training. We conclude that cross-modal facilitation is highly important to improve spatial hearing in monaural conditions and may be applied to the rehabilitation of patients with unilateral deafness and after unilateral cochlear implantation.