Search

Geometric optical illusions (GOIs) are mismatches between physical stimuli and perception. GOIs provide an access point to study the interplay between sensation and perception, Yet, there is relatively scant quantitative investigation of the extent to which different GOIs rely on similar or distinct perceptual mechanisms, which themselves are driven by specific physical properties. We addressed this knowledge gap with a combination of psychophysics and computational modelling. First, 30 healthy adults reported quantitatively their perceptual biases with three GOIs, whose physical properties parametrically varied on a trial-by-trial basis. A given physical property, when considered in isolation, had different effects on perceptual biases depending on the GOI (e.g. the spacing of stimuli affected one GOI, but not another). For a given GOI, there were oftentimes interactions between the effects of different physical properties. Next, we used these psychophysical results to tune a computational model of primary visual cortex that combines parameters of orientation selectivity, receptive-field size, intra-cortical connectivity, and long-range interactions. We showed that similar biases generated in-silico mirror those observed in human behavior when receptive field size, bandwidth and shape (rounded or elongated) are tuned, as well as parameters encoding the strength of the long-range intra-regional interactions between receptive fields. Collectively, our results suggest that different physical properties are not operating independently, but rather synergistically, to generate a GOI. Such results provide a roadmap whereby computational modelling, informed by human psychophysics, can reveal likely mechanistic underpinnings of perception., Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (© 2024 The Author(s).)

Interactions between stimuli from different sensory modalities and their integration are central to daily life, contributing to improved perception. Being born prematurely and the subsequent hospitalization can have an impact not only on sensory processes, but also on the manner in which information from different senses is combined-i.e., multisensory processes. Very preterm (VPT) children (<32 weeks gestational age) present impaired multisensory processes in early childhood persisting at least through the age of five. However, it remains largely unknown whether and how these consequences persist into later childhood. Here, we evaluated the integrity of auditory-visual multisensory processes in VPT schoolchildren. VPT children (N = 28; aged 8-10 years) received a standardized cognitive assessment and performed a simple detection task at their routine follow-up appointment. The simple detection task involved pressing a button as quickly as possible upon presentation of an auditory, visual, or simultaneous audio-visual stimulus. Compared to full-term (FT) children (N = 23; aged 6-11 years), reaction times of VPT children were generally slower and more variable, regardless of sensory modality. Nonetheless, both groups exhibited multisensory facilitation on mean reaction times and inter-quartile ranges. There was no evidence that standardized cognitive or clinical measures correlated with multisensory gains of VPT children. However, while gains in FT children exceeded predictions based on probability summation and thus forcibly invoked integrative processes, this was not the case for VPT children. Our findings provide evidence of atypical multisensory profiles in VPT children persisting into school-age. These results could help in targeting supportive interventions for this vulnerable population., (© 2024. The Author(s).)

More than 10% of births are preterm, and the long-term consequences on sensory and semantic processing of non-linguistic information remain poorly understood. 17 very preterm-born children (born at < 33 weeks gestational age) and 15 full-term controls were tested at 10 years old with an auditory object recognition task, while 64-channel auditory evoked potentials (AEPs) were recorded. Sounds consisted of living (animal and human vocalizations) and manmade objects (e.g. household objects, instruments, and tools). Despite similar recognition behavior, AEPs strikingly differed between full-term and preterm children. Starting at 50ms post-stimulus onset, AEPs from preterm children differed topographically from their full-term counterparts. Over the 108-224ms post-stimulus period, full-term children showed stronger AEPs in response to living objects, whereas preterm born children showed the reverse pattern; i.e. stronger AEPs in response to manmade objects. Differential brain activity between semantic categories could reliably classify children according to their preterm status. Moreover, this opposing pattern of differential responses to semantic categories of sounds was also observed in source estimations within a network of occipital, temporal and frontal regions. This study highlights how early life experience in terms of preterm birth shapes sensory and object processing later on in life., (© 2023. The Author(s).)

A recent study has used scalp-recorded electroencephalography to obtain evidence of semantic processing of human speech and objects by domesticated dogs. The results suggest that dogs do comprehend the meaning of familiar spoken words, in that a word can evoke the mental representation of the object to which it refers., Competing Interests: Declaration of interests The authors declare no competing interests., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments., (© 2023. The Author(s).)

Objectives: The objective of this study was to investigate whether a brief speech-in-noise training with a remote microphone (RM) system (favorable listening condition) would contribute to enhanced post-training plasticity changes in the auditory system of school-age children., Design: Before training, event-related potentials (ERPs) were recorded from 49 typically developing children, who actively identified two syllables in quiet and in noise (+5 dB signal-to-noise ratio [SNR]). During training, children completed the same syllable identification task as in the pre-training noise condition, but received feedback on their performance. Following random assignment, half of the sample used an RM system during training (experimental group), while the other half did not (control group). That is, during training' children in the experimental group listened to a more favorable speech signal (+15 dB SNR) than children from the control group (+5 dB SNR). ERPs were collected after training at +5 dB SNR to evaluate the effects of training with and without the RM system. Electrical neuroimaging analyses quantified the effects of training in each group on ERP global field power (GFP) and topography, indexing response strength and network changes, respectively. Behavioral speech-perception-in-noise skills of children were also evaluated and compared before and after training. We hypothesized that training with the RM system (experimental group) would lead to greater enhancement of GFP and greater topographical changes post-training than training without the RM system (control group). We also expected greater behavioral improvement on the speech-perception-in-noise task when training with than without the RM system., Results: GFP was enhanced after training only in the experimental group. These effects were observed on early time-windows corresponding to traditional P1-N1 (100 to 200 msec) and P2-N2 (200 to 400 msec) ERP components. No training effects were observed on response topography. Finally, both groups increased their speech-perception-in-noise skills post-training., Conclusions: Enhanced GFP after training with the RM system indicates plasticity changes in the neural representation of sound resulting from listening to an enriched auditory signal. Further investigation of longer training or auditory experiences with favorable listening conditions is needed to determine if that results in long-term speech-perception-in-noise benefits., (Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.)

Functional magnetic resonance imaging (fMRI) is a methodological cornerstone of neuroscience. Most studies measure blood-oxygen-level-dependent (BOLD) signal using echo-planar imaging (EPI), Cartesian sampling, and image reconstruction with a one-to-one correspondence between the number of acquired volumes and reconstructed images. However, EPI schemes are subject to trade-offs between spatial and temporal resolutions. We overcome these limitations by measuring BOLD with a gradient recalled echo (GRE) with 3D radial-spiral phyllotaxis trajectory at a high sampling rate (28.24ms) on standard 3T field-strength. The framework enables the reconstruction of 3D signal time courses with whole-brain coverage at simultaneously higher spatial (1mm 3 ) and temporal (up to 250ms) resolutions, as compared to optimized EPI schemes. Additionally, artifacts are corrected before image reconstruction; the desired temporal resolution is chosen after scanning and without assumptions on the shape of the hemodynamic response. By showing activation in the calcarine sulcus of 20 participants performing an ON-OFF visual paradigm, we demonstrate the reliability of our method for cognitive neuroscience research.

Introduction: Food cravings are common in pregnancy and along with emotional eating and eating in the absence of hunger, they are associated with excessive weight gain and adverse effects on metabolic health including gestational diabetes mellitus (GDM). Women with GDM also show poorer mental health, which further can contribute to dysregulated eating behaviour. Food cravings can lead to greater activity in brain centres known to be involved in food 'wanting' and reward valuation as well as emotional eating. They are also related to gestational weight gain. Thus, there is a great need to link implicit brain responses to food with explicit measures of food intake behaviour, especially in the perinatal period. The aim of this study is to investigate the spatiotemporal brain dynamics to visual presentations of food in women during pregnancy and in the post partum, and link these brain responses to the eating behaviour and metabolic health outcomes in women with and without GDM., Methods and Analysis: This prospective observational study will include 20 women with and 20 without GDM, that have valid data for the primary outcomes. Data will be assessed at 24-36 weeks gestational age and at 6 months post partum. The primary outcomes are brain responses to food pictures of varying carbohydrate and fat content during pregnancy and in the post partum using electroencephalography. Secondary outcomes including depressive symptoms, current mood and eating behaviours will be assessed with questionnaires, objective eating behaviours will be measured using Auracle and stress will be measured with heart rate and heart rate variability (Actiheart). Other secondary outcome measures include body composition and glycaemic control parameters., Ethics and Dissemination: The Human Research Ethics Committee of the Canton de Vaud approved the study protocol (2021-01976). Study results will be presented at public and scientific conferences and in peer-reviewed journals., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY. Published by BMJ.)

The ability to process speech in noise (SPiN) declines with age, with a detrimental impact on life quality. Music-making activities such as singing and playing a musical instrument have raised interest as potential prevention strategies for SPiN perception decline because of their positive impact on several brain system, especially the auditory system, which is critical for SPiN. However, the literature on the effect of musicianship on SPiN performance has yielded mixed results. By critically assessing the existing literature with a systematic review and a meta-analysis, we aim to provide a comprehensive portrait of the relationship between music-making activities and SPiN in different experimental conditions. 38/49 articles, most focusing on young adults, were included in the quantitative analysis. The results show a positive relationship between music-making activities and SPiN, with the strongest effects found in the most challenging listening conditions, and little to no effect in less challenging situations. This pattern of results supports the notion of a relative advantage for musicians on SPiN performance and clarify the scope of this effect. However, further studies, especially with older adults, using adequate randomization methods, are needed to extend the present conclusions and assess the potential for musical activities to be used to mitigate SPiN decline in seniors., Competing Interests: Pascale Tremblay reports financial support was provided in the form of a research grant by the 10.13039/501100000038Natural Sciences and Engineering Research Council of Canada., (© 2023 The Authors.)

How functional magnetic resonance imaging (fMRI) data are analyzed depends on the researcher and the toolbox used. It is not uncommon that the processing pipeline is rewritten for each new dataset. Consequently, code transparency, quality control and objective analysis pipelines are important for improving reproducibility in neuroimaging studies. Toolboxes, such as Nipype and fMRIPrep, have documented the need for and interest in automated pre-processing analysis pipelines. Recent developments in data-driven models combined with high resolution neuroimaging dataset have strengthened the need not only for a standardized preprocessing workflow, but also for a reliable and comparable statistical pipeline. Here, we introduce fMRIflows: a consortium of fully automatic neuroimaging pipelines for fMRI analysis, which performs standard preprocessing, as well as 1st- and 2nd-level univariate and multivariate analyses. In addition to the standardized pre-processing pipelines, fMRIflows provides flexible temporal and spatial filtering to account for datasets with increasingly high temporal resolution and to help appropriately prepare data for advanced machine learning analyses, improving signal decoding accuracy and reliability. This paper first describes fMRIflows' structure and functionality, then explains its infrastructure and access, and lastly validates the toolbox by comparing it to other neuroimaging processing pipelines such as fMRIPrep, FSL and SPM. This validation was performed on three datasets with varying temporal sampling and acquisition parameters to prove its flexibility and robustness. fMRIflows is a fully automatic fMRI processing pipeline which uniquely offers univariate and multivariate single-subject and group analyses as well as pre-processing., (© 2022. The Author(s).)

Hearing with a cochlear implant (CI) is limited compared to natural hearing. Although CI users may develop compensatory strategies, it is currently unknown whether these extend from auditory to visual functions, and whether compensatory strategies vary between different CI user groups. To better understand the experience-dependent contributions to multisensory plasticity in audiovisual speech perception, the current event-related potential (ERP) study presented syllables in auditory, visual, and audiovisual conditions to CI users with unilateral or bilateral hearing loss, as well as to normal-hearing (NH) controls. Behavioural results revealed shorter audiovisual response times compared to unisensory conditions for all groups. Multisensory integration was confirmed by electrical neuroimaging, including topographic and ERP source analysis, showing a visual modulation of the auditory-cortex response at N1 and P2 latency. However, CI users with bilateral hearing loss showed a distinct pattern of N1 topography, indicating a stronger visual impact on auditory speech processing compared to CI users with unilateral hearing loss and NH listeners. Furthermore, both CI user groups showed a delayed auditory-cortex activation and an additional recruitment of the visual cortex, and a better lip-reading ability compared to NH listeners. In sum, these results extend previous findings by showing distinct multisensory processes not only between NH listeners and CI users in general, but even between CI users with unilateral and bilateral hearing loss. However, the comparably enhanced lip-reading ability and visual-cortex activation in both CI user groups suggest that these visual improvements are evident regardless of the hearing status of the contralateral ear., Competing Interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (© 2022 The Authors.)

Dashboard-mounted touchscreen tablets are now common in vehicles. Screen/phone use in cars likely shifts drivers' attention away from the road and contributes to risk of accidents. Nevertheless, vision is subject to multisensory influences from other senses. Haptics may help maintain or even increase visual attention to the road, while still allowing for reliable dashboard control. Here, we provide a proof-of-concept for the effectiveness of digital haptic technologies (hereafter digital haptics), which use ultrasonic vibrations on a tablet screen to render haptic perceptions. Healthy human participants (N = 25) completed a divided-attention paradigm. The primary task was a centrally-presented visual conjunction search task, and the secondary task entailed control of laterally-presented sliders on the tablet. Sliders were presented visually, haptically, or visuo-haptically and were vertical, horizontal or circular. We reasoned that the primary task would be performed best when the secondary task was haptic-only. Reaction times (RTs) on the visual search task were fastest when the tablet task was haptic-only. This was not due to a speed-accuracy trade-off; there was no evidence for modulation of VST accuracy according to modality of the tablet task. These results provide the first quantitative support for introducing digital haptics into vehicle and similar contexts., (© 2022. The Author(s).)

Background and Objective: Eye-movement trajectories are rich behavioral data, providing a window on how the brain processes information. We address the challenge of characterizing signs of visuo-spatial neglect from saccadic eye trajectories recorded in brain-damaged patients with spatial neglect as well as in healthy controls during a visual search task., Methods: We establish a standardized pre-processing pipeline adaptable to other task-based eye-tracker measurements. We use traditional machine learning algorithms together with deep convolutional networks (both 1D and 2D) to automatically analyze eye trajectories., Results: Our top-performing machine learning models classified neglect patients vs. healthy individuals with an Area Under the ROC curve (AUC) ranging from 0.83 to 0.86. Moreover, the 1D convolutional neural network scores correlated with the degree of severity of neglect behavior as estimated with standardized paper-and-pencil tests and with the integrity of white matter tracts measured from Diffusion Tensor Imaging (DTI). Interestingly, the latter showed a clear correlation with the third branch of the superior longitudinal fasciculus (SLF), especially damaged in neglect., Conclusions: The study introduces new methods for both the pre-processing and the classification of eye-movement trajectories in patients with neglect syndrome. The proposed methods can likely be applied to other types of neurological diseases opening the possibility of new computer-aided, precise, sensitive and non-invasive diagnostic tools., Competing Interests: Declaration of Competing Interest The authors certify that they have no financial and personal relationships with other people or organisations that could inappropriately influence the present work. Manuscript title: “Machine learning algorithms on eye tracking trajectories to classify patients with spatial neglect” The authors (Benedetta Franceschiello, Tommaso Di Noto, Alexia Bourgeois, Micah M. Murray, Astrid Minier, Pierre Pouget, Jonas Richiardi, Paolo Bartolomeo, Fabio Anselmi) certify that they have no financial and personal relationships with other people or organisations that could inappropriately influence the present work., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Early detection and intervention in schizophrenia requires mechanism-based biomarkers that capture neural circuitry dysfunction, allowing better patient stratification, monitoring of disease progression and treatment. In prefrontal cortex and blood of redox dysregulated mice (Gclm-KO ± GBR), oxidative stress induces miR-137 upregulation, leading to decreased COX6A2 and mitophagy markers (NIX, Fundc1, and LC3B) and to accumulation of damaged mitochondria, further exacerbating oxidative stress and parvalbumin interneurons (PVI) impairment. MitoQ, a mitochondria-targeted antioxidant, rescued all these processes. Translating to early psychosis patients (EPP), blood exosomal miR-137 increases and COX6A2 decreases, combined with mitophagy markers alterations, suggest that observations made centrally and peripherally in animal model were reflected in patients' blood. Higher exosomal miR-137 and lower COX6A2 levels were associated with a reduction of ASSR gamma oscillations in EEG. As ASSR requires proper PVI-related networks, alterations in miR-137/COX6A2 plasma exosome levels may represent a proxy marker of PVI cortical microcircuit impairment. EPP can be stratified in two subgroups: (a) a patients' group with mitochondrial dysfunction "Psy-D", having high miR-137 and low COX6A2 levels in exosomes, and (b) a "Psy-ND" subgroup with no/low mitochondrial impairment, including patients having miR-137 and COX6A2 levels in the range of controls. Psy-D patients exhibited more impaired ASSR responses in association with worse psychopathological status, neurocognitive performance, and global and social functioning, suggesting that impairment of PVI mitochondria leads to more severe disease profiles. This stratification would allow, with high selectivity and specificity, the selection of patients for treatments targeting brain mitochondria dysregulation and capture the clinical and functional efficacy of future clinical trials., (© 2021. The Author(s).)

In naturalistic situations, sounds are often perceived in conjunction with matching visual impressions. For example, we see and hear the neighbor's dog barking in the garden. Still, there is a good chance that we recognize the neighbor's dog even when we only hear it barking, but do not see it behind the fence. Previous studies with normal-hearing (NH) listeners have shown that the audio-visual presentation of a perceptual object (like an animal) increases the probability to recognize this object later on, even if the repeated presentation of this object occurs in a purely auditory condition. In patients with a cochlear implant (CI), however, the electrical hearing of sounds is impoverished, and the ability to recognize perceptual objects in auditory conditions is significantly limited. It is currently not well understood whether CI users - as NH listeners - show a multisensory facilitation for auditory recognition. The present study used event-related potentials (ERPs) and a continuous recognition paradigm with auditory and audio-visual stimuli to test the prediction that CI users show a benefit from audio-visual perception. Indeed, the congruent audio-visual context resulted in an improved recognition ability of objects in an auditory-only condition, both in the NH listeners and the CI users. The ERPs revealed a group-specific pattern of voltage topographies and correlations between these ERP maps and the auditory recognition ability, indicating a different processing of congruent audio-visual stimuli in CI users when compared to NH listeners. Taken together, our results point to distinct cortical processing of naturalistic audio-visual objects in CI users and NH listeners, which however allows both groups to improve the recognition ability of these objects in a purely auditory context. Our findings are of relevance for future clinical research since audio-visual perception might also improve the auditory rehabilitation after cochlear implantation., (Copyright © 2022 The Authors. Published by Elsevier Inc. All rights reserved.)

Electroencephalography (EEG) is among the most widely diffused, inexpensive, and adopted neuroimaging techniques. Nonetheless, EEG requires measurements against a reference site(s), which is typically chosen by the experimenter, and specific pre-processing steps precede analyses. It is therefore valuable to obtain quantities that are minimally affected by reference and pre-processing choices. Here, we show that the topological structure of embedding spaces, constructed either from multi-channel EEG timeseries or from their temporal structure, are subject-specific and robust to re-referencing and pre-processing pipelines. By contrast, the shape of correlation spaces, that is, discrete spaces where each point represents an electrode and the distance between them that is in turn related to the correlation between the respective timeseries, was neither significantly subject-specific nor robust to changes of reference. Our results suggest that the shape of spaces describing the observed configurations of EEG signals holds information about the individual specificity of the underlying individual's brain dynamics, and that temporal correlations constrain to a large degree the set of possible dynamics. In turn, these encode the differences between subjects' space of resting state EEG signals. Finally, our results and proposed methodology provide tools to explore the individual topographical landscapes and how they are explored dynamically. We propose therefore to augment conventional topographic analyses with an additional-topological-level of analysis, and to consider them jointly. More generally, these results provide a roadmap for the incorporation of topological analyses within EEG pipelines., (© 2021. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

A cochlear implant (CI) is an auditory prosthesis which can partially restore the auditory function in patients with severe to profound hearing loss. However, this bionic device provides only limited auditory information, and CI patients may compensate for this limitation by means of a stronger interaction between the auditory and visual system. To better understand the electrophysiological correlates of audiovisual speech perception, the present study used electroencephalography (EEG) and a redundant target paradigm. Postlingually deafened CI users and normal-hearing (NH) listeners were compared in auditory, visual and audiovisual speech conditions. The behavioural results revealed multisensory integration for both groups, as indicated by shortened response times for the audiovisual as compared to the two unisensory conditions. The analysis of the N1 and P2 event-related potentials (ERPs), including topographic and source analyses, confirmed a multisensory effect for both groups and showed a cortical auditory response which was modulated by the simultaneous processing of the visual stimulus. Nevertheless, the CI users in particular revealed a distinct pattern of N1 topography, pointing to a strong visual impact on auditory speech processing. Apart from these condition effects, the results revealed ERP differences between CI users and NH listeners, not only in N1/P2 ERP topographies, but also in the cortical source configuration. When compared to the NH listeners, the CI users showed an additional activation in the visual cortex at N1 latency, which was positively correlated with CI experience, and a delayed auditory-cortex activation with a reversed, rightward functional lateralisation. In sum, our behavioural and ERP findings demonstrate a clear audiovisual benefit for both groups, and a CI-specific alteration in cortical activation at N1 latency when auditory and visual input is combined. These cortical alterations may reflect a compensatory strategy to overcome the limited CI input, which allows the CI users to improve the lip-reading skills and to approximate the behavioural performance of NH listeners in audiovisual speech conditions. Our results are clinically relevant, as they highlight the importance of assessing the CI outcome not only in auditory-only, but also in audiovisual speech conditions., (Copyright © 2022 The Authors. Published by Elsevier Inc. All rights reserved.)

Research on attentional control has largely focused on single senses and the importance of behavioural goals in controlling attention. However, everyday situations are multisensory and contain regularities, both likely influencing attention. We investigated how visual attentional capture is simultaneously impacted by top-down goals, the multisensory nature of stimuli, and the contextual factors of stimuli's semantic relationship and temporal predictability. Participants performed a multisensory version of the Folk et al. (1992) spatial cueing paradigm, searching for a target of a predefined colour (e.g. a red bar) within an array preceded by a distractor. We manipulated: 1) stimuli's goal-relevance via distractor's colour (matching vs. mismatching the target), 2) stimuli's multisensory nature (colour distractors appearing alone vs. with tones), 3) the relationship between the distractor sound and colour (arbitrary vs. semantically congruent) and 4) the temporal predictability of distractor onset. Reaction-time spatial cueing served as a behavioural measure of attentional selection. We also recorded 129-channel event-related potentials (ERPs), analysing the distractor-elicited N2pc component both canonically and using a multivariate electrical neuroimaging framework. Behaviourally, arbitrary target-matching distractors captured attention more strongly than semantically congruent ones, with no evidence for context modulating multisensory enhancements of capture. Notably, electrical neuroimaging of surface-level EEG analyses revealed context-based influences on attention to both visual and multisensory distractors, in how strongly they activated the brain and type of activated brain networks. For both processes, the context-driven brain response modulations occurred long before the N2pc time-window, with topographic (network-based) modulations at ∼30 ms, followed by strength-based modulations at ∼100 ms post-distractor onset. Our results reveal that both stimulus meaning and predictability modulate attentional selection, and they interact while doing so. Meaning, in addition to temporal predictability, is thus a second source of contextual information facilitating goal-directed behaviour. More broadly, in everyday situations, attention is controlled by an interplay between one's goals, stimuli's perceptual salience, meaning and predictability. Our study calls for a revision of attentional control theories to account for the role of contextual and multisensory control., (Copyright © 2021. Published by Elsevier Inc.)

Upper extremity (UE) impairments in infants with cerebral palsy (CP) result from reduced quality of motor experiences and "noisy" sensory inputs. We hypothesized that a neuroscience-based multi-component intervention would improve somatosensory processing and motor measures of more-affected (UEs) in infants with CP and asymmetric UE neurologic impairments, while remaining safe for less-affected UEs. Our randomized controlled trial compared infants (6-24 months) with CP receiving intervention (N = 37) versus a waitlisted group (N = 36). Treatment effects tested a direct measurement of reach smoothness (3D-kinematics), a measure of unimanual fine motor function (Bayley unimanual fine motor raw scores), and EEG measures of cortical somatosensory processing. The four-week therapist-directed, parent-administered intervention included daily (1) bimanual play; (2) less-affected UE wearing soft-constraint (6 h/day, electronically-monitored); (3) reach training on more-affected UE; (4) graduated motor-sensory training; and (5) parent education. Waitlist infants received only bimanual play. Effectiveness and safety were tested; z-scores from 54 posttest-matched typically-developing infants provided benchmarks for treatment effects. Intervention and waitlist infants had no pretest differences. Median weekly constraint wear was 38 h; parent-treatment fidelity averaged > 92%. On the more affected side, the intervention significantly increased smoothness of reach (Cohen's d = - 0.90; p < .001) and unimanual fine motor skill (d = 0.35; p = .004). Using unadjusted p values, intervention improved somatosensory processing (d = 0.53; p = .04). All intervention effects referenced well to typically developing children. Safety of the intervention was demonstrated through positive- or non-effects on measurements involving the constrained, less-affected UE and gross motor function; unexpected treatment effects on reach smoothness occurred in less-affected UEs (d =  - 0.85; p = .01). This large clinical trial demonstrated intervention effectiveness and safety for developing sensory and motor systems with improvements in reach smoothness, and developmental abilities.Clinical Trail Registration: ClinicalTrials.gov NCT02567630, registered October 5, 2015.

Eye motion is a major confound for magnetic resonance imaging (MRI) in neuroscience or ophthalmology. Currently, solutions toward eye stabilisation include participants fixating or administration of paralytics/anaesthetics. We developed a novel MRI protocol for acquiring 3-dimensional images while the eye freely moves. Eye motion serves as the basis for image reconstruction, rather than an impediment. We fully reconstruct videos of the moving eye and head. We quantitatively validate data quality with millimetre resolution in two ways for individual participants. First, eye position based on reconstructed images correlated with simultaneous eye-tracking. Second, the reconstructed images preserve anatomical properties; the eye's axial length measured from MRI images matched that obtained with ocular biometry. The technique operates on a standard clinical setup, without necessitating specialized hardware, facilitating wide deployment. In clinical practice, we anticipate that this may help reduce burdens on both patients and infrastructure, by integrating multiple varieties of assessments into a single comprehensive session. More generally, our protocol is a harbinger for removing the necessity of fixation, thereby opening new opportunities for ethologically-valid, naturalistic paradigms, the inclusion of populations typically unable to stably fixate, and increased translational research such as in awake animals whose eye movements constitute an accessible behavioural readout., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

Multisensory processes include the capacity to combine information from the different senses, often improving stimulus representations and behavior. The extent to which multisensory processes are an innate capacity or instead require experience with environmental stimuli remains debated. We addressed this knowledge gap by studying multisensory processes in prematurely born and full-term infants. We recorded 128-channel event-related potentials (ERPs) from a cohort of 55 full-term and 61 preterm neonates (at an equivalent gestational age) in response to auditory, somatosensory, and combined auditory-somatosensory multisensory stimuli. Data were analyzed within an electrical neuroimaging framework, involving unsupervised topographic clustering of the ERP data. Multisensory processing in full-term infants was characterized by a simple linear summation of responses to auditory and somatosensory stimuli alone, which furthermore shared common ERP topographic features. We refer to the ERP topography observed in full-term infants as "typical infantile processing" (TIP). In stark contrast, preterm infants exhibited non-linear responses and topographies less-often characterized by TIP; there were distinct patterns of ERP topographies to multisensory and summed unisensory conditions. We further observed that the better TIP characterized an infant's ERPs, independently of prematurity, the more typical was the score on the Infant/Toddler Sensory Profile (ITSP) at 12 months of age and the less likely was the child to the show internalizing tendencies at 24 months of age. Collectively, these results highlight striking differences in the brain's responses to multisensory stimuli in children born prematurely; differences that relate to later sensory and internalizing functions.

There is ongoing debate regarding the extent to which human cortices are specialized for processing a given sensory input versus a given type of information, independently of the sensory source. Many neuroimaging and electrophysiological studies have reported that primary and extrastriate visual cortices respond to tactile and auditory stimulation, in addition to visual inputs, suggesting these cortices are intrinsically multisensory. In particular for tactile responses, few studies have proven neuronal processes in visual cortex in humans. Here, we assessed tactile responses in both low-level and extrastriate visual cortices using electrocorticography recordings in a human participant. Specifically, we observed significant spectral power increases in the high frequency band (30-100 Hz) in response to tactile stimuli, reportedly associated with spiking neuronal activity, in both low-level visual cortex (i.e. V2) and in the anterior part of the lateral occipital-temporal cortex. These sites were both involved in processing tactile information and responsive to visual stimulation. More generally, the present results add to a mounting literature in support of task-sensitive and sensory-independent mechanisms underlying functions like spatial, motion, and self-processing in the brain and extending from higher-level as well as to low-level cortices.

Objects are the fundamental building blocks of how we create a representation of the external world. One major distinction among objects is between those that are animate versus those that are inanimate. In addition, many objects are specified by more than a single sense, yet the nature by which multisensory objects are represented by the brain remains poorly understood. Using representational similarity analysis of male and female human EEG signals, we show enhanced encoding of audiovisual objects when compared with their corresponding visual and auditory objects. Surprisingly, we discovered that the often-found processing advantages for animate objects were not evident under multisensory conditions. This was due to a greater neural enhancement of inanimate objects-which are more weakly encoded under unisensory conditions. Further analysis showed that the selective enhancement of inanimate audiovisual objects corresponded with an increase in shared representations across brain areas, suggesting that the enhancement was mediated by multisensory integration. Moreover, a distance-to-bound analysis provided critical links between neural findings and behavior. Improvements in neural decoding at the individual exemplar level for audiovisual inanimate objects predicted reaction time differences between multisensory and unisensory presentations during a Go/No-Go animate categorization task. Links between neural activity and behavioral measures were most evident at intervals of 100-200 ms and 350-500 ms after stimulus presentation, corresponding to time periods associated with sensory evidence accumulation and decision-making, respectively. Collectively, these findings provide key insights into a fundamental process the brain uses to maximize the information it captures across sensory systems to perform object recognition. SIGNIFICANCE STATEMENT Our world is filled with ever-changing sensory information that we are able to seamlessly transform into a coherent and meaningful perceptual experience. We accomplish this feat by combining different stimulus features into objects. However, despite the fact that these features span multiple senses, little is known about how the brain combines the various forms of sensory information into object representations. Here, we used EEG and machine learning to study how the brain processes auditory, visual, and audiovisual objects. Surprisingly, we found that nonliving (i.e., inanimate) objects, which are more difficult to process with one sense alone, benefited the most from engaging multiple senses., (Copyright © 2020 the authors.)

Contemporary schemas of brain organization now include multisensory processes both in low-level cortices as well as at early stages of stimulus processing. Evidence has also accumulated showing that unisensory stimulus processing can result in cross-modal effects. For example, task-irrelevant and lateralised sounds can activate visual cortices; a phenomenon referred to as the auditory-evoked contralateral occipital positivity (ACOP). Some claim this is an example of automatic attentional capture in visual cortices. Other results, however, indicate that context may play a determinant role. Here, we investigated whether selective attention to spatial features of sounds is a determining factor in eliciting the ACOP. We recorded high-density auditory evoked potentials (AEPs) while participants selectively attended and discriminated sounds according to four possible stimulus attributes: location, pitch, speaker identity or syllable. Sound acoustics were held constant, and their location was always equiprobable (50% left, 50% right). The only manipulation was to which sound dimension participants attended. We analysed the AEP data from healthy participants within an electrical neuroimaging framework. The presence of sound-elicited activations of visual cortices depended on the to-be-discriminated, goal-based dimension. The ACOP was elicited only when participants were required to discriminate sound location, but not when they attended to any of the non-spatial features. These results provide a further indication that the ACOP is not automatic. Moreover, our findings showcase the interplay between task-relevance and spatial (un)predictability in determining the presence of the cross-modal activation of visual cortices., Competing Interests: Declaration of competing interest Authors report no conflict of interest., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

Illusory contours (ICs) are borders that are perceived in the absence of contrast gradients. Until recently, IC processes were considered exclusively visual in nature and presumed to be unaffected by information from other senses. Electrophysiological data in humans indicates that sounds can enhance IC processes. Despite cross-modal enhancement being observed at the neurophysiological level, to date there is no evidence of direct amplification of behavioural performance in IC processing by sounds. We addressed this knowledge gap. Healthy adults ( n = 15) discriminated instances when inducers were arranged to form an IC from instances when no IC was formed (NC). Inducers were low-constrast and masked, and there was continuous background acoustic noise throughout a block of trials. On half of the trials, i.e., independently of IC vs NC, a 1000-Hz tone was presented synchronously with the inducer stimuli. Sound presence improved the accuracy of indicating when an IC was presented, but had no impact on performance with NC stimuli (significant IC presence/absence × Sound presence/absence interaction). There was no evidence that this was due to general alerting or to a speed-accuracy trade-off (no main effect of sound presence on accuracy rates and no comparable significant interaction on reaction times). Moreover, sound presence increased sensitivity and reduced bias on the IC vs NC discrimination task. These results demonstrate that multisensory processes augment mid-level visual functions, exemplified by IC processes. Aside from the impact on neurobiological and computational models of vision, our findings may prove clinically beneficial for low-vision or sight-restored patients.

Grid cells in the entorhinal cortex, together with head direction, place, speed and border cells, are major contributors to the organization of spatial representations in the brain. In this work we introduce a novel theoretical and algorithmic framework able to explain the optimality of hexagonal grid-like response patterns. We show that this pattern is a result of minimal variance encoding of neurons together with maximal robustness to neurons' noise and minimal number of encoding neurons. The novelty lies in the formulation of the encoding problem considering neurons as an overcomplete basis (a frame) where the position information is encoded. Through the modern Frame Theory language, specifically that of tight and equiangular frames, we provide new insights about the optimality of hexagonal grid receptive fields. The proposed model is based on the well-accepted and tested hypothesis of Hebbian learning, providing a simplified cortical-based framework that does not require the presence of velocity-driven oscillations (oscillatory model) or translational symmetries in the synaptic connections (attractor model). We moreover demonstrate that the proposed encoding mechanism naturally explains axis alignment of neighbor grid cells and maps shifts, rotations and scaling of the stimuli onto the shape of grid cells' receptive fields, giving a straightforward explanation of the experimental evidence of grid cells remapping under transformations of environmental cues.

In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0°, 90°, 180°, or 270° rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0° resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation., (Copyright © 2020 Tivadar, Chappaz, Anaflous, Roche and Murray.)

The capacity to integrate information from different senses is central for coherent perception across the lifespan from infancy onwards. Later in life, multisensory processes are related to cognitive functions, such as speech or social communication. During learning, multisensory processes can in fact enhance subsequent recognition memory for unisensory objects. These benefits can even be predicted; adults' recognition memory performance is shaped by earlier responses in the same task to multisensory - but not unisensory - information. Everyday environments where learning occurs, such as classrooms, are inherently multisensory in nature. Multisensory processes may therefore scaffold healthy cognitive development. Here, we provide the first evidence of a predictive relationship between multisensory benefits in simple detection and higher-level cognition that is present already in schoolchildren. Multiple regression analyses indicated that the extent to which a child (N = 68; aged 4.5-15years) exhibited multisensory benefits on a simple detection task not only predicted benefits on a continuous recognition task involving naturalistic objects (p = 0.009), even when controlling for age, but also the same relative multisensory benefit also predicted working memory scores (p = 0.023) and fluid intelligence scores (p = 0.033) as measured using age-standardised test batteries. By contrast, gains in unisensory detection did not show significant prediction of any of the above global cognition measures. Our findings show that low-level multisensory processes predict higher-order memory and cognition already during childhood, even if still subject to ongoing maturation. These results call for revision of traditional models of cognitive development (and likely also education) to account for the role of multisensory processing, while also opening exciting opportunities to facilitate early learning through multisensory programs. More generally, these data suggest that a simple detection task could provide direct insights into the integrity of global cognition in schoolchildren and could be further developed as a readily-implemented and cost-effective screening tool for neurodevelopmental disorders, particularly in cases when standard neuropsychological tests are infeasible or unavailable.

Among all of the stimuli surrounding us, food is arguably the most rewarding for the essential role it plays in our survival. In previous visual recognition research, it has already been demonstrated that the brain not only differentiates edible stimuli from non-edible stimuli but also is endowed with the ability to detect foods' idiosyncratic properties such as energy content. Given the contribution of the cooked diet to human evolution, in the present study we investigated whether the brain is sensitive to the level of processing food underwent, based solely on its visual appearance. We thus recorded visual evoked potentials (VEPs) from normal-weight healthy volunteers who viewed color images of unprocessed and processed foods equated in caloric content. Results showed that VEPs and underlying neural sources differed as early as 130 ms post-image onset when participants viewed unprocessed versus processed foods, suggesting a within-category early discrimination of food stimuli. Responses to unprocessed foods engaged the inferior frontal and temporal regions and the premotor cortices. In contrast, viewing processed foods led to the recruitment of occipito-temporal cortices bilaterally, consistently with other motivationally relevant stimuli. This is the first evidence of diverging brain responses to food as a function of the transformation undergone during its preparation that provides insights on the spatiotemporal dynamics of food recognition., (© 2019 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Time is a fundamental dimension of everyday experiences. We can unmistakably sense its passage and adjust our behavior accordingly. Despite its ubiquity, the neuronal mechanisms underlying the capacity to perceive time remains unclear. Here, in two experiments using ultrahigh-field 7-Tesla (7T) functional magnetic resonance imaging (fMRI), we show that in the medial premotor cortex (supplementary motor area [SMA]) of the human brain, neural units tuned to different durations are orderly mapped in contiguous portions of the cortical surface so as to form chronomaps. The response of each portion in a chronomap is enhanced by neighboring durations and suppressed by nonpreferred durations represented in distant portions of the map. These findings suggest duration-sensitive tuning as a possible neural mechanism underlying the recognition of time and demonstrate, for the first time, that the representation of an abstract feature such as time can be instantiated by a topographical arrangement of duration-sensitive neural populations., Competing Interests: The authors have declared that no competing interests exist.

Background: Premature infants are at risk for abnormal sensory development due to brain immaturity at birth and atypical early sensory experiences in the Neonatal Intensive Care Unit. This altered sensory development can have downstream effects on other more complex developmental processes. There are currently no interventions that address rehabilitation of sensory function in the neonatal period., Methods: This study is a randomized controlled trial of preterm infants enrolled at 32-36 weeks postmenstrual age to either standard care or standard care plus multisensory intervention in order to study the effect of multisensory intervention as compared to standard care alone. The study population will consist of 100 preterm infants in each group (total n = 200). Both groups will receive standard care, consisting of non-contingent recorded parent's voice and skin-to-skin by parent. The multisensory group will also receive contemporaneous holding and light pressure containment for tactile stimulation, playing of the mother's voice contingent on the infant's pacifier sucking for auditory stimulation, exposure to a parent-scented cloth for olfactory stimulation, and exposure to carefully regulated therapist breathing that is mindful and responsive to the child's condition for vestibular stimulation. The primary outcome is a brain-based measure of multisensory processing, measured using time locked-EEG. Secondary outcomes include sensory adaptation, tactile processing, speech sound differentiation, motor and language function, measured at one and two years corrected gestational age., Discussion: This is the first randomized controlled trial of a multisensory intervention using brain-based measurements in order to explain the causal effects of the multisensory intervention on neural processing changes to mediate neurodevelopmental outcomes in former preterm infants. In addition to contributing a critical link in our understanding of these processes, the protocolized multisensory intervention in this study is therapist administered, parent supported and leverages simple technology. Thus, this multisensory intervention has the potential to be widely implemented in various NICU settings, with the opportunity to potentially improve neurodevelopment of premature infants., Trial Registration: NIH Clinical Trials ( clinicaltrials.gov ): NCT03232931 . Registered July 2017.

Sensory substitution is an effective means to rehabilitate many visual functions after visual impairment or blindness. Tactile information, for example, is particularly useful for functions such as reading, mental rotation, shape recognition, or exploration of space. Extant haptic technologies typically rely on real physical objects or pneumatically driven renderings and thus provide a limited library of stimuli to users. New developments in digital haptic technologies now make it possible to actively simulate an unprecedented range of tactile sensations. We provide a proof-of-concept for a new type of technology (hereafter haptic tablet) that renders haptic feedback by modulating the friction of a flat screen through ultrasonic vibrations of varying shapes to create the sensation of texture when the screen is actively explored. We reasoned that participants should be able to create mental representations of letters presented in normal and mirror-reversed haptic form without the use of any visual information and to manipulate such representations in a mental rotation task. Healthy sighted, blindfolded volunteers were trained to discriminate between two letters (either L and P, or F and G; counterbalanced across participants) on a haptic tablet. They then tactually explored all four letters in normal or mirror-reversed form at different rotations (0°, 90°, 180°, and 270°) and indicated letter form (i.e., normal or mirror-reversed) by pressing one of two mouse buttons. We observed the typical effect of rotation angle on object discrimination performance (i.e., greater deviation from 0° resulted in worse performance) for trained letters, consistent with mental rotation of these haptically-rendered objects. We likewise observed generally slower and less accurate performance with mirror-reversed compared to prototypically oriented stimuli. Our findings extend existing research in multisensory object recognition by indicating that a new technology simulating active haptic feedback can support the generation and spatial manipulation of mental representations of objects. Thus, such haptic tablets can offer a new avenue to mitigate visual impairments and train skills dependent on mental object-based representations and their spatial manipulation.

Most evidence on the neural and perceptual correlates of sensory processing derives from studies that have focused on only a single sensory modality and averaged the data from groups of participants. Although valuable, such studies ignore the substantial interindividual and intraindividual differences that are undoubtedly at play. Such variability plays an integral role in both the behavioral/perceptual realms and in the neural correlates of these processes, but substantially less is known when compared with group-averaged data. Recently, it has been shown that the presentation of stimuli from two or more sensory modalities (i.e., multisensory stimulation) not only results in the well-established performance gains but also gives rise to reductions in behavioral and neural response variability. To better understand the relationship between neural and behavioral response variability under multisensory conditions, this study investigated both behavior and brain activity in a task requiring participants to discriminate moving versus static stimuli presented in either a unisensory or multisensory context. EEG data were analyzed with respect to intraindividual and interindividual differences in RTs. The results showed that trial-by-trial variability of RTs was significantly reduced under audiovisual presentation conditions as compared with visual-only presentations across all participants. Intraindividual variability of RTs was linked to changes in correlated activity between clusters within an occipital to frontal network. In addition, interindividual variability of RTs was linked to differential recruitment of medial frontal cortices. The present findings highlight differences in the brain networks that support behavioral benefits during unisensory versus multisensory motion detection and provide an important view into the functional dynamics within neuronal networks underpinning intraindividual performance differences.

In real-world environments, information is typically multisensory, and objects are a primary unit of information processing. Object recognition and action necessitate attentional selection of task-relevant from among task-irrelevant objects. However, the brain and cognitive mechanisms governing these processes remain not well understood. Here, we demonstrate that attentional selection of visual objects is controlled by integrated top-down audiovisual object representations ("attentional templates") while revealing a new brain mechanism through which they can operate. In multistimulus (visual) arrays, attentional selection of objects in humans and animal models is traditionally quantified via "the N2pc component": spatially selective enhancements of neural processing of objects within ventral visual cortices at approximately 150-300 msec poststimulus. In our adaptation of Folk et al.'s [Folk, C. L., Remington, R. W., & Johnston, J. C. Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 18, 1030-1044, 1992] spatial cueing paradigm, visual cues elicited weaker behavioral attention capture and an attenuated N2pc during audiovisual versus visual search. To provide direct evidence for the brain, and so, cognitive, mechanisms underlying top-down control in multisensory search, we analyzed global features of the electrical field at the scalp across our N2pcs. In the N2pc time window (170-270 msec), color cues elicited brain responses differing in strength and their topography. This latter finding is indicative of changes in active brain sources. Thus, in multisensory environments, attentional selection is controlled via integrated top-down object representations, and so not only by separate sensory-specific top-down feature templates (as suggested by traditional N2pc analyses). We discuss how the electrical neuroimaging approach can aid research on top-down attentional control in naturalistic, multisensory settings and on other neurocognitive functions in the growing area of real-world neuroscience.

Electroencephalography (EEG) is the non-invasive measurement of the brain's electric fields. Electrodes placed on the scalp record voltage potentials resulting from current flow in and around neurons. EEG is nearly a century old: this long history has afforded EEG a rich and diverse spectrum of applications. On the one hand, foundations of EEG in clinical diagnostics have dovetailed more recently into brain-triggered neurorehabilitation treatments. On the other hand, EEG has not only been a workhorse for providing brain correlates of constructs in the field of experimental psychology, but has also been used as a true neuroimaging method with more recent extensions in translational as well as computational neuroscience. The versatility and accessibility of the technique, in combination with advances in signal processing, allow for this 'old dog' to still deliver new tricks and innovations., (Copyright © 2018 Elsevier Ltd. All rights reserved.)

The perception of an acoustic rhythm is invariant to the absolute temporal intervals constituting a sound sequence. It is unknown where in the brain temporal Gestalt, the percept emerging from the relative temporal proximity between acoustic events, is encoded. Two different relative temporal patterns, each induced by three experimental conditions with different absolute temporal patterns as sensory basis, were presented to participants. A linear support vector machine classifier was trained to differentiate activation patterns in functional magnetic resonance imaging data to the two different percepts. Across the sensory constituents the classifier decoded which percept was perceived. A searchlight analysis localized activation patterns specific to the temporal Gestalt bilaterally to the temporoparietal junction, including the planum temporale and supramarginal gyrus, and unilaterally to the right inferior frontal gyrus (pars opercularis). We show that auditory areas not only process absolute temporal intervals, but also integrate them into percepts of Gestalt and that encoding of these percepts persists in high-level associative areas. The findings complement existing knowledge regarding the processing of absolute temporal patterns to the processing of relative temporal patterns relevant to the sequential binding of perceptual elements into Gestalt.

Very premature children (<33 weeks of gestational age (GA)) experience greater academic difficulties and have lower, though normal-range, intelligence quotients (IQs) versus their full-term peers. These differences are often attributed to GA or familial socio-economic status (SES). However, additional factors are increasingly recognized as likely contributors. Parental stress after a child's premature birth can present as post-traumatic stress disorder (PTSD) symptoms and can in turn reinforce difficulties in parent-child interaction pattern. Following a longitudinal design, we studied the interplay between a premature child's perinatal history and maternal PTSD symptoms on intelligence abilities assessed at 11 years of age. Thirty-three very preterm and 21 full-term mother-children dyads partook in the study. Children's perinatal risk was evaluated at hospital discharge, maternal PTSD symptoms were assessed when the children were 18 months old, and children's IQ was measured at 11 years old. IQ was significantly lower for preterm than full-term children, without reliable influences from perinatal risk scores. However, lower maternal PTSD symptoms predicted higher IQ in preterm children. This preliminary study highlights the importance detecting maternal PTSD symptoms after a preterm birth and suggests interventions should target reducing maternal PTSD symptoms during early childhood to enhance very preterm children's intelligence development.

Cerebral palsy (CP) is predominantly a disorder of movement, with evidence of sensory-motor dysfunction. CIMT 1 is a widely used treatment for hemiplegic CP. However, effects of CIMT on somatosensory processing remain unclear. To examine potential CIMT-induced changes in cortical tactile processing, we designed a prospective study, during which 10 children with hemiplegic CP (5 to 8 years old) underwent an intensive one-week-long nonremovable hard-constraint CIMT. Before and directly after the treatment, we recorded their cortical event-related potential (ERP) responses to calibrated light touch (versus a control stimulus) at the more and less affected hand. To provide insights into the core neurophysiological deficits in light touch processing in CP as well as into the plasticity of this function following CIMT, we analyzed the ERPs within an electrical neuroimaging framework. After CIMT, brain areas governing the more affected hand responded to touch in configurations similar to those activated by the hemisphere controlling the less affected hand before CIMT. This was in contrast to the affected hand where configurations resembled those of the more affected hand before CIMT. Furthermore, dysfunctional patterns of brain activity, identified using hierarchical ERP cluster analyses, appeared reduced after CIMT in proportion with changes in sensory-motor measures (grip or pinch movements). These novel results suggest recovery of functional sensory activation as one possible mechanism underlying the effectiveness of intensive constraint-based therapy on motor functions in the more affected upper extremity in CP. However, maladaptive effects on the less affected constrained extremity may also have occurred. Our findings also highlight the use of electrical neuroimaging as feasible methodology to measure changes in tactile function after treatment even in young children, as it does not require active participation.

Illusory contours (ICs) are perceptions of visual borders despite absent contrast gradients. The psychophysical and neurobiological mechanisms of IC processes have been studied across species and diverse brain imaging/mapping techniques. Nonetheless, debate continues regarding whether IC sensitivity results from a (presumably) feedforward process within low-level visual cortices (V1/V2) or instead are processed first within higher-order brain regions, such as lateral occipital cortices (LOC). Studies in animal models, which generally favour a feedforward mechanism within V1/V2, have typically involved stimuli inducing IC lines. By contrast, studies in humans generally favour a mechanism where IC sensitivity is mediated by LOC and have typically involved stimuli inducing IC forms or shapes. Thus, the particular stimulus features used may strongly contribute to the model of IC sensitivity supported. To address this, we recorded visual evoked potentials (VEPs) while presenting human observers with an array of 10 inducers within the central 5°, two of which could be oriented to induce an IC line on a given trial. VEPs were analysed using an electrical neuroimaging framework. Sensitivity to the presence vs. absence of centrally-presented IC lines was first apparent at ∼200 ms post-stimulus onset and was evident as topographic differences across conditions. We also localized these differences to the LOC. The timing and localization of these effects are consistent with a model of IC sensitivity commencing within higher-level visual cortices. We propose that prior observations of effects within lower-tier cortices (V1/V2) are the result of feedback from IC sensitivity that originates instead within higher-tier cortices (LOC)., (Copyright © 2018 Elsevier Inc. All rights reserved.)

Everyday vision includes the detection of stimuli, figure-ground segregation, as well as object localization and recognition. Such processes must often surmount impoverished or noisy conditions; borders are perceived despite occlusion or absent contrast gradients. These illusory contours (ICs) are an example of so-called mid-level vision, with an event-related potential (ERP) correlate at ∼100-150 ms post-stimulus onset and originating within lateral-occipital cortices (the IC effect ). Presently, visual completion processes supporting IC perception are considered exclusively visual; any influence from other sensory modalities is currently unknown. It is now well-established that multisensory processes can influence both low-level vision (e.g. detection) as well as higher-level object recognition. By contrast, it is unknown if mid-level vision exhibits multisensory benefits and, if so, through what mechanisms. We hypothesized that sounds would impact the IC effect . We recorded 128-channel ERPs from 17 healthy, sighted participants who viewed ICs or no-contour (NC) counterparts either in the presence or absence of task-irrelevant sounds. The IC effect was enhanced by sounds and resulted in the recruitment of a distinct configuration of active brain areas over the 70-170 ms post-stimulus period. IC-related source-level activity within the lateral occipital cortex (LOC), inferior parietal lobe (IPL), as well as primary visual cortex (V1) were enhanced by sounds. Moreover, the activity in these regions was correlated when sounds were present, but not when absent. Results from a control experiment, which employed amodal variants of the stimuli, suggested that sounds impact the perceived brightness of the IC rather than shape formation per se. We provide the first demonstration that multisensory processes augment mid-level vision and everyday visual completion processes, and that one of the mechanisms is brightness enhancement. These results have important implications for the design of treatments and/or visual aids for low-vision patients., (Copyright © 2018 Elsevier Inc. All rights reserved.)

Distinct anatomical and functional pathways are postulated for analysing a sound's object-related ('what') and space-related ('where') information. It remains unresolved to which extent distinct or overlapping neural resources subserve specific object-related dimensions (i.e. who is speaking and what is being said can both be derived from the same acoustic input). To address this issue, we recorded high-density auditory evoked potentials (AEPs) while participants selectively attended and discriminated sounds according to their pitch, speaker identity, uttered syllable ('what' dimensions) or their location ('where'). Sound acoustics were held constant across blocks; the only manipulation involved the sound dimension that participants had to attend to. The task-relevant dimension was varied across blocks. AEPs from healthy participants were analysed within an electrical neuroimaging framework to differentiate modulations in response strength from modulations in response topography; the latter of which forcibly follow from changes in the configuration of underlying sources. There were no behavioural differences in discrimination of sounds across the 4 feature dimensions. As early as 90ms post-stimulus onset, AEP topographies differed across 'what' conditions, supporting a functional sub-segregation within the auditory 'what' pathway. This study characterises the spatio-temporal dynamics of segregated, yet parallel, processing of multiple sound object-related feature dimensions when selective attention is directed to them., (Copyright © 2018 Elsevier Inc. All rights reserved.)

Multisensory information typically confers neural and behavioural advantages over unisensory information. We used a simple audio-visual detection task to compare healthy young (HY), healthy older (HO) and mild-cognitive impairment (MCI) individuals. Neuropsychological tests assessed individuals' learning and memory impairments. First, we provide much-needed clarification regarding the presence of enhanced multisensory benefits in both healthily and abnormally aging individuals. The pattern of sensory dominance shifted with healthy and abnormal aging to favour a propensity of auditory-dominant behaviour (i.e., detecting sounds faster than flashes). Notably, multisensory benefits were larger only in healthy older than younger individuals who were also visually-dominant. Second, we demonstrate that the multisensory detection task offers benefits as a time- and resource-economic MCI screening tool. Receiver operating characteristic (ROC) analysis demonstrated that MCI diagnosis could be reliably achieved based on the combination of indices of multisensory integration together with indices of sensory dominance. Our findings showcase the importance of sensory profiles in determining multisensory benefits in healthy and abnormal aging. Crucially, our findings open an exciting possibility for multisensory detection tasks to be used as a cost-effective screening tool. These findings clarify relationships between multisensory and memory functions in aging, while offering new avenues for improved dementia diagnostics.

Whether non-nutritive sweetener (NNS) consumption impacts food intake behavior in humans is still unclear. Discrepant sensory and metabolic signals are proposed to mislead brain regulatory centers, in turn promoting maladaptive food choices favoring weight gain. We aimed to assess whether ingestion of sucrose- and NNS-sweetened drinks would differently alter brain responses to food viewing and food intake. Eighteen normal-weight men were studied in a fasted condition and after consumption of a standardized meal accompanied by either a NNS-sweetened (NNS), or a sucrose-sweetened (SUC) drink, or water (WAT). Their brain responses to visual food cues were assessed by means of electroencephalography (EEG) before and 45 min after meal ingestion. Four hours after meal ingestion, spontaneous food intake was monitored during an ad libitum buffet. With WAT, meal intake led to increased neural activity in the dorsal prefrontal cortex and the insula, areas linked to cognitive control and interoception. With SUC, neural activity in the insula increased as well, but decreased in temporal regions linked to food categorization, and remained unchanged in dorsal prefrontal areas. The latter modulations were associated with a significantly lower total energy intake at buffet (mean kcal ± SEM; 791 ± 62) as compared to WAT (942 ± 71) and NNS (917 ± 70). In contrast to WAT and SUC, NNS consumption did not impact activity in the insula, but led to increased neural activity in ventrolateral prefrontal regions linked to the inhibition of reward. Total energy intake at the buffet was not significantly different between WAT and NNS. Our findings highlight the differential impact of caloric and non-caloric sweeteners on subsequent brain responses to visual food cues and energy intake. These variations may reflect an initial stage of adaptation to taste-calorie uncoupling, and could be indicative of longer-term consequences of repeated NNS consumption on food intake behavior., Competing Interests: L.T. has received speaker’s honoraria from Nestlé, Switzerland; Soremartec srl, Italy; and the Gatorade Sport Science Institute, USA. The other authors have no conflict of interest to disclose. The funding sponsors had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

Sensory impairments constitute core dysfunctions in schizophrenia. In the auditory modality, impaired mismatch negativity (MMN) has been observed in chronic schizophrenia and may reflect N-methyl-d-aspartate (NMDA) hypo-function, consistent with models of schizophrenia based on oxidative stress. Moreover, a recent study demonstrated deficits in the N100 component of the auditory evoked potential (AEP) in early psychosis patients. Previous work has shown that add-on administration of the glutathione precursor N-acetyl-cysteine (NAC) improves the MMN and clinical symptoms in chronic schizophrenia. To date, it remains unknown whether NAC also improves general low-level auditory processing and if its efficacy would extend to early-phase psychosis. We addressed these issues with a randomized, double-blind study of a small sample (N=15) of early psychosis (EP) patients and 18 healthy controls from whom AEPs were recorded during an active, auditory oddball task. Patients were recorded twice: once prior to NAC/placebo administration and once after six months of treatment. The N100 component was significantly smaller in patients before NAC administration versus controls. Critically, NAC administration improved this AEP deficit. Source estimations revealed increased activity in the left temporo-parietal lobe in patients after NAC administration. Overall, the data from this pilot study, which call for replication in a larger sample, indicate that NAC improves low-level auditory processing in early psychosis., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Carriers of the rare 22q11.2 microdeletion present with a high percentage of positive and negative symptoms and a high genetic risk for schizophrenia. Visual processing impairments have been characterized in schizophrenia, but less so in 22q11.2 Deletion Syndrome (DS). Here, we focus on visual processing using high-density EEG and source imaging in 22q11.2DS participants (N = 25) and healthy controls (N = 26) with an illusory contour discrimination task. Significant differences between groups emerged at early and late stages of visual processing. In 22q11.2DS, we first observed reduced amplitudes over occipital channels and reduced source activations within dorsal and ventral visual stream areas during the P1 (100-125 ms) and within ventral visual cortex during the N1 (150-170 ms) visual evoked components. During a later window implicated in visual completion (240-285 ms), we observed an increase in global amplitudes in 22q11.2DS. The increased surface amplitudes for illusory contours at this window were inversely correlated with positive subscales of prodromal symptoms in 22q11.2DS. The reduced activity of ventral and dorsal visual areas during early stages points to an impairment in visual processing seen both in schizophrenia and 22q11.2DS. During intervals related to perceptual closure, the inverse correlation of high amplitudes with positive symptoms suggests that participants with 22q11.2DS who show an increased brain response to illusory contours during the relevant window for contour processing have less psychotic symptoms and might thus be at a reduced prodromal risk for schizophrenia.

Patients diagnosed with schizophrenia often present with low-level sensory deficits. It is an open question whether there is a functional link between these deficits and the pathophysiology of the disease, e.g. oxidative stress and glutathione (GSH) metabolism dysregulation. Auditory evoked potentials (AEPs) were recorded from 21 psychosis disorder patients and 30 healthy controls performing an active, auditory oddball task. AEPs to standard sounds were analyzed within an electrical neuroimaging framework. A peripheral measure of participants' redox balance, the ratio of glutathione peroxidase and glutathione reductase activities (GPx/GR), was correlated with the AEP data. Patients displayed significantly decreased AEPs over the time window of the P50/N100 complex resulting from significantly weaker responses in the left temporo-parietal lobe. The GPx/GR ratio significantly correlated with patients' brain activity during the time window of the P50/N100 in the medial frontal lobe. We show for the first time a direct coupling between electrophysiological indices of AEPs and peripheral redox dysregulation in psychosis patients. This coupling is limited to stages of auditory processing that are impaired relative to healthy controls and suggests a link between biochemical and sensory dysfunction. The data highlight the potential of low-level sensory processing as a trait-marker of psychosis., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Space is a dimension shared by different modalities, but at what stage spatial encoding is affected by multisensory processes is unclear. Early studies observed attenuation of N1/P2 auditory evoked responses following repetition of sounds from the same location. Here, we asked whether this effect is modulated by audiovisual interactions. In two experiments, using a repetition-suppression paradigm, we presented pairs of tones in free field, where the test stimulus was a tone presented at a fixed lateral location. Experiment 1 established a neural index of auditory spatial sensitivity, by comparing the degree of attenuation of the response to test stimuli when they were preceded by an adapter sound at the same location versus 30° or 60° away. We found that the degree of attenuation at the P2 latency was inversely related to the spatial distance between the test stimulus and the adapter stimulus. In Experiment 2, the adapter stimulus was a tone presented from the same location or a more medial location than the test stimulus. The adapter stimulus was accompanied by a simultaneous flash displayed orthogonally from one of the two locations. Sound-flash incongruence reduced accuracy in a same-different location discrimination task (i.e., the ventriloquism effect) and reduced the location-specific repetition-suppression at the P2 latency. Importantly, this multisensory effect included topographic modulations, indicative of changes in the relative contribution of underlying sources across conditions. Our findings suggest that the auditory response at the P2 latency is affected by spatially selective brain activity, which is affected crossmodally by visual information., (© 2017 Society for Psychophysiological Research.)

Traditional studies of memory and object recognition involved objects presented within a single sensory modality (i.e., purely visual or purely auditory objects). However, in naturalistic settings, objects are often evaluated and processed in a multisensory manner. This begets the question of how object representations that combine information from the different senses are created and utilised by memory functions. Here we review research that has demonstrated that a single multisensory exposure can influence memory for both visual and auditory objects. In an old/new object discrimination task, objects that were presented initially with a task-irrelevant stimulus in another sense were better remembered compared to stimuli presented alone, most notably when the two stimuli were semantically congruent. The brain discriminates between these two types of object representations within the first 100ms post-stimulus onset, indicating early "tagging" of objects/events by the brain based on the nature of their initial presentation context. Interestingly, the specific brain networks supporting the improved object recognition vary based on a variety of factors, including the effectiveness of the initial multisensory presentation and the sense that is task-relevant. We specify the requisite conditions for multisensory contexts to improve object discrimination following single exposures, and the individual differences that exist with respect to these improvements. Our results shed light onto how memory operates on the multisensory nature of object representations as well as how the brain stores and retrieves memories of objects., (Copyright © 2017 Elsevier Ltd. All rights reserved.)

Face recognition is an apparently straightforward but, in fact, complex ability, encompassing the activation of at least visual and somatosensory representations. Understanding how identity shapes the interplay between these face-related affordances could clarify the mechanisms of self-other discrimination. To this aim, we exploited the so-called "face inversion effect" (FIE), a specific bias in the mental rotation of face images (of other people): with respect to inanimate objects, face images require longer time to be mentally rotated from the upside-down. Via the FIE, which suggests the activation of somatosensory mechanisms, we assessed identity-related changes in the interplay between visual and somatosensory affordances between self- and other-face representations. Methodologically, to avoid the potential interference of the somatosensory feedback associated with musculoskeletal movements, we introduced the tracking of gaze direction to record participants' response. Response times from twenty healthy participants showed the larger FIE for self- than other-faces, suggesting that the impact of somatosensory affordances on mental representation of faces varies according to identity. The present study lays the foundations of a quantifiable method to implicitly assess self-other discrimination, with possible translational benefits for early diagnosis of face processing disturbances (e.g. prosopagnosia), and for neurophysiological studies on self-other discrimination in ethological settings., (Copyright © 2017 Elsevier B.V. All rights reserved.)