Search

This review examines how visual information enhances speech perception in individuals with hearing loss, focusing on the impact of age, linguistic stimuli, and specific hearing loss factors on the effectiveness of audiovisual (AV) integration. While existing studies offer varied and sometimes conflicting findings regarding the use of visual cues, our analysis shows that these key factors can distinctly shape AV speech perception outcomes. For instance, younger individuals and those who receive early intervention tend to benefit more from visual cues, particularly when linguistic complexity is lower. Additionally, languages with dense phoneme spaces demonstrate a higher dependency on visual information, underscoring the importance of tailoring rehabilitation strategies to specific linguistic contexts. By considering these influences, we highlight areas where understanding is still developing and suggest how personalized rehabilitation strategies and supportive systems could be tailored to better meet individual needs. Furthermore, this review brings attention to important aspects that warrant further investigation, aiming to refine theoretical models and contribute to more effective, customized approaches to hearing rehabilitation. [ABSTRACT FROM AUTHOR]

This study investigated how running on a treadmill influences the accuracy of throwing a ball to a hoop. Based upon previous research carried out in an open field that demonstrates that targets are perceived further away when running on a treadmill compared to when standing, we examined if this effect persisted in a visually directed throwing task. Fourteen athletes with normal or corrected vision participated. In Experiment 1, participants made indirect distance estimates of targets at 6 m, showing larger estimates while running. In Experiment 2, participants performed a throwing task, aiming to throw balls into a hoop while running or standing on a treadmill. The results showed that running on a treadmill influenced distance estimation, leading to larger throws. These findings suggest that the perception of distance is a process that relies on perceptual cues and sensorimotor feedback. [ABSTRACT FROM AUTHOR]

This review examines how visual information enhances speech perception in individuals with hearing loss, focusing on the impact of age, linguistic stimuli, and specific hearing loss factors on the effectiveness of audiovisual (AV) integration. While existing studies offer varied and sometimes conflicting findings regarding the use of visual cues, our analysis shows that these key factors can distinctly shape AV speech perception outcomes. For instance, younger individuals and those who receive early intervention tend to benefit more from visual cues, particularly when linguistic complexity is lower. Additionally, languages with dense phoneme spaces demonstrate a higher dependency on visual information, underscoring the importance of tailoring rehabilitation strategies to specific linguistic contexts. By considering these influences, we highlight areas where understanding is still developing and suggest how personalized rehabilitation strategies and supportive systems could be tailored to better meet individual needs. Furthermore, this review brings attention to important aspects that warrant further investigation, aiming to refine theoretical models and contribute to more effective, customized approaches to hearing rehabilitation. [ABSTRACT FROM AUTHOR]

Face-to-face speech communication is an audiovisual process during which the interlocuters use both the auditory speech signals as well as visual, oral articulations to understand the other. These sensory inputs are merged into a single, unified process known as multisensory integration. Audiovisual speech integration is known to be influenced by many factors, including listener experience. In this study, we investigated the roles of bilingualism and language experience on integration. We used a McGurk paradigm in which participants were presented with incongruent auditory and visual speech. This included an auditory utterance of ‘ba’ paired with visual articulations of ‘ga’ that often induce the perception of ‘da’ or ‘tha’, a fusion effect that is strong evidence of integration, as well as an auditory utterance of ‘ga’ paired with visual articulations of ‘ba’ that often induce the perception of ‘bga’, a combination effect that is weaker evidence of integration. We compared fusion and combination effects on three groups ( N = 20 each), English monolinguals, Spanish–English bilinguals, and Arabic–English bilinguals, with stimuli presented in all three languages. Monolinguals exhibited significantly stronger multisensory integration than bilinguals in fusion effects, regardless of the stimulus language. Bilinguals exhibited a nonsignificant trend by which greater experience led to increased integration as measured by fusion. These results held regardless of whether McGurk presentations were presented as stand-alone syllables or in the context of real words. [ABSTRACT FROM AUTHOR]

The ability to judge the temporal alignment of visual and auditory information is a prerequisite for multisensory integration and segregation. However, each temporal measurement is subject to error. Thus, when judging whether a visual and auditory stimulus were presented simultaneously, observers must rely on a subjective decision boundary to distinguish between measurement error and truly misaligned audiovisual signals. Here, we tested whether these decision boundaries are relaxed with increasing temporal sensory uncertainty, i.e., whether participants make the same type of adjustment an ideal observer would make. Participants judged the simultaneity of audiovisual stimulus pairs with varying temporal offset, while being immersed in different virtual environments. To obtain estimates of participants' temporal sensory uncertainty and simultaneity criteria in each environment, an independent-channels model was fitted to their simultaneity judgments. In two experiments, participants' simultaneity decision boundaries were predicted by their temporal uncertainty, which varied unsystematically with the environment. Hence, observers used a flexibly updated estimate of their own audiovisual temporal uncertainty to establish subjective criteria of simultaneity. This finding implies that, under typical circumstances, audiovisual simultaneity windows reflect an observer's cross-modal temporal uncertainty. [ABSTRACT FROM AUTHOR]

In the field of sensory neuroprostheses, one ultimate goal is for individuals to perceive artificial somatosensory information and use the prosthesis with high complexity that resembles an intact system. To this end, research has shown that stimulation-elicited somatosensory information improves prosthesis perception and task performance. While studies strive to achieve sensory integration, a crucial phenomenon that entails naturalistic interaction with the environment, this topic has not been commensurately reviewed. Therefore, here we present a perspective for understanding sensory integration in neuroprostheses. First, we review the engineering aspects and functional outcomes in sensory neuroprosthesis studies. In this context, we summarize studies that have suggested sensory integration. We focus on how they have used stimulation-elicited percepts to maximize and improve the reliability of somatosensory information. Next, we review studies that have suggested multisensory integration. These works have demonstrated that congruent and simultaneous multisensory inputs provided cognitive benefits such that an individual experiences a greater sense of authority over prosthesis movements (i.e., agency) and perceives the prosthesis as part of their own (i.e., ownership). Thereafter, we present the theoretical and neuroscience framework of sensory integration. We investigate how behavioral models and neural recordings have been applied in the context of sensory integration. Sensory integration models developed from intact-limb individuals have led the way to sensory neuroprosthesis studies to demonstrate multisensory integration. Neural recordings have been used to show how multisensory inputs are processed across cortical areas. Lastly, we discuss some ongoing research and challenges in achieving and understanding sensory integration in sensory neuroprostheses. Resolving these challenges would help to develop future strategies to improve the sensory feedback of a neuroprosthetic system. [ABSTRACT FROM AUTHOR]

ABSTRACT Introduction Materials and Methods Results Conclusions Individuals with schizophrenia present anomalies in the extension and plasticity of the peripersonal space (PPS), the section of space surrounding the body, shaped through motor experiences. A weak multisensory integration in PPS would contribute to an impairment of self‐embodiment processing, a core feature of the disorder linked to specific subjective experiences.In this exploratory study, we aimed at: (1) testing an association between PPS features, psychopathology, and subjective experiences in schizophrenia; (2) describing the PPS profile in individuals with early‐onset schizophrenia.Twenty‐seven individuals with schizophrenia underwent a task measuring the PPS size and boundaries demarcation before and after a motor training with a tool. The Positive And Negative Syndrome Scale (PANSS), the Examination of Anomalous Self Experience scale (EASE) and the Autism Rating Scale (ARS) were used to assess psychopathology. Subsequently, participants were divided into two subgroups, early and adult‐onset schizophrenia. The two groups were compared in regard to their PPS and psychopathological profiles.PPS patterns were associated with psychopathology, particularly positively with PANSS negative scale score, and negatively with subjective experiences of existential reorientation (EASE Domain 5 scores) and of social encounters (ARS scores). Only PPS parameters and ARS scores differentiated between early and adult‐onset participants.Our results, although preliminary and exploratory, can suggest a link between PPS patterns, negative symptoms, and disturbances of the subjective experience, particularly in the intersubjective domain, in schizophrenia. Moreover, they seem to suggest that specific PPS profiles and schizophrenic autism traits could be markers of early‐onset schizophrenia. [ABSTRACT FROM AUTHOR]

Background: Planning and executing movements requires the integration of different sensory modalities, such as vision and proprioception. However, neurological diseases like stroke can lead to full or partial loss of proprioception, resulting in impaired movements. Recent advances focused on providing additional sensory feedback to patients to compensate for the sensory loss, proving vibrotactile stimulation to be a viable option as it is inexpensive and easy to implement. Here, we test how such vibrotactile information can be integrated with visual signals to estimate the spatial location of a reach target. Methods: We used a center-out reach paradigm with 31 healthy human participants to investigate how artificial vibrotactile stimulation can be integrated with visual-spatial cues indicating target location. Specifically, we provided multisite vibrotactile stimulation to the moving dominant arm using eccentric rotating mass (ERM) motors. As the integration of inputs across multiple sensory modalities becomes especially relevant when one of them is uncertain, we additionally modulated the reliability of visual cues. We then compared the weighing of vibrotactile and visual inputs as a function of visual uncertainty to predictions from the maximum likelihood estimation (MLE) framework to decide if participants achieve quasi-optimal integration. Results: Our results show that participants could estimate target locations based on vibrotactile instructions. After short training, combined visual and vibrotactile cues led to higher hit rates and reduced reach errors when visual cues were uncertain. Additionally, we observed lower reaction times in trials with low visual uncertainty when vibrotactile stimulation was present. Using MLE predictions, we found that integration of vibrotactile and visual cues followed optimal integration when vibrotactile cues required the detection of one or two active motors. However, if estimating the location of a target required discriminating the intensities of two cues, integration violated MLE predictions. Conclusion: We conclude that participants can quickly learn to integrate visual and artificial vibrotactile information. Therefore, using additional vibrotactile stimulation may serve as a promising way to improve rehabilitation or the control of prosthetic devices by patients suffering loss of proprioception. [ABSTRACT FROM AUTHOR]

Does congruence between auditory and visual modalities affect aesthetic experience? While cross-modal correspondences between vision and hearing are well-documented, previous studies show conflicting results regarding whether audiovisual correspondence affects subjective aesthetic experience. Here, in collaboration with the Kentler International Drawing Space (NYC, USA), we depart from previous research by using music specifically composed to pair with visual art in the professionally-curated Music as Image and Metaphor exhibition. Our pre-registered online experiment consisted of 4 conditions: Audio, Visual, Audio-Visual-Intended (artist-intended pairing of art/music), and Audio-Visual-Random (random shuffling). Participants (N = 201) were presented with 16 pieces and could click to proceed to the next piece whenever they liked. We used time spent as an implicit index of aesthetic interest. Additionally, after each piece, participants were asked about their subjective experience (e.g., feeling moved). We found that participants spent significantly more time with Audio, followed by Audiovisual, followed by Visual pieces; however, they felt most moved in the Audiovisual (bi-modal) conditions. Ratings of audiovisual correspondence were significantly higher for the Audiovisual-Intended compared to Audiovisual-Random condition; interestingly, though, there were no significant differences between intended and random conditions on any other subjective rating scale, or for time spent. Collectively, these results call into question the relationship between cross-modal correspondence and aesthetic appreciation. Additionally, the results complicate the use of time spent as an implicit measure of aesthetic experience. [ABSTRACT FROM AUTHOR]

Body image disturbance (BID) is central to eating disorders (EDs), yet the role of self‐face perception has received limited empirical attention despite rising sociocultural pressures emphasizing facial appearance through technologies such as social media. Emerging evidence suggests impairments in self‐face recognition accuracy and distorted perceptions of facial appearance among individuals with EDs. Enfacement illusions, involving the experimental induction of perceived ownership over another's face, offer a novel paradigm to comprehensively investigate the perceptual multisensory integration processes underlying self‐face perception disturbances in ED populations. Such an approach may hold promise for elucidating core pathological mechanisms contributing to BID and ED psychopathology. We discuss how rigorous investigation of self‐face perception through the enfacement illusion paradigm represents an innovative direction of research and/or clinical application that may advance etiological models of EDs and possibly inform interventions targeting the potentially multidimensional nature of body and facial image disturbances characterizing EDs. Public Significance Statement: Body image disturbance is central to eating disorders (EDs), yet, the role of face‐related disturbances remains critically under‐investigated. After summarizing findings on face‐related disturbances in EDs we propose how enfacement illusions (i.e., the experimental induction of ownership over another's face) may elucidate self‐face perception disturbances in EDs, and their underlying mechanisms. Enfacement illusions may also offer an intervention to potentially address multifaceted face and body image disturbances characterizing EDs. [ABSTRACT FROM AUTHOR]

Octopuses integrate visual, chemical and tactile sensory information while foraging and feeding in complex marine habitats. The respective roles of these modes are of interest ecologically, neurobiologically, and for development of engineered soft robotic arms. While vision guides their foraging path, benthic octopuses primarily search "blindly" with their arms to find visually hidden prey amidst rocks, crevices and coral heads. Each octopus arm is lined with hundreds of suckers that possess a combination of chemo- and mechanoreceptors to distinguish prey. Contact chemoreception has been demonstrated in lab tests, but mechanotactile sensing is less well characterized. We designed a non-invasive live animal behavioral assay that isolated mechanosensory capabilities of Octopus bimaculoides arms and suckers to discriminate among five resin 3D-printed prey and non-prey shapes (all with identical chemical signatures). Each shape was introduced inside a rock dome and was only accessible to the octopus' arms. Octopuses' responses were variable. Young octopuses discriminated the crab prey shape from the control, whereas older octopuses did not. These experiments suggest that mechanotactile sensing of 3D shapes may aid in prey discrimination; however, (i) chemo-tactile information may be prioritized over mechanotactile information in prey discrimination, and (ii) mechanosensory capability may decline with age. [ABSTRACT FROM AUTHOR]

While dual-task walking requires the ability to integrate sensory information from multiple ongoing sources, it remains unknown whether dual-task walking is more affected than single-task walking by the multisensory integration ability. How does the audiovisual temporal integration ability affect single-task and dual-task gaits in the aging population? One hundred and thirty healthy middle-aged and older adults (age = 64.7 ± 6.4 years) completed an audiovisual simultaneity judgment (AVSJ) task and underwent single-task, motor dual-task, and cognitive dual-task gait assessments. In the AVSJ task, participants judged whether a flash and an auditory stimulus presented at different stimulus onset asynchronies were simultaneous. The accuracy and precision of the AVSJ performance were assessed using the point of subjective simultaneity (PSS) and the temporal binding window (δ), respectively. A lower absolute PSS and δ indicated better performance. Participants held a cup of water and performed serial-7 subtraction for motor and cognitive dual-task gait assessments, respectively. The spatiotemporal gait parameters and their variability were calculated. The influences of PSS and δ on the gait parameters of the three gaits were examined with multiple hierarchical regressions. Only the cognitive dual-task gait was significantly affected by PSS and δ. Greater PSS predicted a longer single support time (β = 0.195, p = 0.024) and its variability (β = 0.224, p = 0.011). Greater δ predicted greater step time variability (β = 0.198, p = 0.022). Declined perception of audiovisual simultaneity particularly degrades temporal control of cognitive dual-task walking, highlighting the importance of assessing and training this ability after midlife. • Audiovisual (AV) temporal perception and dual-task gaits decline in midlife. • Impact of AV perception on aging gaits under cognitive loads remains unclear. • Poorer AV temporal perception impairs temporal control of cognitive dual-task gait. • Single- and motor dual-task gaits show no audiovisual sensitivity. • Findings stress multisensory perception's importance in cognitive dual-task gait. [ABSTRACT FROM AUTHOR]

Abstract Background Planning and executing movements requires the integration of different sensory modalities, such as vision and proprioception. However, neurological diseases like stroke can lead to full or partial loss of proprioception, resulting in impaired movements. Recent advances focused on providing additional sensory feedback to patients to compensate for the sensory loss, proving vibrotactile stimulation to be a viable option as it is inexpensive and easy to implement. Here, we test how such vibrotactile information can be integrated with visual signals to estimate the spatial location of a reach target. Methods We used a center-out reach paradigm with 31 healthy human participants to investigate how artificial vibrotactile stimulation can be integrated with visual-spatial cues indicating target location. Specifically, we provided multisite vibrotactile stimulation to the moving dominant arm using eccentric rotating mass (ERM) motors. As the integration of inputs across multiple sensory modalities becomes especially relevant when one of them is uncertain, we additionally modulated the reliability of visual cues. We then compared the weighing of vibrotactile and visual inputs as a function of visual uncertainty to predictions from the maximum likelihood estimation (MLE) framework to decide if participants achieve quasi-optimal integration. Results Our results show that participants could estimate target locations based on vibrotactile instructions. After short training, combined visual and vibrotactile cues led to higher hit rates and reduced reach errors when visual cues were uncertain. Additionally, we observed lower reaction times in trials with low visual uncertainty when vibrotactile stimulation was present. Using MLE predictions, we found that integration of vibrotactile and visual cues followed optimal integration when vibrotactile cues required the detection of one or two active motors. However, if estimating the location of a target required discriminating the intensities of two cues, integration violated MLE predictions. Conclusion We conclude that participants can quickly learn to integrate visual and artificial vibrotactile information. Therefore, using additional vibrotactile stimulation may serve as a promising way to improve rehabilitation or the control of prosthetic devices by patients suffering loss of proprioception.

Abstract Does congruence between auditory and visual modalities affect aesthetic experience? While cross-modal correspondences between vision and hearing are well-documented, previous studies show conflicting results regarding whether audiovisual correspondence affects subjective aesthetic experience. Here, in collaboration with the Kentler International Drawing Space (NYC, USA), we depart from previous research by using music specifically composed to pair with visual art in the professionally-curated Music as Image and Metaphor exhibition. Our pre-registered online experiment consisted of 4 conditions: Audio, Visual, Audio-Visual-Intended (artist-intended pairing of art/music), and Audio-Visual-Random (random shuffling). Participants (N = 201) were presented with 16 pieces and could click to proceed to the next piece whenever they liked. We used time spent as an implicit index of aesthetic interest. Additionally, after each piece, participants were asked about their subjective experience (e.g., feeling moved). We found that participants spent significantly more time with Audio, followed by Audiovisual, followed by Visual pieces; however, they felt most moved in the Audiovisual (bi-modal) conditions. Ratings of audiovisual correspondence were significantly higher for the Audiovisual-Intended compared to Audiovisual-Random condition; interestingly, though, there were no significant differences between intended and random conditions on any other subjective rating scale, or for time spent. Collectively, these results call into question the relationship between cross-modal correspondence and aesthetic appreciation. Additionally, the results complicate the use of time spent as an implicit measure of aesthetic experience.

Understanding the neural underpinning of human gait and balance is one of the most pertinent challenges for 21st-century translational neuroscience due to the profound impact that falls and mobility disturbances have on our aging population. Posture and gait control does not happen automatically, as previously believed, but rather requires continuous involvement of central nervous mechanisms. To effectively exert control over the body, the brain must integrate multiple streams of sensory information, including visual, vestibular, and somatosensory signals. The mechanisms which underpin the integration of these multisensory signals are the principal topic of the present work. Existing multisensory integration theories focus on how failure of cognitive processes thought to be involved in multisensory integration leads to falls in older adults. Insufficient emphasis, however, has been placed on specific contributions of individual sensory modalities to multisensory integration processes and cross-modal interactions that occur between the sensory modalities in relation to gait and balance. In the present work, we review the contributions of somatosensory, visual, and vestibular modalities, along with their multisensory intersections to gait and balance in older adults and patients with Parkinson’s disease. We also review evidence of vestibular contributions to multisensory temporal binding windows, previously shown to be highly pertinent to fall risk in older adults. Lastly, we relate multisensory vestibular mechanisms to potential neural substrates, both at the level of neurobiology (concerning positron emission tomography imaging) and at the level of electrophysiology (concerning electroencephalography). We hope that this integrative review, drawing influence across multiple subdisciplines of neuroscience, paves the way for novel research directions and therapeutic neuromodulatory approaches, to improve the lives of older adults and patients with neurodegenerative diseases.

Paradoxically visual dependence is reported to increase with age, contributing to falls risk, whereas visual function typically declines. This study assesses the relationship between age, objective and subjective measures of visual function and visual dependence, in healthy young and older adults. Forty-four healthy Young (YA; n = 32; 18 males, aged 26.2 ± 5.3 yrs.) and Older (OA; n = 12; 3 males, aged 62.4 ± 6.7 yrs.) adults were assessed for objective (visual acuity, contrast sensitivity, depth perception, and lower peripheral vision), and subjective visual function (VFQ-25) along with motion sickness susceptibility. Subjective Visual Vertical (SVV) and induced nausea and vection were assessed using the Rod and Disc Test (RDT). Groups were compared using Mann-Whitney U, whilst determinants of SVV variability were evaluated using Multiple regression modelling. Visual acuity (p < 0.01) and contrast sensitivity (p = 0.04) were lower in OA. Visual dependence (SVV tilt errors) was not associated with ageing (p = 0.46). YA experienced greater RDT-induced vection (p = 0.03). Visual acuity and contrast sensitivity accounted for modest proportions of variance in SVV tilt errors (VA; R2 = 0.14, F(1,42) = 8.00, p < 0.01; β = 6.37) and (CS; R2 = 0.06, F(1,42) = 3.93, p = 0.05; β = −4.97), respectively. Our findings suggest that subclinical differences in visual acuity and contrast sensitivity contribute to SVV tilt error variability, among both healthy young and older adults. Further studies are needed to define the inter-relationship between age-related visual function, non-visual factors (including vestibular and somatosensory fidelity, activity levels, fear of falling and cognitive function) and visual dependence. Highlights: • Age alone was not a predictor of visual dependence in healthy individuals. • Visual acuity and contrast sensitivity were found to be lower in older adults. • There was no effect of age on vision-related health and quality of life • Variability in SVV tilt error was associated with sub-clinical differences in visual acuity and contrast sensitivity, rather than age alone. • There was an indirect effect of ageing on SVV tilt error, mediated by lower visual acuity and contrast sensitivity. [ABSTRACT FROM AUTHOR]

Attention and crossmodal interactions are closely linked through a complex interplay at different stages of sensory processing. Within the context of motion perception, previous research revealed that attentional demands alter audiovisual interactions in the temporal domain. In the present study, we aimed to understand the neurophysiological correlates of these attentional modulations. We utilized an audiovisual motion paradigm that elicits auditory time interval effects on perceived visual speed. The audiovisual interactions in the temporal domain were quantified by changes in perceived visual speed across different auditory time intervals. We manipulated attentional demands in the visual field by having a secondary task on a stationary object (i.e., single‐ vs. dual‐task conditions). When the attentional demands were high (i.e., dual‐task condition), there was a significant decrease in the effects of auditory time interval on perceived visual speed, suggesting a reduction in audiovisual interactions. Moreover, we found significant differences in both early and late neural activities elicited by visual stimuli across task conditions (single vs. dual), reflecting an overall increase in attentional demands in the visual field. Consistent with the changes in perceived visual speed, the audiovisual interactions in neural signals declined in the late positive component range. Compared with the findings from previous studies using different paradigms, our findings support the view that attentional modulations of crossmodal interactions are not unitary and depend on task‐specific components. They also have important implications for motion processing and speed estimation in daily life situations where sensory relevance and attentional demands constantly change. [ABSTRACT FROM AUTHOR]

Flight simulators have an essential role in aircrew training. Occasionally, symptoms of motion sickness, defined as simulator sickness, develop during training sessions. The reported incidence of simulator sickness ranged widely in different studies.The aims of this study were to calculate the incidence of and to define a threshold value for simulator sickness among rotary-wing pilots using the validated Simulator Sickness Questionnaire (SSQ).CH-53 and UH-60 helicopter pilots, who trained in helicopter simulators in the Israeli Air Force, were asked to fulfill SSQ. A score of 20 in the SSQ was defined as the threshold for simulator sickness. Simulator sickness incidence and average SSQ were calculated. Correlations between age and simulator training hours to SSQ scores were analyzed.A total of 207 rotary-wing aircrew participated in the study. Simulator sickness was experienced by 51.7% of trainees. The average SSQ score was 32.7. A significant negative correlation was found between age and SSQ score.Simulator sickness was experienced by more than half of helicopter pilots. A score of 20 in the SSQ was found to be suitable as the threshold for this condition. [ABSTRACT FROM AUTHOR]

Background: Deficits in Multisensory Integration (MSI) in ASD have been reported repeatedly and have been suggested to be caused by altered longrange connectivity. Here we investigate behavioral and ERP correlates of MSI in ASD using ecologically valid videos of emotional expressions. Methods: In the present study, we set out to investigate the electrophysiological correlates of audiovisual MSI in young autistic and neurotypical adolescents. We employed dynamic stimuli of high ecological validity (500 ms clips produced by actors) that depicted fear or disgust in unimodal (visual and auditory), and bimodal (audiovisual) conditions. Results: We report robust MSI effects at both the behavioral and electrophysiological levels and pronounced differences between autistic and neurotypical participants. Specifically, neurotypical controls showed robust behavioral MSI for both emotions as seen through a significant speed-up of bimodal response time (RT), confirmed by Miller's Race Model Inequality (RMI), with greater MSI effects for fear than disgust. Adolescents with ASD, by contrast, showed behavioral MSI only for fear. At the electrophysiological level, the bimodal condition as compared to the unimodal conditions reduced the amplitudes of the visual P100 and auditory P200 and increased the amplitude of the visual N170 regardless of group. Furthermore, a cluster-based analysis across all electrodes revealed that adolescents with ASD showed an overall delayed and spatially constrained MSI effect compared to controls. Conclusion: Given that the variables we measured reflect attention, our findings suggest that MSI can be modulated by the differential effects on attention that fear and disgust produce. We also argue that the MSI deficits seen in autistic individuals can be compensated for at later processing stages by (a) the attention-orienting effects of fear, at the behavioral level, and (b) at the electrophysiological level via increased attentional effort. [ABSTRACT FROM AUTHOR]

People can use their sense of hearing for discerning thermal properties, though they are for the most part unaware that they can do so. While people unequivocally claim that they cannot perceive the temperature of pouring water through the auditory properties of hearing it being poured, our research further strengthens the understanding that they can. This multimodal ability is implicitly acquired in humans, likely through perceptual learning over the lifetime of exposure to the differences in the physical attributes of pouring water. In this study, we explore people's perception of this intriguing cross modal correspondence, and investigate the psychophysical foundations of this complex ecological mapping by employing machine learning. Our results show that not only can the auditory properties of pouring water be classified by humans in practice, the physical characteristics underlying this phenomenon can also be classified by a pre-trained deep neural network. [ABSTRACT FROM AUTHOR]

Our mental representation of our body depends on integrating various sensory modalities, such as tactile information. In tactile distance estimation (TDE) tasks, participants must estimate the distance between two tactile tips applied to their skin. This measure of tactile perception has been linked to body representation assessments. Studies in individuals with fibromyalgia (FM), a chronic widespread pain syndrome, suggest the presence of body representation distortions and tactile alterations, but TDE has never been examined in this population. Twenty participants with FM and 24 pain-free controls performed a TDE task on three Body regions (upper limb, trunk, lower limb), in which they manually estimated the interstimuli distance on a tablet. TDE error, the absolute difference between the estimation and the interstimuli distance, was not different between the Groups, on any Body region. Drawings of their body as they felt it revealed clear and frequent distortions of body representation in the group with FM, compared to negligible perturbations in controls. This contrast between distorted body drawings and unaltered TDE suggests a preserved integration of tactile information but an altered integration of this information with other sensory modalities to generate a precise and accurate body representation. Future research should investigate the relative contribution of each sensory information and prior knowledge about the body in body representation in individuals with FM to shed light on the observed distortions. [ABSTRACT FROM AUTHOR]

Speech comprehension is crucial for human social interaction, relying on the integration of auditory and visual cues across various levels of representation. While research has extensively studied multisensory integration (MSI) using idealised, well‐controlled stimuli, there is a need to understand this process in response to complex, naturalistic stimuli encountered in everyday life. This study investigated behavioural and neural MSI in neurotypical adults experiencing audio‐visual speech within a naturalistic, social context. Our novel paradigm incorporated a broader social situational context, complete words, and speech‐supporting iconic gestures, allowing for context‐based pragmatics and semantic priors. We investigated MSI in the presence of unimodal (auditory or visual) or complementary, bimodal speech signals. During audio‐visual speech trials, compared to unimodal trials, participants more accurately recognised spoken words and showed a more pronounced suppression of alpha power—an indicator of heightened integration load. Importantly, on the neural level, these effects surpassed mere summation of unimodal responses, suggesting non‐linear MSI mechanisms. Overall, our findings demonstrate that typically developing adults integrate audio‐visual speech and gesture information to facilitate speech comprehension in noisy environments, highlighting the importance of studying MSI in ecologically valid contexts. [ABSTRACT FROM AUTHOR]

Tools enable humans to extend their sensing abilities beyond the natural limits of their hands, allowing them to sense objects as if they were using their hands directly. The similarities between direct hand interactions with objects (hand-based sensing) and the ability to extend sensory information processing beyond the hand (tool-mediated sensing) entail the existence of comparable processes for integrating tool- and hand-sensed information with vision, raising the question of whether tools support vision in bimanual object manipulations. Here, we investigated participants' performance while grasping objects either held with a tool or with their hand and compared these conditions with visually guided grasping (Experiment 1). By measuring reaction time, peak velocity, and peak of grip aperture, we found that actions were initiated earlier and performed with a smaller peak grip aperture when the object was seen and held with the tool or the contralateral hand compared to when it was only seen. Thus, tool-mediated sensing effectively supports vision in multisensory grasping and, even more intriguingly, resembles hand-based sensing. We excluded that results were due to the force exerted on the tool's handle (Experiment 2). Additionally, as for hand-based sensing, we found evidence that the tool supports vision by mainly providing object positional information (Experiment 3). Thus, integrating the tool-sensed position of the object with vision is sufficient to promote a multisensory advantage in grasping. Our findings indicate that multisensory integration mechanisms significantly improve grasping actions and fine-tune contralateral hand movements even when object information is only indirectly sensed through a tool. Public Significance Statement: Tools allow extending the hands' sensing capabilities beyond their anatomical limits. Here, we show that object information sensed through a tool can guide bimanual object manipulations as effectively as when directly sensed by the hand. Both tool-based and hand-mediated sensing provide relevant object positional information that is merged with vision to improve action performance. Our findings provide evidence about the interchangeable use of tools and hands for skilled actions and open new perspectives for prosthetic applications and rehabilitative plans. [ABSTRACT FROM AUTHOR]

Objective: This study proposed a model to predict passenger motion sickness under the presence of a visual-vestibular conflict and assessed its performance with respect to previously recorded experimental data. Background: While several models have been shown useful to predict motion sickness under repetitive motion, improvements are still desired in terms of predicting motion sickness in realistic driving conditions. There remains a need for a model that considers angular and linear visual-vestibular motion inputs in three dimensions to improve prediction of passenger motion sickness. Method: The model combined the subjective vertical conflict theory and human motion perception models. The proposed model integrates visual and vestibular sensed 6 DoF motion signals in a novel architecture. Results: Model prediction results were compared to motion sickness data obtained from studies conducted in motion simulators as well as on-road vehicle testing, yielding trends that are congruent with observed results in both cases. Conclusion: The model demonstrated the ability to predict trends in motion sickness response for conditions in which a passenger performs a task on a handheld device versus facing forward looking ahead under realistic driving conditions. However, further analysis across a larger population is necessary to better assess the model's performance. Application: The proposed model can be used as a tool to predict motion sickness under different levels of visual-vestibular conflict. This can be leveraged to design interventions capable of mitigating passenger motion sickness. Further, this model can provide insights that aid in the development of passenger experiences inside autonomous vehicles. [ABSTRACT FROM AUTHOR]

Wide-range thermoreceptive neurons (WRT-EN) in monkey cortical area 7b that encoded innocuous and nocuous cutaneous thermal and threatening visuosensory stimulation with high fidelity were studied to identify their multisensory integrative response properties. Emphasis was given to characterizing the spatial and temporal effects of threatening visuosensory input on the thermal stimulus-response properties of these multisensory nociceptive neurons. Threatening visuosensory stimulation was most efficacious in modulating thermal evoked responses when presented as a downward ("looming"), spatially congruent, approaching and closely proximal target in relation to the somatosensory receptive field. Both temporal alignment and misalignment of spatially aligned threatening visual and thermal stimulation significantly increased mean discharge frequencies above those evoked by thermal stimulation alone, particularly at near noxious (43°C) and mildly noxious (45°C) temperatures. The enhanced multisensory discharge frequencies were equivalent to the discharge frequency evoked by overtly noxious thermal stimulation alone at 47°C (monkey pain tolerance threshold). A significant increase in behavioral mean escape frequency with shorter escape latency was evoked by multisensory stimulation at near noxious temperature (43°C), which was equivalent to that evoked by noxious stimulation alone (47°C). The remarkable concordance of elevating both neural discharge and escape frequency from a nonnociceptive and prepain level by near noxious thermal stimulation to a nociceptive and pain level by multisensory visual and near noxious thermal stimulation and integration is an elegantly designed defensive neural mechanism that in effect lowers both nociceptive response and pain thresholds to preemptively engage nocifensive behavior and, consequently, avert impending and actual injurious noxious thermal stimulation. NEW & NOTEWORTHY: Multisensory nociceptive neurons in cortical area 7b are engaged in integration of threatening visuosensory and a wide range of innocuous and nocuous somatosensory (thermoreceptive) inputs. The enhancement of neuronal activity and escape behavior in monkey by multisensory integration is consistent and supportive of human psychophysical studies. The spatial features of visuosensory stimulation in peripersonal space in relation to somatic stimulation in personal space are critical to multisensory integration, nociception, nocifensive behavior, and pain. [ABSTRACT FROM AUTHOR]

Introduction: The prevailing theories of consciousness consider the integration of different sensory stimuli as a key component for this phenomenon to rise on the brain level. Despite many theories and models have been proposed for multisensory integration between supraliminal stimuli (e.g., the optimal integration model), we do not know if multisensory integration occurs also for subliminal stimuli and what psychophysical mechanisms it follows. Methods: To investigate this, subjects were exposed to visual (Virtual Reality) and/or haptic stimuli (Electro-Cutaneous Stimulation) above or below their perceptual threshold. They had to discriminate, in a two-Alternative Forced Choice Task, the intensity of unimodal and/or bimodal stimuli. They were then asked to discriminate the sensory modality while recording their EEG responses. Results: We found evidence of multisensory integration for supraliminal condition, following the classical optimal model. Importantly, even for subliminal trials participant's performances in the bimodal condition were significantly more accurate when discriminating the intensity of the stimulation. Moreover, significant differences emerged between unimodal and bimodal activity templates in parietotemporal areas known for their integrative role. Discussion: These converging evidences - even if preliminary and needing confirmation from the collection of further data - suggest that subliminal multimodal stimuli can be integrated, thus filling a meaningful gap in the debate about the relationship between consciousness and multisensory integration. [ABSTRACT FROM AUTHOR]

Humans naturally integrate signals from the olfactory and intranasal trigeminal systems. A tight interplay has been demonstrated between these two systems, and yet the neural circuitry mediating olfactory–trigeminal (OT) integration remains poorly understood. Using functional magnetic resonance imaging (fMRI), combined with psychophysics, this study investigated the neural mechanisms underlying OT integration. Fifteen participants with normal olfactory function performed a localization task with air‐puff stimuli, phenylethyl alcohol (PEA; rose odor), or a combination thereof while being scanned. The ability to localize PEA to either nostril was at chance. Yet, its presence significantly improved the localization accuracy of weak, but not strong, air‐puffs, when both stimuli were delivered concurrently to the same nostril, but not when different nostrils received the two stimuli. This enhancement in localization accuracy, exemplifying the principles of spatial coincidence and inverse effectiveness in multisensory integration, was associated with multisensory integrative activity in the primary olfactory (POC), orbitofrontal (OFC), superior temporal (STC), inferior parietal (IPC) and cingulate cortices, and in the cerebellum. Multisensory enhancement in most of these regions correlated with behavioral multisensory enhancement, as did increases in connectivity between some of these regions. We interpret these findings as indicating that the POC is part of a distributed brain network mediating integration between the olfactory and trigeminal systems. Practitioner Points: Psychophysical and neuroimaging study of olfactory–trigeminal (OT) integration.Behavior, cortical activity, and network connectivity show OT integration.OT integration obeys principles of inverse effectiveness and spatial coincidence.Behavioral and neural measures of OT integration are correlated. [ABSTRACT FROM AUTHOR]

Dysfunctions in sensory processing are widely described in individuals with autism spectrum disorder (ASD), although little is known about the developmental course and the impact of these difficulties on the learning processes during the preschool and school ages of ASD children. Specifically, as regards the interplay between visual and haptic information in ASD during developmental age, knowledge is very scarce and controversial. In this study, we investigated unimodal (visual and haptic) and cross-modal (visuo-haptic) processing skills aimed at object recognition through a behavioural paradigm already used in children with typical development (TD), with cerebral palsy and with peripheral visual impairments. Thirty-five children with ASD (age range: 5–11 years) and thirty-five age-matched and gender-matched typically developing peers were recruited. The procedure required participants to perform an object-recognition task relying on only the visual modality (black-and-white photographs), only the haptic modality (manipulation of real objects) and visuo-haptic transfer of these two types of information. Results are consistent with the idea that visuo-haptic transfer may be significantly worse in ASD children than in TD peers, leading to significant impairment in multisensory interactions for object recognition facilitation. Furthermore, ASD children tended to show a specific deficit in haptic information processing, while a similar trend of maturation of visual modality between the two groups is reported. This study adds to the current literature by suggesting that ASD differences in multisensory processes also regard visuo-haptic abilities necessary to identify and recognise objects of daily life. [ABSTRACT FROM AUTHOR]

Despite the historically consolidated psychopathological perspective, on the one hand, contemporary organicistic psychiatry often highlights abnormalities in neurotransmitter systems like dysregulation of dopamine transmission, neural circuitry, and genetic factors as key contributors to schizophrenia. Neuroscience, on the other, has so far almost entirely neglected the first-person experiential dimension of this syndrome, mainly focusing on high-order cognitive functions, such as executive function, working memory, theory of mind, and the like. An alternative view posits that schizophrenia is a self-disorder characterized by anomalous self-experience and awareness. This view may not only shed new light on the psychopathological features of psychosis but also inspire empirical research targeting the bodily and neurobiological changes underpinning this disorder. Cognitive neuroscience can today address classic topics of phenomenological psychopathology by adding a new level of description, finally enabling the correlation between the first-person experiential aspects of psychiatric diseases and their neurobiological roots. Recent empirical evidence on the neurobiological basis of a minimal notion of the self, the bodily self, is presented. The relationship between the body, its motor potentialities and the notion of minimal self is illustrated. Evidence on the neural mechanisms underpinning the bodily self, its plasticity, and the blurring of self-other distinction in schizophrenic patients is introduced and discussed. It is concluded that brain-body function anomalies of multisensory integration, differential processing of self- and other-related bodily information mediating self-experience, might be at the basis of the disruption of the self disorders characterizing schizophrenia. [Display omitted] [ABSTRACT FROM AUTHOR]

Chronic ankle instability (CAI) is associated with a less flexible and adaptable sensorimotor system. Thus, individuals with CAI may present an inadequate sensory reweighting system, inhibiting their ability to place more emphasis (upweight) on reliable sensory feedback to control posture. However, how individuals with CAI reweight sensory feedback to maintain postural control in bilateral and unilateral stances has not been established. To examine (1) group differences in how the sensory reweighting system changes to control posture in a simple double-limb stance and a more complex single-limb stance (uninjured limb and injured limb) under increased environmental constraints manipulating somatosensory and visual information for individuals with and without CAI and (2) the effect of environmental and task constraints on postural control. Case-control study. Laboratory. A total of 21 individuals with CAI (age = 26.4 ± 5.7 years, height = 171.2 ± 9.8 cm, mass = 76.6 ± 15.17 kg) and 21 individuals without CAI (control group; age = 25.8 ± 5.7 years, height = 169.5 ± 9.5 cm, mass = 72.4 ± 15.0 kg) participated. We examined the equilibrium scores based on the first 10 seconds of trials in which participants completed 6 environmental conditions of the Sensory Organization Test during 3 tasks (double-limb and single-limb [uninjured and injured] stances). Sensory reweighting ratios for sensory systems (somatosensory, vision, and vestibular) were computed from paired equilibrium scores based on the first 10 seconds of the trials. We observed 3-factor interactions between groups, sensory systems, and tasks (F4,160 = 3.754, P =.006) and for group, task, and environment (F10,400 = 2.455, P =.007). The CAI group did not downweight vestibular feedback compared with the control group while maintaining posture on the injured limb (P =.03). The CAI group demonstrated better postural stability than the control group while standing with absent vision (ie, eyes closed), fixed surroundings, and a moving platform on the injured limb (P =.03). The CAI group relied on vestibular feedback while maintaining better postural stability than the control group in injured-limb stance. Group differences in postural control depended on both environmental (absent vision and moving platform) and task (injured limb) constraints. [ABSTRACT FROM AUTHOR]

Knowledge of the body size is intricately tied to multisensory integration processes that rely on the dynamic interplay of top‐down and bottom‐up mechanisms. Recent years have seen the development of passive sensory stimulation protocols aimed at investigating the modulation of various cognitive functions, primarily inducing perceptual learning and behaviour change without the need for extensive training. Given that reductions in sensory input have been associated with alterations in body size perception, it is reasonable to hypothesize that increasing sensory information through passive sensory stimulation could similarly influence the perception of the size of body parts. The primary aim of this study was to investigate the potential modulatory effects of passive sensory stimulation on the perception of hand and face size in a group of young adults. Passive sensory stimulation effectively modulated the size representation of the stimulated hand, supporting the notion that access to somatosensory and proprioceptive information is prioritised for the hands but may not extend to the face. Increased somatosensory input resulted in a reduction of distortion, providing evidence for bottom‐up modulation of size representation. Passive sensory stimulation can induce subjective changes in body size perception without the need for extensive training. This paradigm holds promise as a potential alternative for modulating distorted size representation in individuals with body representational deficits. [ABSTRACT FROM AUTHOR]

Tinnitus is the perception of a continuous sound in the absence of an external source. Although the role of the auditory system is well investigated, there is a gap in how multisensory signals are integrated to produce a single percept in tinnitus. Here, we train participants to learn a new sensory environment by associating a cue with a target signal that varies in perceptual threshold. In the test phase, we present only the cue to see whether the person perceives an illusion of the target signal. We perform two separate experiments to observe the behavioral and electrophysiological responses to the learning and test phases in 1) healthy young adults and 2) people with continuous subjective tinnitus and matched control subjects. We observed that in both parts of the study the percentage of false alarms was negatively correlated with the 75% detection threshold. Additionally, the perception of an illusion goes together with increased evoked response potential in frontal regions of the brain. Furthermore, in patients with tinnitus, we observe no significant difference in behavioral or evoked response in the auditory paradigm, whereas patients with tinnitus were more likely to report false alarms along with increased evoked activity during the learning and test phases in the visual paradigm. This emphasizes the importance of integrity of sensory pathways in multisensory integration and how this process may be disrupted in people with tinnitus. Furthermore, the present study also presents preliminary data supporting evidence that tinnitus patients may be building stronger perceptual models, which needs future studies with a larger population to provide concrete evidence on. NEW & NOTEWORTHY: Tinnitus is the continuous phantom perception of a ringing in the ears. Recently, it has been suggested that tinnitus may be a maladaptive inference of the brain to auditory anomalies, whether they are detected or undetected by an audiogram. The present study presents empirical evidence for this hypothesis by inducing an illusion in a sensory domain that is damaged (auditory) and one that is intact (visual). It also presents novel information about how people with tinnitus process multisensory stimuli in the audio-visual domain. [ABSTRACT FROM AUTHOR]

The illusory experience of self-motion known as vection, is a multisensory phenomenon relevant to self-motion processes. While some studies have shown that neck muscle vibrations can improve self-motion parameter estimation, the influence on vection remains unknown. Further, few studies measured cybersickness (CS), presence, and vection concurrently and have shown conflicting results. It was hypothesized that 1) neck vibrations would enhance vection and presence, and 2) CS to negatively relate to presence and vection, whereas presence and vection to positively relate to one another. Thirty-two participants were visually and audibly immersed in a virtual reality flight simulator and occasional neck muscle vibrations were presented. Vection onset and duration were reported through button presses. Turning angle estimations and ratings of vection quality, presence, and CS were obtained after completion of the flights. Results showed no influence of vibrations on turning angle estimation errors, but a medium positive effect of vibrations on vection quality was found. Presence and vection quality were positively related, and no strong association between CS and presence or vection was found. It is concluded that neck vibrations may enhance vection and presence, however, from the current study it is unclear whether this is due to proprioceptive or tactile stimulation. [ABSTRACT FROM AUTHOR]

This paper investigates the impact of two non-technical speech feedback perturbations outside the auditory modality: topical application of commercially-available benzocaine to reduce somatosensory feedback from speakers’ lips and tongue tip, and the presence of a mirror to provide fully-detailed visual self-feedback. In experiment 1, speakers were recorded under normal quiet conditions (i.e., baseline), then again with benzocaine application plus auditory degradation, and finally with the addition of mirror feedback. Speech produced under normal and both feedback-altered conditions was assessed via naïve listeners’ intelligibility discrimination judgments. Listeners judged speech produced under bisensory degradation to be less intelligible than speech from the un-degraded baseline, and with a greater degree of difference than previously observed with auditory-only degradation. The introduction of mirror feedback, however, did not result in relative improvements in intelligibility. Experiment 2, therefore, assessed the effect of a mirror on speech intelligibility in isolation with no other sensory feedback manipulations. Speech was recorded at baseline and then again in front of a mirror, and relative intelligibility was discriminated by naïve listeners. Speech produced with mirror feedback was judged as less intelligible than baseline tokens, indicating a negative impact of visual self-feedback in the absence of other sensory manipulations. The results of both experiments demonstrate that relatively accessible manipulations of non-auditory sensory feedback can produce speech-relevant effects, and that those effects are perceptible to naïve listeners.

Our brain constantly integrates afferent information, such as visual and tactile information, to perceive the world around us. According to the maximumlikelihood estimation (MLE) model, imprecise information will be weighted less than precise, making the multisensory percept as precise as possible. Individuals with fibromyalgia (FM), a chronic pain syndrome, show alterations in the integration of tactile information. This could lead to a decrease in their weight in a multisensory percept or a general disruption of multisensory integration, making it less beneficial. To assess multisensory integration, 15 participants with FM and 18 pain-free controls performed a temporal-order judgment task in which they received pairs of sequential visual, tactile (unisensory conditions), or visuotactile (multisensory condition) stimulations on the index and the thumb of the non-dominant hand and had to determine which finger was stimulated first. The task enabled us to measure the precision and accuracy of the percept in each condition. Results indicate an increase in precision in the visuotactile condition compared to the unimodal conditions in controls only, although we found no intergroup differences. The observed visuotactile precision was correlated to the precision predicted by the MLE model in both groups, suggesting an optimal integration. Finally, the weights of the sensory information were not different between the groups; however, in the group with FM, higher pain intensity was associated with smaller tactile weight. This study shows no alterations of the visuotactile integration in individuals with FM, though pain may influence tactile weight in these participants. [ABSTRACT FROM AUTHOR]

In the study of bodily awareness, the predictive coding theory has revealed that our brain continuously modulates sensory experiences to integrate them into a unitary body representation. Indeed, during multisensory illusions (e.g., the rubber hand illusion, RHI), the synchronous stroking of the participant’s concealed hand and a fake visible one creates a visuotactile conflict, generating a prediction error. Within the predictive coding framework, through sensory processing modulation, prediction errors are solved, inducing participants to feel as if touches originated from the fake hand, thus ascribing the fake hand to their own body. Here, we aimed to address sensory processing modulation under multisensory conflict, by disentangling somatosensory and visual stimuli processing that are intrinsically associated during the illusion induction. To this aim, we designed two EEG experiments, in which somatosensory- (SEPs; Experiment 1; N = 18; F = 10) and visual-evoked potentials (VEPs; Experiment 2; N = 18; F = 9) were recorded in human males and females following the RHI. Our results show that, in both experiments, ERP amplitude is significantly modulated in the illusion as compared with both control and baseline conditions, with a modality-dependent diametrical pattern showing decreased SEP amplitude and increased VEP amplitude. Importantly, both somatosensory and visual modulations occur in long-latency time windows previously associated with tactile and visual awareness, thus explaining the illusion of perceiving touch at the sight location. In conclusion, we describe a diametrical modulation of somatosensory and visual processing as the neural mechanism that allows maintaining a stable body representation, by restoring visuotactile congruency under the occurrence of multisensory conflicts. [ABSTRACT FROM AUTHOR]

The present study explored the effects of visuomotor synchrony in virtual reality during the embodiment of a full human avatar in children (aged 5–6 years) and adults. Participants viewed their virtual bodies from a first‐person perspective while they moved the body during self‐generated and structured movement. Embodiment was measured via questions and psychophysiological responses (skin conductance) to a virtual body‐threat and during both movement conditions. Both children and adults had increased feelings of ownership and agency over a virtual body during synchronous visuomotor feedback (compared to asynchronous visuomotor feedback). Children had greater ownership compared to adults during synchronous movement but did not differ from adults on agency. There were no differences in SCRs (frequency or magnitude) between children and adults, between conditions (i.e., baseline or movement conditions) or visuomotor feedback. Collectively, the study highlights the importance of visuomotor synchrony for children's ratings of embodiment for a virtual avatar from at least 5 years old, and suggests adults and children are comparable in terms of psychophysiological arousal when moving (or receiving a threat to) a virtual body. This has important implications for our understanding of the development of embodied cognition and highlights the considerable promise of exploring visuomotor VR experiences in children. [ABSTRACT FROM AUTHOR]

Humans have the remarkable ability to integrate information from different senses, which greatly facilitates the detection, localization and identification of events in the environment. About 466 million people worldwide suffer from hearing loss. Yet, the impact of hearing loss on how the senses work together is rarely investigated. Here, we investigate how a common sensory impairment, asymmetric conductive hearing loss (AHL), alters the way our senses interact by examining human orienting behaviour with normal hearing (NH) and acute AHL. This type of hearing loss disrupts auditory localization. We hypothesized that this creates a conflict between auditory and visual spatial estimates and alters how auditory and visual inputs are integrated to facilitate multisensory spatial perception. We analysed the spatial and temporal properties of saccades to auditory, visual and audiovisual stimuli before and after plugging the right ear of participants. Both spatial and temporal aspects of multisensory integration were affected by AHL. Compared with NH, AHL caused participants to make slow, inaccurate and unprecise saccades towards auditory targets. Surprisingly, increased weight on visual input resulted in accurate audiovisual localization with AHL. This came at a cost: saccade latencies for audiovisual targets increased significantly. The larger the auditory localization errors, the less participants were able to benefit from audiovisual integration in terms of saccade latency. Our results indicate that observers immediately change sensory weights to effectively deal with acute AHL and preserve audiovisual accuracy in a way that cannot be fully explained by statistical models of optimal cue integration. [ABSTRACT FROM AUTHOR]

Objective: In this cross‐sectional observational study, we aimed to investigate sensory profiles and multisensory integration processes in women with migraine using virtual dynamic interaction systems. Background: Compared to studies on unimodal sensory processing, fewer studies show that multisensory integration differs in patients with migraine. Multisensory integration of visual, auditory, verbal, and haptic modalities has not been evaluated in migraine. Method s : A 12‐min virtual dynamic interaction game consisting of four parts was played by the participants. During the game, the participants were exposed to either visual stimuli only or multisensory stimuli in which auditory, verbal, and haptic stimuli were added to the visual stimuli. A total of 78 women participants (28 with migraine without aura and 50 healthy controls) were enrolled in this prospective exploratory study. Patients with migraine and healthy participants who met the inclusion criteria were randomized separately into visual and multisensory groups: Migraine multisensory (14 adults), migraine visual (14 adults), healthy multisensory (25 adults), and healthy visual (25 adults). The Sensory Profile Questionnaire was utilized to assess the participants' sensory profiles. The game scores and survey results were analyzed. Results: In visual stimulus, the gaming performance scores of patients with migraine without aura were similar to the healthy controls, at a median (interquartile range [IQR]) of 81.8 (79.5–85.8) and 80.9 (77.1–84.2) (p = 0.149). Error rate of visual stimulus in patients with migraine without aura were comparable to healthy controls, at a median (IQR) of 0.11 (0.08–0.13) and 0.12 (0.10–0.14), respectively (p = 0,166). In multisensory stimulation, average gaming score was lower in patients with migraine without aura compared to healthy individuals (median [IQR] 82.2 [78.8–86.3] vs. 78.6 [74.0–82.4], p = 0.028). In women with migraine, exposure to new sensory modality upon visual stimuli in the fourth, seventh, and tenth rounds (median [IQR] 78.1 [74.1–82.0], 79.7 [77.2–82.5], 76.5 [70.2–82.1]) exhibited lower game scores compared to visual stimuli only (median [IQR] 82.3 [77.9–87.8], 84.2 [79.7–85.6], 80.8 [79.0–85.7], p = 0.044, p = 0.049, p = 0.016). According to the Sensory Profile Questionnaire results, sensory sensitivity, and sensory avoidance scores of patients with migraine (median [IQR] score 45.5 [41.0–54.7] and 47.0 [41.5–51.7]) were significantly higher than healthy participants (median [IQR] score 39.0 [34.0–44.2] and 40.0 [34.0–48.0], p < 0.001, p = 0.001). Conclusion: The virtual dynamic game approach showed for the first time that the gaming performance of patients with migraine without aura was negatively affected by the addition of auditory, verbal, and haptic stimuli onto visual stimuli. Multisensory integration of sensory modalities including haptic stimuli is disturbed even in the interictal period in women with migraine. Virtual games can be employed to assess the impact of sensory problems in the course of the disease. Also, sensory training could be a potential therapy target to improve multisensory processing in migraine. Plain Language Summary: Patients with migraine process sensory information differently from those without migraine, but multisensory integration (MI), or how the nervous system combines information from each of the senses, has not been studied in detail in patients with migraine. In our study, a video game was used to study the MI of four different senses including seeing, hearing, reading, and touching in 28 women with migraine without aura and 50 healthy women. The gaming performance of women with migraine was negatively affected when hearing, reading, and touching were added to the visual video game experience, and patients with migraine experienced impaired MI even when they did not have a migraine attack. [ABSTRACT FROM AUTHOR]

Our everyday perceptual experiences are grounded in the integration of information within and across our senses. Due to this direct behavioural relevance, cross‐modal integration retains a certain degree of contextual flexibility, even to social relevance. However, how social relevance modulates cross‐modal integration remains unclear. To investigate possible mechanisms, Experiment 1 tested the principles of audio‐visual integration for numerosity estimation by deriving a Bayesian optimal observer model with perceptual prior from empirical data to explain perceptual biases. Such perceptual priors may shift towards locations of high salience in the stimulus space. Our results showed that the tendency to over‐ or underestimate numerosity, expressed in the frequency and strength of fission and fusion illusions, depended on the actual event numerosity. Experiment 2 replicated the effects of social relevance on multisensory integration from Scheller & Sui, 2022 JEP:HPP, using a lower number of events, thereby favouring the opposite illusion through enhanced influences of the prior. In line with the idea that the self acts like a prior, the more frequently observed illusion (more malleable to prior influences) was modulated by self‐relevance. Our findings suggest that the self can influence perception by acting like a prior in cue integration, biasing perceptual estimates towards areas of high self‐relevance. [ABSTRACT FROM AUTHOR]