Search

Parkinson's Disease (PD)-typical declines in gait coordination are possibly explained by weakness in bilateral cortical and muscular connectivity. Here, we seek to determine whether this weakness and consequent decline in gait coordination is affected by dopamine levels. To this end, we compare cortico-cortical, cortico-muscular, and intermuscular connectivity and gait outcomes between body sides in people with PD under ON and OFF medication states, and in older adults. In our study, participants walked back and forth along a 12 m corridor. Gait events (heel strikes and toe-offs) and electrical cortical and muscular activities were measured and used to compute cortico-cortical, cortico-muscular, and intermuscular connectivity (i.e., coherences in the alpha, beta, and gamma bands), as well as features characterizing gait performance (e.g., the step-timing coordination, length, and speed). We observe that people with PD, mainly during the OFF medication, walk with reduced step-timing coordination. Additionally, our results suggest that dopamine intake in PD increases the overall cortico-muscular connectivity during the stance and swing phases of gait. We thus conclude that dopamine corrects defective feedback caused by impaired sensory-information processing and sensory-motor integration, thus increasing cortico-muscular coherences in the alpha bands and improving gait., (© 2024. The Author(s).)

Movement deterioration is the hallmark of Parkinson's disease (PD), characterized by levodopa-induced motor-fluctuations (i.e., symptoms' variability related to the medication cycle) in advanced stages. However, motor symptoms are typically too sporadically and/or subjectively assessed, ultimately preventing the effective monitoring of their progression, and thus leading to suboptimal treatment/therapeutic choices. Smartwatches (SW) enable a quantitative-oriented approach to motor-symptoms evaluation, namely home-based monitoring (HBM) using an embedded inertial measurement unit. Studies validated such approach against in-clinic evaluations. In this work, we aimed at delineating personalized motor-fluctuations' profiles, thus capturing individual differences. 21 advanced PD patients with motor fluctuations were monitored for 2 weeks using a SW and a smartphone-dedicated app (Intel Pharma Analytics Platform). The SW continuously collected passive data (tremor, dyskinesia, level of activity using dedicated algorithms) and active data, i.e., time-up-and-go, finger tapping, hand tremor and hand rotation carried out daily, once in OFF and once in ON levodopa periods. We observed overall high compliance with the protocol. Furthermore, we observed striking differences among the individual patterns of symptoms' levodopa-related variations across the HBM, allowing to divide our participants among four data-driven, motor-fluctuations' profiles. This highlights the potential of HBM using SW technology for revolutionizing clinical practices., (© 2024. The Author(s).)

Accumulating evidence in the last decades has given rise to a new theory of brain organization, positing that cortical regions are recruited for specific tasks irrespective of the sensory modality via which information is channeled. For instance, the visual reading network has been shown to be recruited for reading via the tactile Braille code in congenitally blind adults. Yet, how rapidly non-typical sensory input modulates activity in typically visual regions is yet to be explored. To this aim, we developed a novel reading orthography, termed OVAL, enabling congenitally blind adults to quickly acquire reading via the auditory modality. OVAL uses the EyeMusic, a visual-to-auditory sensory-substitution-device (SSD) to transform visually presented letters optimized for auditory transformation into sound. Using fMRI, we show modulation in the right ventral visual stream following 2-h of same-day training. Crucially, following more extensive training (i.e., ∼12 h) we show that OVAL reading recruits the left ventral visual stream including the location of the Visual Word Form Area, a key graphene-responsive region within the visual reading network. Our results show that while after 2 h of SSD training we can already observe the recruitment of the deprived ventral visual stream by auditory stimuli, computation-selective cross-modal recruitment requires longer training to establish., (Copyright © 2023. Published by Elsevier Ltd.)

Introduction: Freezing of gait (FoG) is a debilitating symptom of advanced Parkinson's disease (PD) characterized by a sudden, episodic stepping arrest despite the intention to continue walking. The etiology of FoG is still unknown, but accumulating evidence unraveled physiological signatures of the autonomic nervous system (ANS) around FoG episodes. Here we aim to investigate for the first time whether detecting a predisposition for upcoming FoG events from ANS activity measured at rest is possible., Methods: We recorded heart-rate for 1-min while standing in 28 persons with PD with FoG (PD + FoG), while OFF, and in 21 elderly controls (EC). Then, PD + FoG participants performed walking trials containing FoG-triggering events (e.g., turns). During these trials, n = 15 did experience FoG (PD + FoG+), while n = 13 did not (PD + FoG-). Most PD participants (n = 20: 10 PD + FoG+ and 10 PD + FoG-) repeated the experiment 2-3 weeks later, while ON, and none experienced FoG. We then analyzed heart-rate variability (HRV), i.e., the fluctuations in time intervals between adjacent heartbeats, mainly generated by brain-heart interactions., Results: During OFF, HRV was significantly lower in PD + FoG + participants, reflecting imbalanced sympathetic/parasympathetic activity and disrupted self-regulatory capacity. PD + FoG- and EC participants showed comparable (higher) HRV. During ON, HRV did not differ among groups. HRV values did not correlate with age, PD duration, levodopa consumption, nor motor -symptoms severity scores., Conclusions: Overall, these results document for the first time a relation between HRV at rest and FoG presence/absence during gait trials, expanding previous evidence regarding the involvement of ANS in FoG., Competing Interests: Declaration of competing interest None., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Background: Vertical perturbations are one major cause of falling. Incidentally, while conducting a comprehensive study comparing effects of vertical versus horizontal perturbations, we commonly observed a stumbling-like response induced by upward perturbations. The present study describes and characterizes this stumbling effect., Methods: Fourteen individuals (10 male; 27 ± 4 yr) walked self-paced on a treadmill embedded in a moveable platform and synchronized to a virtual reality system. Participants experienced 36 perturbations (12 types). Here, we report only on upward perturbations. We determined stumbling based on visual inspection of recorded videos, and calculated stride time and anteroposterior, whole-body center of mass (COM) distance relative to the heel, i.e., COM-to-heel distance, extrapolated COM (xCOM) and margin of stability (MOS) before and after perturbation., Results: From 68 upward perturbations across 14 participants, 75% provoked stumbling. During the first gait cycle post-perturbation, stride time decreased in the perturbed foot and the unperturbed foot (perturbed = 1.004 s vs. baseline = 1.119 s and unperturbed = 1.017 s vs. baseline = 1.125 s, p < 0.001). In the perturbed foot, the difference was larger in stumbling-provoking perturbations (stumbling: 0.15 s vs. non-stumbling: 0.020 s, p = 0.004). In addition, the COM-to-heel distance decreased during the first and second gait cycles after perturbation in both feet (first cycle: 0.58 m, second cycle: 0.665 m vs. baseline: 0.72 m, p-values<0.001). During the first gait cycle, COM-to-heel distance was larger in the perturbed foot compared to the unperturbed foot (perturbed foot: 0.61 m vs. unperturbed foot: 0.55 m, p < 0.001). MOS decreased during the first gait cycle, whereas the xCOM increased during the second through fourth gait cycles post-perturbation (maximal xCOM at baseline: 0.5 m, second cycle: 0.63 m, third cycle: 0.66 m, fourth cycle: 0.64 m, p < 0.001)., Conclusions: Our results show that upward perturbations can induce a stumbling effect, which - with further testing - has the potential to be translated into balance training to reduce fall risk, and for method standardization in research and clinical practice., (Copyright © 2023. Published by Elsevier B.V.)

Humans, like most animals, integrate sensory input in the brain from different sensory modalities. Yet humans are distinct in their ability to grasp symbolic input, which is interpreted into a cognitive mental representation of the world. This representation merges with external sensory input, providing modality integration of a different sort. This study evaluates the Topo-Speech algorithm in the blind and visually impaired. The system provides spatial information about the external world by applying sensory substitution alongside symbolic representations in a manner that corresponds with the unique way our brains acquire and process information. This is done by conveying spatial information, customarily acquired through vision, through the auditory channel, in a combination of sensory (auditory) features and symbolic language (named/spoken) features. The Topo-Speech sweeps the visual scene or image and represents objects' identity by employing naming in a spoken word and simultaneously conveying the objects' location by mapping the x-axis of the visual scene or image to the time it is announced and the y-axis by mapping the location to the pitch of the voice. This proof of concept study primarily explores the practical applicability of this approach in 22 visually impaired and blind individuals. The findings showed that individuals from both populations could effectively interpret and use the algorithm after a single training session. The blind showed an accuracy of 74.45%, while the visually impaired had an average accuracy of 72.74%. These results are comparable to those of the sighted, as shown in previous research, with all participants above chance level. As such, we demonstrate practically how aspects of spatial information can be transmitted through non-visual channels. To complement the findings, we weigh in on debates concerning models of spatial knowledge (the persistent, cumulative, or convergent models) and the capacity for spatial representation in the blind. We suggest the present study's findings support the convergence model and the scenario that posits the blind are capable of some aspects of spatial representation as depicted by the algorithm comparable to those of the sighted. Finally, we present possible future developments, implementations, and use cases for the system as an aid for the blind and visually impaired., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Maimon, Wald, Ben Oz, Codron, Netzer, Heimler and Amedi.)

As neuroscience and rehabilitative techniques advance, age-old questions concerning the visual experience of those who gain sight after blindness, once thought to be philosophical alone, take center stage and become the target for scientific inquiries. In this study, we employ a battery of visual perception tasks to study the unique experience of a small group of children who have undergone vision-restoring cataract removal surgery as part of the Himalayan Cataract Project. We tested their abilities to perceive in three dimensions (3D) using a binocular rivalry task and the Brock string task, perceive visual illusions, use cross-modal mappings between touch and vision, and spatially group based on geometric cues. Some of the children in this study gained a sense of sight for the first time in their lives, having been born with bilateral congenital cataracts, while others suffered late-onset blindness in one eye alone. This study simultaneously supports yet raises further questions concerning Hubel and Wiesel's critical periods theory and provides additional insight into Molyneux's problem, the ability to correlate vision with touch quickly. We suggest that our findings present a relatively unexplored intermediate stage of 3D vision development. Importantly, we spotlight some essential geometrical perception visual abilities that strengthen the idea that spontaneous geometry intuitions arise independently from visual experience (and education), thus replicating and extending previous studies. We incorporate a new model, not previously explored, of testing children with congenital cataract removal surgeries who perform the task via vision. In contrast, previous work has explored these abilities in the congenitally blind via touch. Taken together, our findings provide insight into the development of what is commonly known as the visual system in the visually deprived and highlight the need to further empirically explore an amodal, task-based interpretation of specializations in the development and structure of the brain. Moreover, we propose a novel objective method, based on a simple binocular rivalry task and the Brock string task, for determining congenital (early) vs. late blindness where medical history and records are partial or lacking (e.g., as is often the case in cataract removal cases)., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Maimon, Netzer, Heimler and Amedi.)

Freezing of Gait (FOG) is among the most debilitating symptoms of Parkinson's Disease (PD), characterized by a sudden inability to generate effective stepping. In preparation for the development of a real-time FOG prediction and intervention device, this work presents a novel FOG prediction algorithm based on detection of altered interlimb coordination of the legs, as measured using two inertial movement sensors and analyzed using a wavelet coherence algorithm., Methods: Fourteen participants with PD (in OFF state) were asked to walk in challenging conditions (e.g. with turning, dual-task walking, etc.) while wearing inertial motion sensors (waist, 2 shanks) and being videotaped. Occasionally, participants were asked to voluntarily stop (VOL). FOG and VOL events were identified by trained researchers based on videos. Wavelet analysis was performed on shank sagittal velocity signals and a synchronization loss threshold (SLT) was defined and compared between FOG and VOL. A proof-of-concept analysis was performed for a subset of the data to obtain preliminary classification characteristics of the novel measure., Results: 128 FOG and 42 VOL episodes were analyzed. SLT occurred earlier for FOG (MED=1.81 sec prior to stop, IQR=1.57) than for VOL events (MED=0.22 sec, IQR=0.76) (Z=-4.3, p<0.001, ES=1.15). These time differences were not related with measures of disease severity. Preliminary results demonstrate sensitivity of 98%, specificity of 42% (mostly due to 'turns' detection) and balanced accuracy of 70% for SLT-based prediction, with good differentiation between FOG and VOL., Conclusions: Wavelet analysis provides a relatively simple, promising approach for prediction of FOG in people with PD.

Previous evidence suggests that visual experience is crucial for the emergence and tuning of the typical neural system for face recognition. To challenge this conclusion, we trained congenitally blind adults to recognize faces via visual-to-auditory sensory-substitution (SDD). Our results showed a preference for trained faces over other SSD-conveyed visual categories in the fusiform gyrus and in other known face-responsive-regions of the deprived ventral visual stream. We also observed a parametric modulation in the same cortical regions, for face orientation (upright vs. inverted) and face novelty (trained vs. untrained). Our results strengthen the conclusion that there is a predisposition for sensory-independent and computation-specific processing in specific cortical regions that can be retained in life-long sensory deprivation, independently of previous perceptual experience. They also highlight that if the right training is provided, such cortical preference maintains its tuning to what were considered visual-specific face features., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Arbel, Heimler and Amedi.)

The phenomenology of the blind has provided an age-old, unparalleled means of exploring the enigmatic link between the brain and mind. This paper delves into the unique phenomenological experience of a man who became blind in adulthood. He subsequently underwent both an Argus II retinal prosthesis implant and training, and extensive training on the EyeMusic visual to auditory sensory substitution device (SSD), thereby becoming the first reported case to date of dual proficiency with both devices. He offers a firsthand account into what he considers the great potential of combining sensory substitution devices with visual prostheses as part of a complete visual restoration protocol. While the Argus II retinal prosthesis alone provided him with immediate visual percepts by way of electrically stimulated phosphenes elicited by the device, the EyeMusic SSD requires extensive training from the onset. Yet following the extensive training program with the EyeMusic sensory substitution device, our subject reports that the sensory substitution device allowed him to experience a richer, more complex perceptual experience, that felt more "second nature" to him, while the Argus II prosthesis (which also requires training) did not allow him to achieve the same levels of automaticity and transparency. Following long-term use of the EyeMusic SSD, our subject reported that visual percepts representing mainly, but not limited to, colors portrayed by the EyeMusic SSD are elicited in association with auditory stimuli, indicating the acquisition of a high level of automaticity. Finally, the case study indicates an additive benefit to the combination of both devices on the user's subjective phenomenological visual experience., (Copyright © 2022 The Authors. Published by Elsevier Ltd.. All rights reserved.)

Unlike sighted individuals, congenitally blind individuals have little to no experience with face shapes. Instead, they rely on non-shape cues, such as voices, to perform character identification. The extent to which face-shape perception can be learned in adulthood via a different sensory modality (i.e., not vision) remains poorly explored. We used a visual-to-auditory Sensory Substitution Device (SSD) that enables conversion of visual images to the auditory modality while preserving their visual characteristics. Expert SSD users were systematically taught to identify cartoon faces via audition. Following a tailored training program lasting ~ 12 h, congenitally blind participants successfully identified six trained faces with high accuracy. Furthermore, they effectively generalized their identification to the untrained, inverted orientation of the learned faces. Finally, after completing the extensive 12-h training program, participants learned six new faces within 2 additional hours of training, suggesting internalization of face-identification processes. Our results document for the first time that facial features can be processed through audition, even in the absence of visual experience across the lifespan. Overall, these findings have important implications for both non-visual object recognition and visual rehabilitation practices and prompt the study of the neural processes underlying auditory face perception in the absence of vision., (© 2022. The Author(s).)

Topographic maps, a key principle of brain organization, emerge during development. It remains unclear, however, whether topographic maps can represent a new sensory experience learned in adulthood. MaMe, a congenitally blind individual, has been extensively trained in adulthood for perception of a 2D auditory-space (soundscape) where the y- and x-axes are represented by pitch and time, respectively. Using population receptive field mapping we found neural populations tuned topographically to pitch, not only in the auditory cortices but also in the parietal and occipito-temporal cortices. Topographic neural tuning to time was revealed in the parietal and occipito-temporal cortices. Some of these maps were found to represent both axes concurrently, enabling MaMe to represent unique locations in the soundscape space. This case study provides proof of concept for the existence of topographic maps tuned to the newly learned soundscape dimensions. These results suggest that topographic maps can be adapted or recycled in adulthood to represent novel sensory experiences., Competing Interests: Declaration of Competing Interests There is no conflict of interest to declare., (Copyright © 2021. Published by Elsevier Inc.)

Geometrical intuitions spontaneously drive visuo-spatial reasoning in human adults, children and animals. Is their emergence intrinsically linked to visual experience, or does it reflect a core property of cognition shared across sensory modalities? To address this question, we tested the sensitivity of blind-from-birth adults to geometrical-invariants using a haptic deviant-figure detection task. Blind participants spontaneously used many geometric concepts such as parallelism, right angles and geometrical shapes to detect intruders in haptic displays, but experienced difficulties with symmetry and complex spatial transformations. Across items, their performance was highly correlated with that of sighted adults performing the same task in touch (blindfolded) and in vision, as well as with the performances of uneducated preschoolers and Amazonian adults. Our results support the existence of an amodal core-system of geometry that arises independently of visual experience. However, performance at selecting geometric intruders was generally higher in the visual compared to the haptic modality, suggesting that sensory-specific spatial experience may play a role in refining the properties of this core-system of geometry., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Can humans extend and augment their natural perceptions during adulthood? Here, we address this fascinating question by investigating the extent to which it is possible to successfully augment visual spatial perception to include the backward spatial field (a region where humans are naturally blind) via other sensory modalities (i.e., audition). We thus developed a sensory-substitution algorithm, the "Topo-Speech" which conveys identity of objects through language, and their exact locations via vocal-sound manipulations, namely two key features of visual spatial perception. Using two different groups of blindfolded sighted participants, we tested the efficacy of this algorithm to successfully convey location of objects in the forward or backward spatial fields following ~ 10 min of training. Results showed that blindfolded sighted adults successfully used the Topo-Speech to locate objects on a 3 × 3 grid either positioned in front of them (forward condition), or behind their back (backward condition). Crucially, performances in the two conditions were entirely comparable. This suggests that novel spatial sensory information conveyed via our existing sensory systems can be successfully encoded to extend/augment human perceptions. The implications of these results are discussed in relation to spatial perception, sensory augmentation and sensory rehabilitation.

Perceiving the spatial location and physical dimensions of touched objects is crucial for goal-directed actions. To achieve this, our brain transforms skin-based coordinates into a reference frame by integrating visual and posture information. In the current study, we examine the role of posture in mapping tactile sensations to a visual image. We developed a new visual-to-touch sensory substitution device that transforms images into a sequence of vibrations on the arm. 52 blindfolded participants performed spatial recognition tasks in three different arm postures and had to switch postures between trial blocks. As participants were not told which side of the device is down and which is up, they could choose how to map its vertical axis in their responses. Contrary to previous findings, we show that new proprioceptive inputs can be overridden in mapping tactile sensations. We discuss the results within the context of the spatial task and the various sensory contributions to the process.

Reading is a unique human cognitive skill and its acquisition was proven to extensively affect both brain organization and neuroanatomy. Differently from western sighted individuals, literacy rates via tactile reading systems, such as Braille, are declining, thus imposing an alarming threat to literacy among non-visual readers. This decline is due to many reasons including the length of training needed to master Braille, which must also include extensive tactile sensitivity exercises, the lack of proper Braille instruction and the high costs of Braille devices. The far-reaching consequences of low literacy rates, raise the need to develop alternative, cheap and easy-to-master non-visual reading systems. To this aim, we developed OVAL, a new auditory orthography based on a visual-to-auditory sensory-substitution algorithm. Here we present its efficacy for successful words-reading, and investigation of the extent to which redundant features defining characters (i.e., adding specific colors to letters conveyed into audition via different musical instruments) facilitate or impede auditory reading outcomes. Thus, we tested two groups of blindfolded sighted participants who were either exposed to a monochromatic or to a color version of OVAL. First, we showed that even before training, all participants were able to discriminate between 11 OVAL characters significantly more than chance level. Following 6 hours of specific OVAL training, participants were able to identify all the learned characters, differentiate them from untrained letters, and read short words/pseudo-words of up to 5 characters. The Color group outperformed the Monochromatic group in all tasks, suggesting that redundant characters' features are beneficial for auditory reading. Overall, these results suggest that OVAL is a promising auditory-reading tool that can be used by blind individuals, by people with reading deficits as well as for the investigation of reading specific processing dissociated from the visual modality., Competing Interests: The authors have declared that no competing interests exist.

We review here studies with visual and auditory deprived/recovery populations to argue for the need of a redefinition of the crucial role of unisensory-specific experiences during critical periods (CPs) on the emergence of sensory specializations. Specifically, we highlight that these studies, with emphasis on results with congenitally blind adults using visual sensory-substitution devices, consistently document that typical specializations (e.g., in visual cortex) could arise also in adulthood via other sensory modalities (e.g., audition), even after relatively short (tailored) trainings. Altogether, these studies suggest that 1) brain specializations are driven by sensory-independent computations rather than by unisensory-specific inputs and that 2) specific computation-oriented trainings, even if executed during adulthood, can guide the sensory brain to display/recover, core properties of brain specializations. We thus introduce here the concept of a reversible plasticity gradient, namely that brain plasticity spontaneously decreases with age in line with CPs theory, but it nonetheless can be reignited across the lifespan, even without any exposure to unisensory (e.g., visual) experiences during childhood, thus diverging dramatically from CPs assumptions., (Copyright © 2020 Elsevier Ltd. All rights reserved.)

The study of selective attention in people with profound deafness has repeatedly documented enhanced attention to the peripheral regions of the visual field compared to hearing controls. This finding emerged from covert attention studies (i.e., without eye-movements) involving extremely simplified visual scenes and comprising few visual items. In this study, we aimed to test whether this key finding extends also to overt attention, using a more ecologically valid experimental context in which complex naturalistic images were presented for 3 s. In Experiment 1 (N = 35), all images contained a single central object superimposed on a congruent naturalistic background (e.g., a tiger in the woods). At the end of the visual exploration phase, an incidental memory task probed the participants' recollection of the seen central objects and image backgrounds. Results showed that hearing controls explored and remembered the image backgrounds more than deaf participants, who lingered on the central object to a greater extent. In Experiment 2 we aimed to disentangle if this behaviour of deaf participants reflected a bias in overt space-based attention towards the centre of the image, or instead, enhanced object-centred attention. We tested new participants (N = 42) in the visual exploration task adding images with lateralized objects, as well as images with multiple object or images without any object. Results confirmed increased exploration of objects in deaf participants. Taken together our novel findings show limitations of the well-known peripheral attention bias of deaf people and suggest that visual object-centred attention may also change after prolonged auditory deprivation., (Copyright © 2019 Elsevier B.V. All rights reserved.)

Visual-to-auditory Sensory Substitution Devices (SSDs) are a family of non-invasive devices for visual rehabilitation aiming at conveying whole-scene visual information through the intact auditory modality. Although proven effective in lab environments, the use of SSDs has yet to be systematically tested in real-life situations. To start filling this gap, in the present work we tested the ability of expert SSD users to filter out irrelevant background noise while focusing on the relevant audio information. Specifically, nine blind expert users of the EyeMusic visual-to-auditory SSD performed a series of identification tasks via SSDs (i.e., shape, color, and conjunction of the two features). Their performance was compared in two separate conditions: silent baseline, and with irrelevant background sounds from real-life situations, using the same stimuli in a pseudo-random balanced design. Although the participants described the background noise as disturbing, no significant performance differences emerged between the two conditions (i.e., noisy; silent) for any of the tasks. In the conjunction task (shape and color) we found a non-significant trend for a disturbing effect of the background noise on performance. These findings suggest that visual-to-auditory SSDs can indeed be successfully used in noisy environments and that users can still focus on relevant auditory information while inhibiting irrelevant sounds. Our findings take a step towards the actual use of SSDs in real-life situations while potentially impacting rehabilitation of sensory deprived individuals.

Background: Hearing loss is becoming a real social and health problem. Its prevalence in the elderly is an epidemic. The risk of developing hearing loss is also growing among younger people. If left untreated, hearing loss can perpetuate development of neurodegenerative diseases, including dementia. Despite recent advancements in hearing aid (HA) and cochlear implant (CI) technologies, hearing impaired users still encounter significant practical and social challenges, with or without aids. In particular, they all struggle with understanding speech in challenging acoustic environments, especially in presence of a competing speaker., Objectives: In the current proof-of-concept study we tested whether multisensory stimulation, pairing audition and a minimal-size touch device would improve intelligibility of speech in noise., Methods: To this aim we developed an audio-to-tactile sensory substitution device (SSD) transforming low-frequency speech signals into tactile vibrations delivered on two finger tips. Based on the inverse effectiveness law, i.e., multisensory enhancement is strongest when signal-to-noise ratio is lowest between senses, we embedded non-native language stimuli in speech-like noise and paired it with a low-frequency input conveyed through touch., Results: We found immediate and robust improvement in speech recognition (i.e. in the Signal-To-Noise-ratio) in the multisensory condition without any training, at a group level as well as in every participant. The reported improvement at the group-level of 6 dB was indeed major considering that an increase of 10 dB represents a doubling of the perceived loudness., Conclusions: These results are especially relevant when compared to previous SSD studies showing effects in behavior only after a demanding cognitive training. We discuss the implications of our results for development of SSDs and of specific rehabilitation programs for the hearing impaired either using or not using HAs or CIs. We also discuss the potential application of such a set-up for sense augmentation, such as when learning a new language.

Multisensory interactions in deaf cognition are largely unexplored. Unisensory studies suggest that behavioral/neural changes may be more prominent for visual compared to tactile processing in early deaf adults. Here we test whether such an asymmetry results in increased saliency of vision over touch during visuo-tactile interactions. About 23 early deaf and 25 hearing adults performed two consecutive visuo-tactile spatial interference tasks. Participants responded either to the elevation of the tactile target while ignoring a concurrent visual distractor at central or peripheral locations (respond to touch/ignore vision), or they performed the opposite task (respond to vision/ignore touch). Multisensory spatial interference emerged in both tasks for both groups. Crucially, deaf participants showed increased interference compared to hearing adults when they attempted to respond to tactile targets and ignore visual distractors, with enhanced difficulties with ipsilateral visual distractors. Analyses on task-order revealed that in deaf adults, interference of visual distractors on tactile targets was much stronger when this task followed the task in which vision was behaviorally relevant (respond to vision/ignore touch). These novel results suggest that behavioral/neural changes related to early deafness determine enhanced visual dominance during visuo-tactile multisensory conflict., (© The Author 2017. Published by Oxford University Press. All rights reserved. For Permissions, please email: journals.permissions@oup.com.)

How do the anatomically consistent functional selectivities of the brain emerge? A new study by Bola and colleagues reveals task selectivity in auditory rhythm-selective areas in congenitally deaf adults perceiving visual rhythm sequences. Here, we contextualize this result with accumulating evidence from animal and human studies supporting sensory-independent task specializations as a comprehensive principle shaping brain (re)organization., (Copyright © 2017 Elsevier Ltd. All rights reserved.)

The aim of the present study was to investigate the impact of dynamic distractors on the time-course of oculomotor selection using saccade trajectory deviations. Participants were instructed to make a speeded eye movement (pro-saccade) to a target presented above or below the fixation point while an irrelevant distractor was presented. Four types of distractors were varied within participants: (1) static, (2) flicker, (3) rotating apparent motion and (4) continuous motion. The eccentricity of the distractor was varied between participants. The results showed that saccadic trajectories curved towards distractors presented near the vertical midline; no reliable deviation was found for distractors presented further away from the vertical midline. Differences between the flickering and rotating distractor were found when distractor eccentricity was small and these specific effects developed over time such that there was a clear differentiation between saccadic deviation based on apparent motion for long-latency saccades, but not short-latency saccades. The present results suggest that the influence on performance of apparent motion stimuli is relatively delayed and acts in a more sustained manner compared to the influence of salient static, flickering and continuous moving stimuli.

In 2 experiments we investigated attentional orienting to nonpredictive social and nonsocial cues in deaf observers. In Experiment 1a, 22 early deaf adults and 23 hearing controls performed a peripheral shape-discrimination task, while uninformative central gaze cues validly and invalidly cued the location of the target. As an adaptation to the lack of audition, we expected deaf adults to show a larger impact of gaze cuing on attentional orienting compared with hearing controls. However, contrary to our predictions, deaf participants did not respond faster to cued compared with uncued targets (gaze-cuing effect; GCE), and this behavior partly correlated with early sign language acquisition. Experiment 1b showed a reliable GCE in 13 hearing native signers, thus excluding a key role of early sign language acquisition in explaining the lack of GCE in the response times of deaf participants. To test whether the resistance to uninformative central cues extends to nonsocial cues, in Experiment 2 nonpredictive arrow cues were presented to 14 deaf and 14 hearing participants. Both groups of participants showed a comparable arrow-cuing effect. Together, our findings suggest that deafness may selectively limit attentional-orienting triggered by central irrelevant gaze cues. Possible implications for plasticity related to deafness are discussed., ((c) 2015 APA, all rights reserved).)

Evidence of task-specific sensory-independent (TSSI) plasticity from blind and deaf populations has led to a better understanding of brain organization. However, the principles determining the origins of this plasticity remain unclear. We review recent data suggesting that a combination of the connectivity bias and sensitivity to task-distinctive features might account for TSSI plasticity in the sensory cortices as a whole, from the higher-order occipital/temporal cortices to the primary sensory cortices. We discuss current theories and evidence, open questions and related predictions. Finally, given the rapid progress in visual and auditory restoration techniques, we address the crucial need to develop effective rehabilitation approaches for sensory recovery., (Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.)

Previous work investigating the consequence of bilateral deafness on attentional selection suggests that experience-dependent changes in this population may result in increased automatic processing of stimulus-driven visual information (e.g., saliency). However, adaptive behavior also requires observers to prioritize goal-driven information relevant to the task at hand. In order to investigate whether auditory deprivation alters the balance between these two components of attentional selection, we assessed the time-course of overt visual selection in deaf adults. Twenty early-deaf adults and twenty hearing controls performed an oculomotor additional singleton paradigm. Participants made a speeded eye-movement to a unique orientation target, embedded among homogenous non-targets and one additional unique orientation distractor that was more, equally or less salient than the target. Saliency was manipulated through color. For deaf participants proficiency in sign language was assessed. Overall, results showed that fast initiated saccades were saliency-driven, whereas later initiated saccades were goal-driven. However, deaf participants were overall slower than hearing controls at initiating saccades and also less captured by task-irrelevant salient distractors. The delayed oculomotor behavior of deaf adults was not explained by any of the linguistic measures acquired. Importantly, a multinomial model applied to the data revealed a comparable evolution over time of the underlying saliency- and goal-driven processes between the two groups, confirming the crucial role of saccadic latencies in determining the outcome of visual selection performance. The present findings indicate that prioritization of saliency-driven information is not an unavoidable phenomenon in deafness. Possible neural correlates of the documented behavioral effect are also discussed., (Copyright © 2015 Elsevier Inc. All rights reserved.)

Action videogame players (AVGPs) have been shown to outperform nongamers (NVGPs) in covert visual attention tasks. These advantages have been attributed to improved top-down control in this population. The time course of visual selection, which permits researchers to highlight when top-down strategies start to control performance, has rarely been investigated in AVGPs. Here, we addressed specifically this issue through an oculomotor additional-singleton paradigm. Participants were instructed to make a saccadic eye movement to a unique orientation singleton. The target was presented among homogeneous nontargets and one additional orientation singleton that was more, equally, or less salient than the target. Saliency was manipulated in the color dimension. Our results showed similar patterns of performance for both AVGPs and NVGPs: Fast-initiated saccades were saliency-driven, whereas later-initiated saccades were more goal-driven. However, although AVGPs were faster than NVGPs, they were also less accurate. Importantly, a multinomial model applied to the data revealed comparable underlying saliency-driven and goal-driven functions for the two groups. Taken together, the observed differences in performance are compatible with the presence of a lower decision bound for releasing saccades in AVGPs than in NVGPs, in the context of comparable temporal interplay between the underlying attentional mechanisms. In sum, the present findings show that in both AVGPs and NVGPs, the implementation of top-down control in visual selection takes time to come about, and they argue against the idea of a general enhancement of top-down control in AVGPs.

Although cross-modal recruitment of early sensory areas in deafness and blindness is well established, the constraints and limits of these plastic changes remain to be understood. In the case of human deafness, for instance, it is known that visual, tactile or visuo-tactile stimuli can elicit a response within the auditory cortices. Nonetheless, both the timing of these evoked responses and the functional contribution of cross-modally recruited areas remain to be ascertained. In the present study, we examined to what extent auditory cortices of deaf humans participate in high-order visual processes, such as visual change detection. By measuring visual ERPs, in particular the visual MisMatch Negativity (vMMN), and performing source localization, we show that individuals with early deafness (N=12) recruit the auditory cortices when a change in motion direction during shape deformation occurs in a continuous visual motion stream. Remarkably this "auditory" response for visual events emerged with the same timing as the visual MMN in hearing controls (N=12), between 150 and 300 ms after the visual change. Furthermore, the recruitment of auditory cortices for visual change detection in early deaf was paired with a reduction of response within the visual system, indicating a shift from visual to auditory cortices of part of the computational process. The present study suggests that the deafened auditory cortices participate at extracting and storing the visual information and at comparing on-line the upcoming visual events, thus indicating that cross-modally recruited auditory cortices can reach this level of computation., (Copyright © 2014 Elsevier Inc. All rights reserved.)

Early deaf adults typically respond faster than hearing controls when performing a speeded simple detection on visual targets. Whether this response time advantage can generalise to another intact modality (touch) or it is instead specific to visual processing remained unexplored. We tested eight early deaf adults and twelve hearing controls in a simple detection task, with visual or tactile targets delivered on the arms and occupying the same locations in external space. Catch trials were included in the experimental paradigm. Results revealed a response time advantage in deaf adults compared to hearing controls, selectively for visual targets. This advantage did not extend to touch. The number of anticipation errors was negligible and comparable in both groups. The present findings strengthen the notion that response time advantage in deaf adults emerges as a consequence of changes specific to visual processing. They also exclude the involvement of sensory-unspecific cognitive mechanisms in this improvement (e.g. increased impulsivity in initiation of response, longer-lasting sustained attention or higher motivation to perform the task). Finally, they provide initial evidence that the intact sensory modalities can reorganise independently from each other following early auditory deprivation.