Search

When a sound is presented in the free field at a location that remains fixed to the head during whole-body rotation in darkness, it is heard displaced in the direction opposing the rotation. This phenomenon is known as the audiogyral illusion. Consequently, the subjective auditory median plane (AMP) (the plane where the binaural difference cues for sound localization are perceived to be zero) shifts in the direction of body rotation. Recent experiments, however, have suggested opposite AMP results when using a fixation light that also moves with the head. Although in this condition the eyes remain stationary in the head, an ocular pursuit signal cancels the vestibulo-ocular reflex, which could induce an additional AMP shift. We tested whether the AMP is influenced by vestibular signals, eye position or eye velocity. We rotated subjects sinusoidally at different velocities, either in darkness or with a head-fixed fixation light, while they judged the laterality (left vs. right with respect to the midsagittal plane of the head) of broadband sounds presented over headphones. Subjects also performed the same task without vestibular stimulation while tracking a sinusoidally moving visual target, which mimicked the average eye-movement patterns of the vestibular experiments in darkness. Results show that whole-body rotation in darkness induces a shift of the AMP in the direction of body rotation. In contrast, we obtained no significant AMP change when a fixation light was used. The pursuit experiments showed a shift of the AMP in the direction of eccentric eye position but not at peak pursuit velocity. We therefore conclude that the vestibular-induced shift in average eye position underlies both the audiogyral illusion and the AMP shift. [ABSTRACT FROM AUTHOR]

Orienting the eyes towards a peripheral sound source calls for a transformation of the head-centred sound coordinates into an oculocentric motor command, which requires an estimate of current eye position. Current models of saccadic control explain spatial accuracy by oculocentric transformations that rely on efference copies of relative eye-displacement signals, rather than on absolute eye position in the orbit. In principle, the gaze-control system could keep track of instantaneous eye position by vector addition of intervening eye-displacement commands. However, given that each motor update is endowed with some noise, the neural estimate of eye orientation is then expected to become noisier with increasing number of intervening saccades. As a consequence, the localization response will also be noisier. According to the alternative, in which target updates rely on feedback of the current eye position, such an increase in errors would be absent. In an attempt to dissociate these hypotheses, we studied the influence of the accumulation of oculomotor commands prior to a sound-localization response. Head-restrained subjects generated voluntary eye movements in darkness in random directions for a period between 0.2 and 15 s, after which they rapidly reoriented the eyes towards a brief sound burst. The results demonstrate that the audiomotor system programmes the orienting response on the basis of actual eye position, rather than on an accumulated estimate from intervening eye displacements. [ABSTRACT FROM AUTHOR]

Orienting responses to audiovisual events in the environment can benefit markedly by the integration of visual and auditory spatial information. However, logically, audiovisual integration would only be considered successful for stimuli that are spatially and temporally aligned, as these would be emitted by a single object in space–time. As humans do not have prior knowledge about whether novel auditory and visual events do indeed emanate from the same object, such information needs to be extracted from a variety of sources. For example, expectation about alignment or misalignment could modulate the strength of multisensory integration. If evidence from previous trials would repeatedly favour aligned audiovisual inputs, the internal state might also assume alignment for the next trial, and hence react to a new audiovisual event as if it were aligned. To test for such a strategy, subjects oriented a head-fixed pointer as fast as possible to a visual flash that was consistently paired, though not always spatially aligned, with a co-occurring broadband sound. We varied the probability of audiovisual alignment between experiments. Reaction times were consistently lower in blocks containing only aligned audiovisual stimuli than in blocks also containing pseudorandomly presented spatially disparate stimuli. Results demonstrate dynamic updating of the subject’s prior expectation of audiovisual congruency. We discuss a model of prior probability estimation to explain the results. [ABSTRACT FROM AUTHOR]

Visual stimuli are initially represented in a retinotopic reference frame. To maintain spatial accuracy of gaze (i.e., eye in space) despite intervening eye and head movements, the visual input could be combined with dynamic feedback about ongoing gaze shifts. Alternatively, target coordinates could be updated in advance by using the preprogrammed gaze-motor command ("predictive remapping"). So far, previous experiments have not dissociated these possibilities. Here we study whether the visuomotor system accounts for saccadic eye-head movements that occur during target presentation. In this case, the system has to deal with fast dynamic changes of the retinal input and with highly variable changes in relative eye and head movements that cannot be preprogrammed by the gaze control system. We performed visual-visual double-step experiments in which a brief (50-ms) stimulus was presented during a saccadic eye-head gaze shift toward a previously flashed visual target. Our results show that gaze shifts remain accurate under these dynamic conditions, even for stimuli presented near saccade onset, and that eyes and head are driven in oculocentric and craniocentric coordinates, respectively. These results cannot be explained by a predictive remapping scheme. We propose that the visuomotor system adequately processes dynamic changes in visual input that result from self-initiated gaze shifts, to construct a stable representation of visual targets in an absolute, supraretinal (e.g., world) reference frame. Predictive remapping may subserve transsaccadic integration, thus enabling perception of a stable visual scene despite eye movements, whereas dynamic feedback ensures accurate actions (e.g., eye-head orienting) to a selected goal. [ABSTRACT FROM AUTHOR]

Saccades to combined audiovisual stimuli often have reduced saccadic reaction times (SRTs) compared with those to unimodal stimuli. Neurons in the intermediate/deep layers of the superior colliculus (dSC) are capable of integrating converging sensory inputs to influence the time to saccade initiation. To identify how neural processing in the dSC contributes to reducing SRTs to audiovisual stimuli, we recorded activity from dSC neurons while monkeys generated saccades to visual or audiovisual stimuli. To evoke crossmodal interactions of varying strength, we used auditory and visual stimuli of different intensities, presented either in spatial alignment or to opposite hemifields. Spatially aligned audiovisual stimuli evoked the shortest SRTs. In the case of low-intensity stimuli, the response to the auditory component of the aligned audiovisual target increased the activity preceding the response to the visual component, accelerating the onset of the visual response and facilitating the generation of shorter-latency saccades. In the case of high-intensity stimuli, the auditory and visual responses occurred much closer together in time and so there was little opportunity for the auditory stimulus to influence previsual activity. Instead, the reduction in SRT for high-intensity, aligned audiovisual stimuli was correlated with increased premotor activity (activity after visual burst but preceding saccade-aligned burst). These data provide a link between changes in neural activity related to stimulus modality with changes in behavior. They further demonstrate how crossmodal interactions are not limited to the initial sensory activity but can also influence premotor activity in the SC. [ABSTRACT FROM AUTHOR]

Interaural differences in sound arrival time (ITD) and in level (ILD) enable us to localize sounds in the horizontal plane, and can support source segregation and speech understanding in noisy environments. It is uncertain whether these cues are also available to hearing-impaired listeners who are bimodally fitted, i.e. with a cochlear implant (CI) and a contralateral hearing aid (HA). Here, we assessed sound localization behavior of fourteen bimodal listeners, all using the same Phonak HA and an Advanced Bionics CI processor, matched with respect to loudness growth. We aimed to determine the availability and contribution of binaural (ILDs, temporal fine structure and envelope ITDs) and monaural (loudness, spectral) cues to horizontal sound localization in bimodal listeners, by systematically varying the frequency band, level and envelope of the stimuli. The sound bandwidth had a strong effect on the localization bias of bimodal listeners, although localization performance was typically poor for all conditions. Responses could be systematically changed by adjusting the frequency range of the stimulus, or by simply switching the HA and CI on and off. Localization responses were largely biased to one side, typically the CI side for broadband and high-pass filtered sounds, and occasionally to the HA side for low-pass filtered sounds. HA-aided thresholds better than 45 dB HL in the frequency range of the stimulus appeared to be a prerequisite, but not a guarantee, for the ability to indicate sound source direction. We argue that bimodal sound localization is likely based on ILD cues, even at frequencies below 1500 Hz for which the natural ILDs are small. These cues are typically perturbed in bimodal listeners, leading to a biased localization percept of sounds. The high accuracy of some listeners could result from a combination of sufficient spectral overlap and loudness balance in bimodal hearing. [ABSTRACT FROM AUTHOR]