Search

Orienting responses to audiovisual events in the environment can benefit markedly by the integration of visual and auditory spatial information. However, logically, audiovisual integration would only be considered successful for stimuli that are spatially and temporally aligned, as these would be emitted by a single object in space–time. As humans do not have prior knowledge about whether novel auditory and visual events do indeed emanate from the same object, such information needs to be extracted from a variety of sources. For example, expectation about alignment or misalignment could modulate the strength of multisensory integration. If evidence from previous trials would repeatedly favour aligned audiovisual inputs, the internal state might also assume alignment for the next trial, and hence react to a new audiovisual event as if it were aligned. To test for such a strategy, subjects oriented a head-fixed pointer as fast as possible to a visual flash that was consistently paired, though not always spatially aligned, with a co-occurring broadband sound. We varied the probability of audiovisual alignment between experiments. Reaction times were consistently lower in blocks containing only aligned audiovisual stimuli than in blocks also containing pseudorandomly presented spatially disparate stimuli. Results demonstrate dynamic updating of the subject’s prior expectation of audiovisual congruency. We discuss a model of prior probability estimation to explain the results. [ABSTRACT FROM AUTHOR]

When a sound is presented in the free field at a location that remains fixed to the head during whole-body rotation in darkness, it is heard displaced in the direction opposing the rotation. This phenomenon is known as the audiogyral illusion. Consequently, the subjective auditory median plane (AMP) (the plane where the binaural difference cues for sound localization are perceived to be zero) shifts in the direction of body rotation. Recent experiments, however, have suggested opposite AMP results when using a fixation light that also moves with the head. Although in this condition the eyes remain stationary in the head, an ocular pursuit signal cancels the vestibulo-ocular reflex, which could induce an additional AMP shift. We tested whether the AMP is influenced by vestibular signals, eye position or eye velocity. We rotated subjects sinusoidally at different velocities, either in darkness or with a head-fixed fixation light, while they judged the laterality (left vs. right with respect to the midsagittal plane of the head) of broadband sounds presented over headphones. Subjects also performed the same task without vestibular stimulation while tracking a sinusoidally moving visual target, which mimicked the average eye-movement patterns of the vestibular experiments in darkness. Results show that whole-body rotation in darkness induces a shift of the AMP in the direction of body rotation. In contrast, we obtained no significant AMP change when a fixation light was used. The pursuit experiments showed a shift of the AMP in the direction of eccentric eye position but not at peak pursuit velocity. We therefore conclude that the vestibular-induced shift in average eye position underlies both the audiogyral illusion and the AMP shift. [ABSTRACT FROM AUTHOR]

Orienting the eyes towards a peripheral sound source calls for a transformation of the head-centred sound coordinates into an oculocentric motor command, which requires an estimate of current eye position. Current models of saccadic control explain spatial accuracy by oculocentric transformations that rely on efference copies of relative eye-displacement signals, rather than on absolute eye position in the orbit. In principle, the gaze-control system could keep track of instantaneous eye position by vector addition of intervening eye-displacement commands. However, given that each motor update is endowed with some noise, the neural estimate of eye orientation is then expected to become noisier with increasing number of intervening saccades. As a consequence, the localization response will also be noisier. According to the alternative, in which target updates rely on feedback of the current eye position, such an increase in errors would be absent. In an attempt to dissociate these hypotheses, we studied the influence of the accumulation of oculomotor commands prior to a sound-localization response. Head-restrained subjects generated voluntary eye movements in darkness in random directions for a period between 0.2 and 15 s, after which they rapidly reoriented the eyes towards a brief sound burst. The results demonstrate that the audiomotor system programmes the orienting response on the basis of actual eye position, rather than on an accumulated estimate from intervening eye displacements. [ABSTRACT FROM AUTHOR]