1. Spatially incongruent sounds affect visual localization in virtual environments
- Author
-
Dong Liu and Pei-Luen Patrick Rau
- Subjects
Linguistics and Language ,Computer science ,Distance discrimination ,Experimental and Cognitive Psychology ,Virtual reality ,Affect (psychology) ,050105 experimental psychology ,Language and Linguistics ,03 medical and health sciences ,0302 clinical medicine ,Humans ,0501 psychology and cognitive sciences ,Computer vision ,Sound Localization ,Sound (geography) ,geography ,geography.geographical_feature_category ,business.industry ,Distance Perception ,05 social sciences ,Visual localization ,Sensory Systems ,Sound ,Visual Perception ,Artificial intelligence ,Cues ,business ,Depth perception ,Depth plane ,030217 neurology & neurosurgery ,Spatial disparity - Abstract
Distance underestimations along the depth plane are widely found in virtual environments. However, past findings have shown that changes in the visual aspects of virtual reality settings do not lead to more accurate depth estimates. Therefore, we examined if nonvisual stimuli, namely, sounds, could serve as cues that affect observers' depth perception. Accordingly, we conducted two distance discrimination tasks to examine whether observers' depth localization is affected by a spatially incongruent sound. In Experiment 1, a spatially incongruent sound made a visual target appear farther away than a visual target presented with no sound only when a far-distance range (i.e., longer than 12 m) was introduced. Experiment 2 further indicated that the sound shifted visual localization only when audiovisual spatial disparity did not exceed 4°. Taken together, our findings suggest that the depth localization of a visual object in virtual reality can be altered by a spatially incongruent sound, and provide a potential approach that we can adopt a spatially incongruent sound as a cue to reduce the depth compression in VR.
- Published
- 2020