Gaze and body capture system under VR experiences

This paper proposes a novel system to simultaneously capture gaze behavior and the whole body motion of a person experiencing 6-DOF VR contents. This system consists of a VR goggle, eye-trackers attached to the goggle, and multiple Kinects. Measurements of those devices are all described in the consistent global coordinate system. Since the Kinects are robustly calibrated, whichever position and pose a user is located, his/her whole body pose as well as gaze directions is correctly measured. Using this system, we can easily capture gaze behaviors as well as body motion of people under any VR scenes, which is helpful for physiological researches.