Search

We present a novel mixed reality (MR) telepresence system, which enables a local user to interact with a remote user through full-body avatars in their own rooms. If the remote rooms have different size and furniture arrangement, directly applying the user’s motion to the avatar leads to mismatch of placement and deictic gesture. To overcome this problem, we retarget the placement, arm gesture and head movement of the local user to the avatar in remote room to preserve the environment and interaction context of the local user. This allows avatars to utilize real furniture and interact with the local user and shared objects as if they were in the same room.

In this demonstration paper, we introduce our RAPAEL rehabilitation system. It is designed for treatment of those who are suffering from brain diseases or disorders. The purpose of our system is to turn boring and unpleasant conventional rehabilitation exercises into more exciting and inspiring one. We developed an IoT-based wearable device and serious game for medical use.