3D interaction assistance in virtual reality: A semantic reasoning engine for context-awareness

International audience; This work aims to provide 3D interaction assistance in virtual environments depending on context. We designed and implemented a generic decision engine that can connect to our existing virtual reality applications through a set of tools. It uses an ontology and Conceptual Graphs (CGs) to represent knowledge, and First Order Logic to conduct semantic reasoning. Context information are gathered by virtual sensors in the application and interpreted by the engine. Multimodal assistance is provided by virtual actuators. Our first test scenario is about assistance to selection of objects or navigation towards objects: the engine automatically detects user's interests and manages adaptations depending on user's hand gestures, interactions history and type of task.