601. The VirBot: A virtual reality robot driven with multimodal commands
- Author
-
Jesus Savage-Carmona, Alistair D. C. Holden, and Mark Billinghurst
- Subjects
Computer science ,business.industry ,General Engineering ,Symbolic artificial intelligence ,Virtual reality ,computer.software_genre ,Expert system ,Computer Science Applications ,Intelligent agent ,Artificial Intelligence ,Software agent ,Human–computer interaction ,Virtual machine ,Robot ,Artificial intelligence ,business ,computer ,Gesture ,Instructional simulation - Abstract
In this paper we show how symbolic Artificial Intelligence (AI) techniques can be used to develop intelligent Virtual Reality (VR) environments. We have developed an expert system architecture for building intelligent agents that respond to voice and gesture commands in virtual environments. To demonstrate the utility of this we present a simple application that allows a user to drive a virtual robot (the VirBot) around a virtual environment with multimodal commands. This software agent is able to accept spoken commands from the user, interpret them using natural language understanding and interact with and modify the virtual environment. Command recognition is further improved by the use of contextual information which reduces recognition error rates by 31%. Context is encoded using scripts, making it easy to compose inferences about events for which there is incomplete or fuzzy information.