1. Natural Language Based Multimodal Interface for UAV Mission Planning
- Author
-
Anna C. Trujillo, B. Danette Allen, Erica L. Meszaros, and Meghan Chandarana
- Subjects
Engineering ,Highly skilled ,Modalities ,Natural language user interface ,business.industry ,Interface (computing) ,05 social sciences ,02 engineering and technology ,Medical Terminology ,Human–computer interaction ,020204 information systems ,0202 electrical engineering, electronic engineering, information engineering ,Trajectory ,0501 psychology and cognitive sciences ,business ,050107 human factors ,Human communication ,Natural language ,Simulation ,Medical Assisting and Transcription ,Gesture - Abstract
As the number of viable applications for unmanned aerial vehicle (UAV) systems increases at an exponential rate, interfaces that reduce the reliance on highly skilled engineers and pilots must be developed. Recent work aims to make use of common human communication modalities such as speech and gesture. This paper explores a multimodal natural language interface that uses a combination of speech and gesture input modalities to build complex UAV flight paths by defining trajectory segment primitives. Gesture inputs are used to define the general shape of a segment while speech inputs provide additional geometric information needed to fully characterize a trajectory segment. A user study is conducted in order to evaluate the efficacy of the multimodal interface.
- Published
- 2017