201. Gaze-based predictive user interfaces: Visualizing user intentions in the presence of uncertainty
- Author
-
Tevfik Metin Sezgin and Cagla Cig Karaman
- Subjects
business.industry ,Computer science ,05 social sciences ,General Engineering ,Intelligent decision support system ,020207 software engineering ,Human Factors and Ergonomics ,Usability ,02 engineering and technology ,Gaze ,Education ,Visualization ,Personalization ,Human-Computer Interaction ,Hardware and Architecture ,Human–computer interaction ,Scrolling ,0202 electrical engineering, electronic engineering, information engineering ,Eye tracking ,0501 psychology and cognitive sciences ,User interface ,business ,050107 human factors ,Software - Abstract
Human eyes exhibit different characteristic patterns during different virtual interaction tasks such as moving a window, scrolling a piece of text, or maximizing an image. Human-computer, studies literature contains examples of intelligent systems that can predict user's task-related intentions and goals based on eye gaze behavior. However, these systems are generally evaluated in terms of prediction accuracy, and on previously collected offline interaction data. Little attention has been paid to creating real-time interactive systems using eye gaze and evaluating them in online use. We have five main contributions that address this gap from a variety of aspects. First, we present the first line of work that uses real-time feedback generated by a gaze-based probabilistic task prediction model to build an adaptive real-time visualization system: Our system is able to dynamically provide adaptive interventions that are informed by real-time user behavior data. Second, we propose two novel adaptive visualization approaches that take into account the presence of uncertainty in the outputs of prediction models. Third, we offer a personalization method to suggest which approach will be more suitable for each user in terms of system performance (measured in terms of prediction accuracy). Personalization boosts system performance and provides users with the more optimal visualization approach (measured in terms of usability and perceived task load). Fourth, by means of a thorough usability study, we quantify the effects of the proposed visualization approaches and prediction errors on natural user behavior and the performance of the underlying prediction systems. Finally, this paper also demonstrates that our previously-published gaze-based task prediction system, which was assessed as successful in an offline test scenario, can also be successfully utilized in realistic online usage scenarios. (C) 2017 Elsevier Ltd. All rights reserved.
- Published
- 2018