201. Challenging selections in mobile and pervasive computing
- Author
-
Plaumann, Katrin, Rukzio, Enrico, and Boll, Susanne
- Subjects
Mobile computing ,Ubiquitous computing ,InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI) ,Direct manipulation ,Pervasive computing ,ddc:004 ,DDC 004 / Data processing & computer science ,Selection ,Human-computer interaction ,Mensch-Maschine-Kommunikation - Abstract
Selecting objects is a key element of \ac{hci}. Successful selections of \ac{ui} elements allow users to chose display options, input text, open and close applications but also to select the objects one intends to interact with. Without successful selections, no viable input and therefore interaction would be possible. Through the introduction of mobile and pervasive computing, the design space for input has changed dramatically. Objects are more and more selected without using intermediary devices by way of mid-air and touch gestures, fully fulfilling the promises of direct manipulation. However, this introduces several new challenges. \ac{ui}s relying on mid-air and touch gestures as input means do not necessarily include intermediary devices like mice or physical keyboards and feedback indicators like cursors. Those \ac{ui} elements traditionally serve as moderators between users and systems, allowing users to still perform successful interactions even with less precise input. When no intermediary devices are included in the \ac{ui}, however, a higher degree of precision in input as well as knowledge about how systems process user input is expected from users. Further, through the absence of feedback indicators no implicit corrections of input gestures based on hand-eye coordination are possible, only upon success or failure one can correct their selection strategy. This thesis presents solutions to overcome the resulting challenges by systematically analysing the mentioned problem space, presenting empirical as well as artefact contributions, and discussing said solutions in the broader context of \ac{hci}. The proposed solutions include a soft- and hardware based general hand tremor correction approach for mobile touchscreens, optimizations for list selections on small mobile touchscreens, comparisons of mid-air gesture type performances for smart home contexts, conflict solving strategies in multi-user mid-air gesture scenarios, and a model of how ocular dominance and handedness affects deictic mid-air gesture accuracy. The solutions were developed based on an introduced model of object selection in \ac{hci}, the Interaction Loop. This model allows to analyse interaction processes as well as breaks resulting from omitting intermediaries and feedback indicators. To achieve the empiric and artefact contributions presented in this thesis, the standard \ac{ucd} process was refined to account for the requirements of research in mobile and pervasive computing. Yet the version presented here can also be applied in \ac{hci} research in general. In general, solutions were developed based on information about user behaviour collected before developing said solutions. The main development strategy were adjusting \ac{ui}s to accustom for user specific and context specific characteristica. Subsequently, solutions were evaluated using standard \ac{hci} methods.
- Published
- 2022
- Full Text
- View/download PDF