Search

Tangible controls-especially sliders and rotary knobs-have been explored in a wide range of interactive applications for desktop and immersive environments. Studies have shown that they support greater precision and provide proprioceptive benefits, such as support for eyes-free interaction. However, such controls tend to be expressly designed for specific applications. We draw inspiration from a bespoke controller for immersive data visualisation, but decompose this design into a simple, wireless, composable unit featuring two actuated sliders and a rotary encoder. Through these controller units, we explore the interaction opportunities around actuated sliders; supporting precise selection, infinite scrolling, adaptive data representations, and rich haptic feedback; all within a mode-less interaction space. We demonstrate the controllers' use for simple, ad hoc desktop interaction,before moving on to more complex, multi-dimensional interactions in VR and AR. We show that the flexibility and composability of these actuated controllers provides an emergent design space which covers the range of interactive dynamics for visual analysis. In a user study involving pairs performing collaborative visual analysis tasks in mixed-reality, our participants were able to easily compose rich visualisations, make insights and discuss their findings.

Many developers of digital Qur'an applications today still use tap to scrolling to run applications, although the features are interesting. This makes it less effective and efficient in opening the Qur'an. As is the case during the taklim assembly, some da'i are very interactive with jama'ah, asking to open certain surahs and verses so that there are some who have difficulty in searching. Therefore, the need for the Qur'anic application with voice command command to facilitate users. This research is the development of the Qur'an application with voice recognition feature. Using the waterfall method in development, voice command with google speech API as a voice command of surah and verse calling in the Qur'an application 30 juz. Conducted 10 randomized experiments with calls in the form of play or open surahs and certain verses give a 90% accuracy result. Commands can be given when online or offline. Then the use of google speech API can be very useful for use in the development of other applications. &nbsp, Banyak developer aplikasi Al-Qur’an digital saat ini masih menggunakan tap hingga scrolling untuk menjalankan aplikasi, meskipun fiturnya menarik. Hal itu menjadikan kurang efektif dan efisien dalam membuka Al-Qur’an. Seperti halnya saat majelis taklim, beberapa da’i sangat interaktif dengan jama’ah, meminta untuk membuka surah dan ayat tertentu sehingga ada beberapa yang kesulitan dalam mencari. Oleh karena itu perlunya aplikasi Al Qur’an dengan perintah voice command untuk memudahkan pengguna. Penelitian ini merupakan pengembangan aplikasi Al Qur’an dengan fitur voice recognition. Menggunakan metode waterfall dalam pengembangan, voice command dengan google speech API sebagai perintah suara pemanggilan surah dan ayat dalam aplikasi Al Qur’an 30 juz. Dilakukan 10 kali percobaan secara acak dengan pemanggilan berupa putar atau buka surah dan ayat tertentu memberikan hasil akurasi 90%. Perintah bisa diberikan ketika dalam keadaan online maupun offline. Maka penggunaan google speech API dapat sangat berguna untuk digunakan dalam pengembangan aplikasi lainnya.

Modern society has a culture that consumes mobile-based content. Despite this trend, the contents emphasizing the device characteristics were not diversified and a particular method of production has not yet been developed. For this method proposal, the objective of this work is to produce content that emphasizes spatiality, while simultaneously differentiating it from content using existing parallax scrolling techniques. Based on this situation, we herein developed mobile contents that produced 3D stereoscopic effects by reconstructing the existing 2D webtoon “Tilly the Spiky Hands” as the main content. In this study, we examine the technical elements of parallax and present the results of functions developed through screen and functional elements. This work is meaningful in terms of technology and culture by presenting a new method of production using these mobile characteristics.

Publisher Copyright: © 2021 ACM. Copy-and-paste operations are the most popular features on computing devices such as desktop computers, smartphones and tablets. However, the copy-and-paste operations are not sufficiently addressed on the Augmented Reality (AR) smartglasses designated for real-time interaction with texts in physical environments. This paper proposes two system solutions, namely Granularity Scrolling (GS) and Two Ends (TE), for the copy-and-paste operations on AR smartglasses. By leveraging a thumb-size button on a touch-sensitive and pressure-sensitive surface, both the multi-step solutions can capture the target texts through indirect manipulation and subsequently enables the copy-and-paste operations. Based on the system solutions, we implemented an experimental prototype named Press-n-Paste (PnP). After the eight-session evaluation capturing 1,296 copy-and-paste operations, 18 participants with GS and TE achieve the peak performance of 17,574 ms and 13,951 ms per copy-and-paste operation, with 93.21% and 98.15% accuracy rates respectively, which are as good as the commercial solutions using direct manipulation on touchscreen devices. The user footprints also show that PnP has a distinctive feature of miniaturized interaction area within 12.65 mm∗14.48 mm. PnP not only proves the feasibility of copy-and-paste operations with the flexibility of various granularities on AR smartglasses, but also gives significant implications to the design space of pressure widgets as well as the input design on smart wearables.

A growing body of work has highlighted the important role that Wikipedia's volunteer-created content plays in helping search engines achieve their core goal of addressing the information needs of hundreds of millions of people. In this paper, we report the results of an investigation into the incidence of Wikipedia links in search engine results pages (SERPs). Our results extend prior work by considering three U.S. search engines, simulating both mobile and desktop devices, and using a spatial analysis approach designed to study modern SERPs that are no longer just "ten blue links". We find that Wikipedia links are extremely common in important search contexts, appearing in 67-84% of desktop SERPs for common and trending queries, but less often for medical queries. Furthermore, we observe that Wikipedia links often appear in "Knowledge Panel" SERP elements and are in positions visible to users without scrolling, although Wikipedia appears less often and in less prominent positions on mobile devices. Our findings reinforce the complementary notions that (1) Wikipedia content and research has major impact outside of the Wikipedia domain and (2) powerful technologies like search engines are highly reliant on free content created by volunteers.

Educational games can provide players with rich learning and socializing experiences through different interac-tion paradigms, such as board games, card games, and, more recently, hybrid (physical-digital) games. However, the process of making, maintaining, and evolving an educational analog game is not a trivial task. Balancing the game mechanics and dynamics to provide a pleasant and educational gaming experience can be very difficult to achieve. Furthermore, adding a digital component in the gameplay can disturb the experience of the game and learning ob-jectives, and this kind of insertion should be evaluated. This work then aims to report the process of developing and evaluating a mobile application for helping the gameplay of a card game that focuses on on teaching software testing concepts. Our primary concern during the development of the application was whether its insertion would compromise the learning process or the social experience of the card game. The developed application has the fol-lowing functionalities: point counter, dice scrolling, timer, and a summary of the rules. We designed and developed a first version of the application. Then, we evaluated the impact of its insertion on gameplay by applying the game assisted with the application with students from Computer Science and Computer Engineering courses and, after the end of the game, the participants answered questionnaires about the players’ experience and their impressions about the application. Based on the results, we perceived that the use of the application provided benefits to the players’ experience, although the evaluation highlighted some opportunities for improvement. Thus, we evolve the mobile application based on the comments gathered in this evaluation. This new version has improvements on user’s interface, aiming to provide a better user experience, and new functionalities. Furthermore, we assessed the second version and compared both versions of the mobile app in order to collect evidence regarding improvements in the game experience.

We propose a 3D-printed interface, CAPath, in which conductive contact points are in a grid layout. This structure allows not only specific inputs (e.g., scrolling or pinching) but also general 2D inputs and gestures that fully leverage the "touch surface." We provide the requirements to fabricate the interface and implement a designing system to generate 3D objects in the conductive grid structure. The CAPath interface can be utilized in the uniquely shaped interfaces and opens up further application fields that cannot currently be accessed with existing passive touch extensions. Our contributions also include an evaluation for the recognition accuracy of the touch operations with the implemented interfaces. The results show that our technique is promising to fabricate customizable touch-sensitive interactive objects.

Deep Reinforcement learning agent has outperformed human players in many games, such as the Atari 2600 games. In more complicated games, previous related works proposed a curiosity-driven exploration for learning. Nevertheless, it generally requires substantial computational resources to train the agent. We attempt to design a method to assist with our agent to explore the environment. By utilizing prior learned experience more effectively, we develop a new memory replay mechanism, which consists of two modules: Trajectory Replay Module to record the agent moving trajectory information with much less space, and the Trajectory Optimization Module to formulate the state information as a reward. We evaluate our approach with two popular side-scrolling video games: Super Mario Bros and Sonic the Hedgehog. The experiment results show that our method can help the agent explore the environment efficiently, pass through various tough scenarios and successfully reach the goal in most of the testing game levels with merely four workers and of ordinary CPU computational resources for training. The demo videos are at Super Mario Bros and Sonic the Hedgehog.

The article shows the history of the development of badges as an image accessory designed to represent and/or identify people at a service checkpoint, in a conference or other mass event related to a meeting and contacts of people. This story covers: simple badge cards with printed information about a person, electronic badges with scrolling text, badges with controlled display of QR codes and graphic portraits of people who carry these badges, smart identification and contact control badges. At the same time, it is noted that the latest ideas in the development of badges support the technical side of the creation of “Electronic Citizen” and, while not entirely perfect, are focused on more local use. One of the alternative solutions is the use of color animated biometric QR codes that store facial biometric information about a particular person - his color graphic portrait, QR codes with documentary and biometric information about him.

Eye tracking tools are used in software engineering research to study various software development activities. However, a major limitation of these tools is their inability to track gaze data for activities that involve source code editing. We present a novel solution to support eye tracking experiments for tasks involving source code edits as an extension of the iTrace community infrastructure. We introduce the iTrace-Atom plugin and gazel -- a Python data processing pipeline that maps gaze information to changing source code elements and provides researchers with a way to query this dynamic data. iTrace-Atom is evaluated via a series of simulations and is over 99% accurate at high eye-tracking speeds of over 1,000Hz. iTrace and gazel completely revolutionize the way eye tracking studies are conducted in realistic settings with the presence of scrolling, context switching, and now editing. This opens the doors to support many day-to-day software engineering tasks such as bug fixing, adding new features, and refactoring., 4 pages, 2 figures

The scrolling interaction is a pervasive human-computer interaction on smartphones, which can reflect intrinsic characteristics during dynamic browsings. Different from extrinsic statistical measures like frequency of visits and dwell time, intrinsic features underlying scrolling interactions reveal fine-grained implicit feedbacks about user interests. Toward this end, we explore user interest inference by extracting efficient browsing features from scrolling human-computer interactions on smartphones. In this paper, we first analyze browsing traces of 40 volunteers, and find two intrinsic browsing features underlying scrolling interactions, i.e., browsing velocity stability and browsing velocity sequence, which are tightly related to user interests. Inspired by the observation, we propose an Intelligent Interest Inference system, I3, which infers user interests through sensing scrolling interactions during browsings. Specifically, I3 first extracts the two intrinsic browsing features from users' scrolling interactions. Then, I3 applies a Naive Bayesian-based approach to construct an interest discriminator for coarse-grained user interest (i.e., like-preferred or dislike-preferred) inference. Furthermore, we develop a deep learning-based approach for I3 to train rating classifiers for fine-grained rating inference in like-preferred and dislike-preferred browsings respectively. Finally, I3 utilizes the interest discriminator and rating classifiers to infer exact user ratings about browsing contents on smartphones. Experimental results under browsing traces of 46 volunteers present that I3 achieves 92.4% overall accuracy in interest inference.

Social commerce is an extension of e‐commerce, in which social media is leveraged to promote user contributions. Our study asks how interruptions in relation to interface design influence two types of user contributions: creating shared content and appreciating others' content. We use two interface designs, pagination and infinite scrolling, to manipulate the extent of interruptions to social commerce users. On the basis of the capacity theory of attention, we develop five hypotheses. We empirically test our model using a lab experiment and a field study to show that interruptions reduce users' content appreciation but increase their content creation and that user characteristics moderate these effects. The theoretical and practical contributions of our study are discussed.

The Qwerty soft keyboard is widely used on mobile devices. However, keyboards often consume a large portion of the touchscreen space, occluding the application view on the smartphone and requiring a separate input interface on the smartwatch. Such space consumption can affect the user experience of accessing information and the overall performance of text input. In order to free up the screen real estate, this article explores the concept of Sparse Keyboard and proposes two new ways of presenting the Qwerty soft keyboard. The idea is to use users’ spatial memory and the reference effect of spatial landmarks on the graphical interface. Our final design K3-SGK displays only three keys while L5-EYOCN displays only five line segments instead of the entire Qwerty layout. To achieve this, we employ a user-centered computational design method: first study the reference effect of a single landmark key (line segment) from empirical data, then make assumptions to generalize the effect to multiple landmarks, and finally optimize the best designs. To make the text entry function more complete, we also design and implement gestural interactions for editing operations and non-alphabetical characters’ input. User evaluation shows that participants can quickly learn how to type with K3-SGK and L5-EYOCN . After five 15-phrase typing sessions, participants achieve 88.1%--92.8% of the full Qwerty keyboard in terms of words per minute on the smartphone and 98.4%--99.1% on the smartwatch. The differences on character and word error rate between our keyboard designs and the full Qwerty keyboard are not significant. The results of out-of-vocabulary words input are also promising. In addition, participants can quickly recall the typing skills and maintain the input performance even after a few days. User feedbacks in real application contexts show that with the low occlusion keyboard, users can acquire more information and perform less scrolling on the smartphone and achieve a higher input efficiency on the smartwatch with a more fluent input experience.

This paper presents an object acquisition and selection approach in human computer interaction systems. In this approach, objects placed over computer screen are automatically scanned and the user performs voluntary eye blinks for object selection when the focus comes over the object of interest. Here, scanning means moving the focus over objects placed on the computer screen one by one and the scanning time is the time taken to move focus from one object to the next object. The user is not required to perform any physical movement, the moving part is only the eye lids. A low cost webcam and MATLAB software with computer vision toolbox are required to implement the proposed approach. The performance of the proposed approach has been compared with the Camera Mouse for selection of text and graphic objects. The Camera Mouse utilizes facial feature tracking for mouse cursor control and dwell time for object selection. Three experiments were performed for evaluation of the proposed method in which ten healthy users voluntarily participated. The proposed method has given significantly better performance than the Camera Mouse when selection of text objects was performed in an html file. For selection of graphic objects placed on computer screen, where page scrolling is not required, no significant difference has been found in the performance of both the systems. The proposed method has also been evaluated for performing mouse analogous operations using eye blinks and a performance comparison has been made with state-of-the-art methods.

This paper proposes a new scrolling text detection method for frame rate up-conversion, which uses a text edge detector and motion vector distribution analysis of the detected text. Existing methods use either edge or motion vector information of an image for scrolling text detection. Thus, when text begins or ends scrolling at the frame boundary, they have difficulty in detecting the text. Moreover, these methods use a fixed threshold to detect text edges. This makes their detection accuracy dependent on the local characteristic of an image. To overcome these drawbacks, the proposed algorithm uses both text edge detector and motion vector distribution analysis. The proposed method consists of the following three steps. In the first step, a text map is generated by the text edge detector based on region-adaptive thresholding for luminance change. Then, an initial scrolling text map is generated by calculating the difference between the previous and current text maps. Finally, the scrolling text is refined by analyzing the region characteristic of the detected text, including density, structure, and motion vector distribution. Compared with the state-of-the-art method, the experimental results show that the proposed method increases the detection accuracy by up to 17.6%. In addition, when the proposed algorithm is used for scrolling text detection, the frame rate up-conversion algorithm can generate high quality interpolated images for the scrolling text regions.

Mobile videochat use has been growing, especially for teens. To better understand teens' videochat practices, we conducted a two-week photo diary study with 16 teens. We found that most often, teens videochat with their closest friends from their bedrooms when they feel lonely or bored. Teens turned to videochat when understimulated but also felt understimulated during videochat. In order to manage this, they multitasked -teens moved from active chatting to co-presence while engaged in separate activities like scrolling social feeds or playing games. We uncovered social norms of reciprocity of attention, where teens match the attention level of the other and give leeway to briefly divert attention. Digital notifications did not feel disruptive to the videochat but family members' interruptions felt disruptive as teens' domestic context intruded into their virtual peer setting. We discuss these findings and their implications for research and design of videochat systems.

Smartphones are now ubiquitous, yet our understanding of user interface factors that maximize mobile user experience (UX), is still limited. This work presents a controlled experiment, which investigated factors that affect the usability and UX of a mobile incident reporting app. The results indicate that sequence of user interface elements matters while striving to increase UX, and that there is no difference between tab and scrolling as navigation modalities in short forms. These findings can serve as building blocks for empirically-derived guidelines for mobile incident reporting., Paper accepted for presentation at the 5th International Conference on Human Computer Interaction Theory and Applications (HUCAPP@VISIGRAPP 2021)

ABSTR A C T Increasing the productivity of flexible working during working hours is a common concern for employers. Employees working in different sectors use various tools to carry out their tasks and work in different working environments. With the Covid-19 pandemic that began in the beginning of 2020, remote working has become an essential part of life. However, one of the biggest problems faced by managers and employers is how to control remote workers. In this study, SmartRadar software was developed to track employee computer use behavior and detect anomalous behavior. Anomalous behavior is defined as computer-based activities or processes carried out during work time which are not related to the tasks for which the employee is responsible. Clicking, mouse wheel scrolling, copying and other similar actions by the user are processed, a summary of the data is generated, and a multi-dimensional dataset is created. Anomalous behavior can then be detected using support vector machines. The proposed software has been shown to detect anomalous computer use behavior by employees with a high degree of accuracy. The favorable results of the study show that the proposed method and the software could be used for tracking and reporting purposes both in workplaces and in flexible working conditions. (c) 2021 Elsevier B.V. All rights reserved.

Recommender systems play a vital role in e-commerce by presenting personalized product suggestions, reducing habituation and leading to transactions in an environment with limited human touch. Data used for learning how to select optimal recommendation content, including mouse tracking data, are often imprecise in nature. In this paper, we present a fuzzy approach to model purchase intent based on tracking user interaction with a browser via mouse and keyboard. It appreciates data uncertainty and provides insights into e-commerce customer behavior and the development of shops online. The developed fuzzy rule-based systems had a good accuracy and low interpretability, and results show that to generalize possible purchase intent with fuzzy rules, it is good to begin with looking at such behavioral features as distance of mouse movement, distance of vertical page scrolling, number of mouse clicks and time of user activity on website in relation to page content length. In future work, we intend to look at more features reflecting product parameters and transactions to enhance the modeling results on a larger scale.

Here, we propose a wearable tactile braille device with IoT connectivity to a mobile device so as to transmit any document on the device in the form of braille script to make it available at the user’s fingertip. The tactile braille display is a Modular Low-Cost Braille Electronic Display (MOLBED) proprietary to a team. A finger-held scrolling device is also proposed here with which the user can read at one’s own pace. The whole device is proposed to fit on a finger of the user and hence function as a wearable device. The proposed device can be used even by people without visual disabilities but have sufficient knowledge of braille script. Hence, it can function as a new age reading device while not maintaining direct eye contact with a screen or interface.

As the international community goes digital due to the state of affairs, it may be deemed that gamification is on the rise. Moreover, the coronavirus disease 2019 pandemic has impacted children, alongside adults, and they are in isolation, yet child development continues. The authors acknowledged these, took the notion that gamification is advantageous into consideration, and developed a side–scroller that is entertaining yet informative about SARS–CoV–2 and viruses at large using object–oriented programming, a programming paradigm, and the Association for Computing Machinery Java Task Force graphics library. This paper underlined that there is an absence of precedence of a side-scroller that is developed using this graphics library, and, subsequent to the assessment of the authors, it concluded that such a graphics library may not be suited to video game development due to its limiting factors. This paper deemed that gamification stimulates learning, nonetheless.

Mobile devices are becoming an important platform for reading. However, existing research on mobile reading primarily focuses on low-level metrics such as speed and comprehension. For complex reading tasks involving information seeking and context switching, researchers still rely on verbal reports via think-aloud. We present StrategicReading, an intelligent reading system running on unmodified smartphones, to understand high-level strategic reading behaviors on mobile devices. StrategicReading leverages multimodal behavior sensing and takes advantage of signals from camera-based gaze sensing, kinematic scrolling patterns, and cross-page behavior changes. Through a 40-participant study, we found that gaze patterns, muscle stiffness signals, and reading paths captured by StrategicReading can infer both users' reading strategies and reading performance with high accuracy.

Navigation is considered one of the most fundamental challenges in Virtual Reality (VR) and has been extensively researched [11]. The world-in-miniature (WIM) navigation metaphor allows users to travel in large-scale virtual environments (VEs) regardless of available physical space while maintaining a high-level overview of the VE. It relies on a hand-held, scaled-down duplicate of the entire VE, where the user’s current position is displayed, and an interface provided to introduce his/her next movements [17]. There are several extensions to deal with challenges of this navigation technique, e.g. scaling and scrolling [23]. In this work, a WIM is presented that integrates state-of-the-art research insights and incorporates additional features that became apparent during the integration process. These features are needed to improve user interactions and to provide both look-ahead and post-travel feedback. For instance, a novel occlusion handling feature hides the WIM geometry in a rounded space reaching from the user’s hand to his/her forearm. This allows the user to interact with occluded areas of the WIM such as buildings. Further extensions include different visualizations for occlusion handling, an interactive preview screen, post-travel feedback, automatic WIM customization, a unified diegetic UI design concerning WIM and user representation, and an adaptation of widely established gestures to control scaling and scrolling of the WIM. Overall, the presented WIM design integrates and extends state-of-the-art interaction tasks and visualization concepts to overcome open conceptual gaps and to provide a comprehensive practical solution for traveling in VR.

An increasing number of musicians are opting to use tablet devices instead of traditional print media for their music sheets since the digital medium offers the benefit of storing a lot of music in a compact space. The limited screen size of the tablet devices makes the music difficult to read and musicians often opt to display part of the music page at a time. With fewer music lines on display, the musician will then have to resort to scrolling through the music to read the entire score. This scrolling is annoying since the musicians will need to remove their hands from the instrument to interact with the tablet, causing a break in the music if this is not done quickly enough, or if the tablet is not sufficiently responsive. In this paper, we describe an alternative page turning system which automates the page turning event of the musician. By actively monitoring the musician's on-screen point of regard, the system retains the musician in the loop and thus, the page turns are attuned to the musician's position on the score. By analysing the way the musician's gaze changes between attention to the score and the instrument as well as the way musicians fixate on different parts of the score, we note that musicians often look away from the score and toward their hands, or elsewhere, when playing the instrument. As a result, the eye regions fall outside the field-of-view of the eye-gaze tracker, giving rise to erratic page-turns. To counteract this problem, we create a gaze prediction model that uses Kalman filtering to predict where the musician would be looking on the score. We evaluate our hands-free page turning system using 15 different piano songs containing different levels of difficulty, various repeats, and which also required playing in different registers on the piano, thus, evaluating the applicability of the page-turner under different conditions. Performance of the page-turner was quantified through the number of correct page turns, the number of delayed page turns, and the number of mistaken page turns. Of the 289 page turns involved in the experiment, 98.3% were successfully executed, 1.7% were delayed, while no mistaken page turns were observed.

Despite its numerous scientifically cited benefits, traceability is still rarely established in industrial settings. Years of research in the area have brought several different approaches to create traceability links including Information Retrieval (IR) and Machine Learning approaches. However, their accuracy and overall traceability support is not sufficient yet to be properly applied in practice. In my research, I want to investigate the usage of eye tracking and interaction data in the field of traceability. By tracking how software engineers interact with documents, where they focus on and recording gaze links between those documents, an algorithm is designed to obtain trace links between artifacts from these data. Eye tracking and interaction data have the advantage that they can be recorded in an automatic, non-intrusive way without requiring manual effort. They give detailed insight about where people focus on when working on tasks. However, software support of eye tracking is still limited, especially in the context of dynamic content such as switching between, scrolling or editing documents. Therefore, one essential step of my research is to provide software support for recording eye tracking data in dynamic document environments. By combining eye tracking data with additionally recorded metadata such as interactions, this eye tracking framework shall enable the automatic capturing of gaze links and gaze durations during software engineering tasks. The approach of using eye tracking in the context of traceability will be evaluated in several usage scenarios such as requirements coverage assessment.

This paper presents a gaze-based web browser that allows hands-free navigation through five different link selection methods (namely, Menu, Discrete Cursor, Progressive Zoom, Quick Zoom, and Free Pointing) and two page scrolling techniques. For link selection, the purpose of this multi-approach solution is two-fold. On the one hand, we want users to be able to choose either their preferred methods or those that, in each specific case, are the most suitable (e.g., depending on the kind of link to activate). On the other hand, we wanted to assess the performance and appreciation level of the different approaches through formal tests, to identify their strengths and weaknesses. The browser, which is conceived as an assistive technology tool, also includes a built-in on-screen keyboard and the possibility to save and retrieve bookmarks.

International audience; We describe a design space of view manipulation interactions for small data-driven contextual visualizations (word-scale visualizations). These interaction techniques support an active reading experience and engage readers through exploration of embedded visualizations whose placement and content connect them to specific terms in a document. A reader could, for example, use our proposed interaction techniques to explore word-scale visualizations of stock market trends for companies listed in a market overview article. When readers wish to engage more deeply with the data, they can collect, arrange, compare, and navigate the document using the embedded word-scale visualizations, permitting more visualization-centric analyses. We support our design space with a concrete implementation, illustrate it with examples from three application domains, and report results from two experiments. The experiments show how view manipulation interactions helped readers examine embedded visualizations more quickly and with less scrolling and yielded qualitative feedback on usabil-ity and future opportunities.

This paper details a usability evaluation of scrolling techniques on websites. The scrolling methods evaluated were normal scrolling (with default pagination), infinite scrolling, infinite scrolling with a ‘load more’ button and Infinite Scrolling with ‘pagination’. The four scrolling types were evaluated in the context of tasks that involved either serendipitous type tasks or goal-oriented type tasks. The evaluation was principally about the ‘raw’ performance and participant perceptions. This is because it was felt that the greatest gap in knowledge concerned these aspects. The evaluation was done by means of an experiment and the data collected was statistically analysed. The results were mixed in nature, where no single scrolling method stood out as being the most usable.

In the long-term observation, we’ve discovered that the joystick has high maneuverability, but players find it difficult to control when playing complex 2-D STG. The layout which is full of bullets and enemies is a huge challenge to players’ techniques and reactions. Furthermore, it influences the games’ difficulties and players’ willingness to play; we implemented shadowing observational method and questionnaire to come up with four key factors which were significant to this research. However, the experiment probed into the Human-Machine Interaction with regard to joystick and synergy between hardware and software. After the focus group with those subjects, we acquired a few pieces of feedback on how to improve the joysticks. Ultimately, in the conclusion of this research, we proposed two pieces of advice on the design of prototype of joystick. We’d like to improve the User Experience (UX) and Somatosensory Experience, and create a customized joystick for 2-D STG.

For developing mobile apps, developers can choose between a native development approach, in which a unique code base needs to be maintained for each supported mobile platform, and mobile cross-platform development (MCPD) approaches. MCPD approaches allow building and deploying mobile apps for several mobile platforms from one single code base. As MCPD approaches build on top of different technologies, in this paper, we analyze the performance of MCPD approaches based on UI interactions. We developed one app natively, and two using MCPD approaches. Using automated tests, we measured CPU usage, memory consumption and rendered frames of these apps when executing UI interaction scenarios consisting of three selected UI interactions (i.e., opening/closing a navigation drawer, screen transition, and virtual scrolling). The study confirms results of previous studies showing that, compared to natively developed apps, apps developed using MCPD approaches put a higher load on mobile devices regarding CPU usage, main memory and GPU memory consumption.

In this paper, we introduce a novel type of navigation bar especially designed to provide users with additional information as they navigate long web pages that consist of several different sections and a large amount of content. In addition to facilitating scrolling, the proposed navigation bar enables users to quickly traverse the page without needing to manually scroll. Moreover, we present the results of a comparative study that analyzed the effectiveness of our proposed system with respect to traditional approaches. From the findings of our research, which includes an evaluation of individuals’ likelihood to use the proposed navigation bar, we can conclude that users have a strong preference for our system; also we found that it increases accuracy in information finding tasks. Consequently, we believe the proposed navigation bar design could enhance web usability and improve user satisfaction.

Gaze-based interaction approaches like the Multi Modal Interaction Concept for Efficient Input (M²ice) minimize the need for using pointing devices like a computer mouse in human computer interaction. While most core functionalities of pointing devices can be addressed in a more or less straightfor-ward manner, secondary functions like scrolling remain to be a challenge. This demo paper presents a gaze-based extension for the M²ice interaction concept that is realized by dividing the screen into distinct areas and combining scrolling areas with a reading area in the middle. The approach is compared to other gaze-based solutions.

In this era of evolving technologies, most of the human interactions with the electronic devices are becoming smart. For elderly and blind people, it may be difficult to use mouse and keyboard for every operation especially when watching videos in computer, increasing or decreasing of volume and play pause, and when using web browsers, scrolling up or down and swapping of the taps. This paper has tried to provide solutions to the above-mentioned problem by reducing the usage of mouse and keyboard using IOT technologies. Gesture recognition is one of the essential techniques to build user-friendly interface. This paper deals with Human Computer Interaction(HCI) consists of hardware components such as Arduino UNO and the ultrasonic sensors with the software components such as Arduino and Python IDLE for exchanging the information or communication between the user and machine.

Human eyes exhibit different characteristic patterns during different virtual interaction tasks such as moving a window, scrolling a piece of text, or maximizing an image. Human-computer, studies literature contains examples of intelligent systems that can predict user's task-related intentions and goals based on eye gaze behavior. However, these systems are generally evaluated in terms of prediction accuracy, and on previously collected offline interaction data. Little attention has been paid to creating real-time interactive systems using eye gaze and evaluating them in online use. We have five main contributions that address this gap from a variety of aspects. First, we present the first line of work that uses real-time feedback generated by a gaze-based probabilistic task prediction model to build an adaptive real-time visualization system: Our system is able to dynamically provide adaptive interventions that are informed by real-time user behavior data. Second, we propose two novel adaptive visualization approaches that take into account the presence of uncertainty in the outputs of prediction models. Third, we offer a personalization method to suggest which approach will be more suitable for each user in terms of system performance (measured in terms of prediction accuracy). Personalization boosts system performance and provides users with the more optimal visualization approach (measured in terms of usability and perceived task load). Fourth, by means of a thorough usability study, we quantify the effects of the proposed visualization approaches and prediction errors on natural user behavior and the performance of the underlying prediction systems. Finally, this paper also demonstrates that our previously-published gaze-based task prediction system, which was assessed as successful in an offline test scenario, can also be successfully utilized in realistic online usage scenarios. (C) 2017 Elsevier Ltd. All rights reserved.

The purpose of this paper is to investigate how a study group consisting of 85 participants interact with selected online stores and how the interactions correlate with interest in products for each store. This work uses a quantitative research methodology involving a dedicated tool for implicit monitoring of human-website interaction, instrumented for selected stores and registering product interest for the benefit of recommender systems. One of the findings was that to predict product interest it seems a good idea to start with monitoring scrolling activities, mouse usage and time spent on a website and its sections. Rich product information played a crucial role in shaping user interest. For all stores in the study, a misclassification rate of 28.7% was achieved in a CART model, while modeling for particular stores, it varied from 39.3% to 24.8%, and we feel that it reflected different page layouts in stores. Models built to represent individual behavior patterns of most active study participants varied in terms of misclassification rates from 17% to 26%, and the analysis suggested that individual preference modeling could be considered for recommender systems, in particular for key customers or customer groups. The study leads to insights into online store user behavior and product interest prediction, and as a result to possible implications for recommender systems design, including ergonomics optimization and interaction personalization.

Reading on touchscreen mobile devices is common in modern society. However, it is difficult to determine which interaction mode has the best reading effect when reading texts of different lengths. Using memory tests, eye-movement data analysis, and task load scale, we studied the effects of paging and vertical scrolling modes on the memory level, visual fatigue, task load, and reading speed of 28 participants reading both long and short texts. The results showed that vertical scrolling has a better memory effect than paging mode when reading short texts, but there was no difference in effect when reading long texts; the blink frequency in paging mode is higher than in scrolling mode whether reading long or short texts; no significant differences were found in reading speed in scrolling or paging mode when reading short or long texts; and in task load, the mental and temporal demands in scrolling mode were lower than in paging mode whether reading long or short texts. Considering that most current mobile readings do not differ in interaction mode according to the length of reading material, our conclusions provide valuable design recommendations to designers working on mobile reading apps.

Parallax scrolling is a popular web technique used widely in product presentation websites, but its effect on user experience is unknown. Parallax scrolling allows the object displayed in the foreg...

Despite the increasing use of mobile web in our everyday lives, mobile web search remains a challenging task mainly due to the intensive scrolling inherent in linear presentation of search engine results (SERs) on the small screen of a mobile device. Drawing on the cognitive load theory and information foraging theory, this study aims to improve user performance in mobile web search by proposing two new artifacts—radial visualization of SERs clusters and synchronization of clusters and individual SERs presentations. These artifacts are hypothesized to improve search efficiency and/or navigation efficiency without affecting search effectiveness. This study also examines a possible moderating effect of search task type (open-ended vs. close-ended tasks). We implemented four mobile web search systems that reflect four combinations of different visualization and synchronization settings and empirically evaluated them using a controlled experiment. The results show that the radial visualization improve...

Non-linear document navigation refers to the process of repeatedly reading a document at different levels to provide an overview, including selective reading to search for useful information within a document under time constraints. Currently, this function is not supported well by small-screen tablets. In this study, we propose the concept of structure-aware touch-based scrolling (SATS), which allows structural document navigation using region-dependent touch gestures for non-sequential navigation within tablets or tablet-sized e-book readers. In SATS, the screen is divided into four vertical sections representing the different structural levels of a document, where dragging into the different sections allows navigating from the macro to micro levels. The implementation of a prototype is presented, as well as details of a comparative evaluation using typical non-sequential navigation tasks performed under time constraints. The results showed that SATS obtained better performance, higher user satisfaction, and a lower usability workload compared with a conventional structural overview interface.

Large high-resolution displays (LHRDs) are entering into our daily life. Today, we already see them in installations where they display tailored applications, e.g. in exhibitions. However, while heavily studied under lab conditions, real-world applications for personal use, which utilize the extended screen space are rarely available. Thus, today’s studies of LHRD are particularly designed to embrace the large screen space. In contrast, in this paper, we investigate a real-world application designed for researchers working on large text corpora to support them in deep text understanding. We conducted a study with 14 experts from the humanities and computational linguistics which solved a text analysis task using a standard desktop version on a 24 inch screen and an LHRD version on three 50 inch screens. Surprisingly, the smaller display condition outperformed the LHRD in terms of task completion time and error rate. While participants appreciated the overview provided by the large screen, qualitative feedback also revealed that the need for head movement and the scrolling mechanism decreased the usability of the LHRD condition.

Eye tracking is a frequently used technique to collect data capturing users' strategies and behaviors in processing information. Understanding how programmers navigate through a large number of classes and methods to find bugs is important to educators and practitioners in software engineering. However, the eye tracking data collected on realistic codebases is massive compared to traditional eye tracking data on one static page. The same content may appear in different areas on the screen with users scrolling in an Integrated Development Environment (IDE). Hierarchically structured content and fluid method position compose the two major challenges for visualization. We present a dual-space analysis approach to explore eye tracking data by leveraging existing software visualizations and a new graph embedding visualization. We use the graph embedding technique to quantify the distance between two arbitrary methods, which offers a more accurate visualization of distance with respect to the inherent relations, compared with the direct software structure and the call graph. The visualization offers both naturalness and readability showing time-varying eye movement data in both the content space and the embedded space, and provides new discoveries in developers' eye tracking behaviors.

Creating effective interfaces for browsing is a key challenge in digital libraries. In a desktop computing-based world, large screen real estate and vertical-only scrolling were major drivers of the design of DL interfaces. Mobile computing presents new challenges and opportunities for DLs: screens are smaller, but touch screens afford interactions that have not been possible in the past. In this paper we compare the effect of input modality---touch vs. scrolling---on navigation in interfaces designed for book browsing. We specifically address effectiveness and user satisfaction with horizontal and two-dimensional scrolling, which has traditionally had low acceptability to users and thus drastically limited the information presentation options available in digital libraries.

Intensive exploration and navigation of hierarchical lists on smartphones can be tedious and time-consuming as it often requires users to frequently switch between multiple views. To overcome this limitation, we present PinchList, a novel interaction design that leverages pinch gestures to support seamless exploration of multi-level list items in hierarchical views. With PinchList, sub-lists are accessed with a pinch-out gesture whereas a pinch-in gesture navigates back to the previous level. Additionally, pinch and flick gestures are used to navigate lists consisting of more than two levels. We conduct a user study to refine the design parameters of PinchList such as a suitable item size, and quantitatively evaluate the target acquisition performance using pinch-in/out gestures in both scrolling and non-scrolling conditions. In a second study, we compare the performance of PinchList in a hierarchal navigation task with two commonly used touch interfaces for list browsing: pagination and expand-and-collapse interfaces. The results reveal that PinchList is significantly faster than other two interfaces in accessing items located in hierarchical list views. Finally, we demonstrate that PinchList enables a host of novel applications in list-based interaction?