Search

The past two decades have experienced a paradigm shift from a narrow conception of usability to a broader process of user experience. We argue that durable connections to usability remain in TPC. In this perspectives piece, we highlight the paradigm shift and share traces of how the usability paradigm remains durable, primarily in the service course. We share savvy practices of instructors embracing the UX paradigm, even in the face of constraints. [ABSTRACT FROM AUTHOR]

Human digital twins are computational models of the human actions involved in interacting and operating technical artifacts. Such models provide a conceptual and practical tool for artificial intelligence designers when they seek to replace human work with intelligent machines. Indeed, digital twins have long served as models of technical and cyber-physical processes. Human digital twins have such models as their foundations but also include models of human actions. As a result, human digital twin models enable technology designers to model how people interact with intelligent technical artifacts. Yet, development of human digital twins is associated with certain conceptual problems. To clarify the basic idea, we constructed a human digital twin for Minsky's M-Machine. The abstract conceptual structure of this machine and its generality allowed us to analyze the general properties of human digital twins, their design, and their use as tools in designing intelligent technologies. [ABSTRACT FROM AUTHOR]

The application and use cases for conversational agents (CAs) are versatile. Smart speakers such as Alexa and Google Home are used in smart home environments, digital agents are integrated into car systems and chatbots are increasingly used in customer service processes. However, human–computer interaction researchers identify and investigate a wide-ranging variety of aspects impeding the usage of CAs by end-users. In general, impediments differ depending on use case contexts, user group characteristics and the CA's technological infrastructure. Hence, it is difficult and often ambiguous for designers and developers to generate an appropriate awareness about aspects impeding CA usage. We address this problem, by conducting a systematic review of 65 publications surveying impeding aspects of the usage of CAs. [ABSTRACT FROM AUTHOR]

For years, design has been focused on human needs, creating human-centred solutions and often neglecting the existence or the impact that design can have on other species. As designers shift from that traditional anthropocentric approach to adopting design practices that include other species' perspectives in the process, there is a growing need for practices capable of providing designers with the right tools to understand non-human needs and design for their inclusion. For this reason, the Beings Activities Context Technologies (BACT) framework is proposed as a theoretical means to support the shift to a more multispecies-oriented approach, expanding the anthropocentric Benyon's People Activities Contexts Technologies (PACT) framework. The methodological implications of the framework have been explored in a case study design project focused on the development of a wearable device designed to support beekeepers during their work. The case study explored the design by taking into consideration both the needs of humans and animals in the context of beekeeping while analysing their interactions in depth. Through this framework, we seek to contribute to the more-than-human turn in interaction design and aid designers in expanding their considerations beyond the person–technology relationship. [ABSTRACT FROM AUTHOR]

This paper presents a systemic literature review of Sustainable Interaction Design. We use the PRISMA model to guide the review. In the analysis of the identified papers, we identify an emergent and significant shift in the discourse on Sustainable Interaction Design from its original introduction in 2007. The shift in discourse concerns extensions both in the methodology as well as the impact, which is oddly underexplored. Regarding the methodology, we found that the objectives of sustainability are pursued by the concrete features of designed artifacts or through the use impact of design and that the design contains a process of learning for all participating parties, captured in the notion of sustainability in designing. By complementing this with the pursued impact of social, environmental, and economic sustainability, we point to where the current research tends to cluster, which areas are underexplored, and, thus, where new research agendas are needed. Here, the limited interest in studying how Interaction Design fosters sustainability while including an economic perspective stands out. In the concluding parts of this paper, we propose future research trajectories of SID and speculate and discuss opportunities and challenges for future research. [ABSTRACT FROM AUTHOR]

Maintaining the normal flight of drones is crucial for drone operators. Analyzing the operation status of drones and adjusting flight parameters are essential to achieve this goal. However, as drone technology continues to evolve, the volume and complexity of spatio-temporal data related to drone flight status have grown exponentially. The complexity of this data poses a challenge to effective visualization, which can impact operators' analysis and decision-making. Currently, there is limited research on identifying flight attributes from a large collection of drone time series data. Two challenges were identified: (1) visual clutter from spatio-temporal data; (2) effective integration of time and space properties. By collaborating with domain experts, we addressed two challenges with DSTVis, a novel interactive system for operators to visually analyze spatio-temporal data of drones. For Challenge 1, we designed dynamic interactive views by abstracting and stratifying spatio-temporal data, enabling effective exploration of large amounts of data. For Challenge 2, a two-dimensional map is utilized to integrate time information and assist users in comprehending the spatio-temporal properties. The effectiveness of the system is evaluated with a usage scenario on a real-world historical dataset and received positive feedback from experts. [ABSTRACT FROM AUTHOR]

Robots and smart technologies are becoming part of everyday life and private households. While this automation of mundane tasks typically creates pragmatic benefits (e.g., efficiency, accuracy, time savings), it may also come with psychological losses, such as in meaning, competence, or responsibility. Depending on the domain (e.g., AI-assisted surgery, automated decision making), especially the user's felt responsibility could have far-reaching consequences. The present research systematically explores such effects, building a more structured base for responsible automation in human–computer interaction (HCI). Based on a framework of seven dimensions, study 1 (N = 122) evaluates users' reflections on automating five mundane tasks (e.g., gardening, paperwork) and identifies reasons for or against automation in different domains (e.g., creativity, care work, decision making). Study 2 (N = 57) provides deeper insights into effects of automation on responsibility perceptions. Based on the example of a vacuum cleaner robot, an experimental laboratory study contrasted a non-robotic manual vacuum cleaner to a robot, whereby the user's perceptions of device agency (higher for the robot) and own competence (higher for the manual device) were central mediators for the perceived responsibility for the result. We position our findings as part of a broader idea of responsible design and automation from a user-centered design perspective. [ABSTRACT FROM AUTHOR]

Abstract Human digital twins are computational models of the human actions involved in interacting and operating technical artifacts. Such models provide a conceptual and practical tool for artificial intelligence designers when they seek to replace human work with intelligent machines. Indeed, digital twins have long served as models of technical and cyber-physical processes. Human digital twins have such models as their foundations but also include models of human actions. As a result, human digital twin models enable technology designers to model how people interact with intelligent technical artifacts. Yet, development of human digital twins is associated with certain conceptual problems. To clarify the basic idea, we constructed a human digital twin for Minsky’s M-Machine. The abstract conceptual structure of this machine and its generality allowed us to analyze the general properties of human digital twins, their design, and their use as tools in designing intelligent technologies.

Addressing dyslexia through digital product design presents distinct challenges and necessitates the development of tailored strategies or guidelines to facilitate children in reading accurately and efficiently. Hence, a design guideline was formulated by integrating Interaction Design (IxD) principles to enhance comprehension and minimise reading errors while using digital applications. Nonetheless, the existing design guidelines for dyslexia people have yet to be confirmed and updated to cater to the current and latest five IxD dimensions. Therefore, this paper presents an eye-tracking usability test that was conducted to identify usability issues pertaining to the design guideline by performing the test on an application called BacaDisleksia, which was developed based on the existing guideline. A usability test was conducted using the Tobii eye-tracking tool through an in-person and moderated session with six dyslexic children. The test reveals pertinent design issues by analysing heat maps and gaze plots. Based on these findings, this paper proposes a refined design guideline with five IxD dimensions and strategies conducive to dyslexia-friendly application design by incorporating space and time components. The results contribute to the development of comprehensive design guideline for people with dyslexia, which aligns with UNESCO’s objective of utilising technology to promote inclusion for disabled learners. This effort underscores the significance of informed design decisions in digital innovation for better-serving individuals with dyslexia and similar learning challenges. [ABSTRACT FROM AUTHOR]

Copyright of e-Education Research is the property of Northwest Normal University and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Interactive videos have the potential to boost content-student interactions. This study is an attempt to observe the logs of interactions in two different learning scenarios (straight and branched scenario) by two different content types (declarative and procedural). The study aims to understand if learning experiences vary across scenario-content combinations. It is built upon experimental design methodology. The experimental group (N = 20) interacted with the branched scenario, while the control group (N = 20) engaged in the straight scenario. Each group engaged in both content types with varying scenarios. Logs, screen recordings, and interviews were the primary data sources. The results indicated that for the declarative content type, time spent in the straight scenario was significantly higher than that of the branched scenario. Still, the collected points of the branched scenario were substantially higher than that of the straight one. These effects were not observed in procedural content. General content and concepts were mentioned frequently in declarative content with a higher amount in branched-declarative than in straight-declarative combination. Retrieval for details was observed frequently in the straight-procedural combination. The navigational patterns varied across combinations, but pausing, forwarding, rewinding, and skipping were commonly observed in declarative content regardless of the scenario type. [ABSTRACT FROM AUTHOR]

AbstractAutonomous vehicles (AVs) are rapidly evolving as a novel way of transportation. Nevertheless, there is a consensus that AVs cannot address all traffic scenarios independently. Consequently, there arises a need for remote human intervention. To pave the way for large-scale deployment of AVs onto public roadways, innovative models of remote operation must evolve. Such a paradigm is Tele-assistance, which posits that the low-level control of AVs should be delegated through high-level commands. Our work explores how such a command language should be constructed as a first step in designing a Tele-assistance user interface. Through interviews with 17 experienced teleoperators, we elicit a set of discrete commands that a remote operator can use to resolve various road scenarios. Subsequently, we create a scenario-command mapping and a thematic classification of the defined commands. Finally, we present an initial Tele-assistance interface design based on these commands. [ABSTRACT FROM AUTHOR]

Traffic management in aviation, shipping, and rail transport shows similarities and dissimilarities in the work process. For example, they share the temporal aspect, but different levels of urgency in the control work set different requirements on monitoring, decisions, and actions. However, few studies have been presented that model and compare the different domains in terms of temporal decision-making. The Joint Control Framework (JCF) is an approach to analyse and temporally model operators' control processes from a cognitive systems engineering perspective. In this study, we have used JCF to map, and compare, cognitive joints, such as perceptions, decisions, and actions, in temporally challenging control situations in air traffic control, maritime vessel traffic service, and train traffic management. Data was collected collaboratively with traffic operators, focusing on (1) identifying challenging traffic situations and (2) jointly modelling the temporal decision-making patterns of these situations using simplified JCF. Post-analysis was done by breaking down the results into different processes and comparing domains to ascertain how operators maintain control. An intermediate level of activity—between general monitoring and work with specific vehicles—was identified: processes-in-focus. A shared problem arises in the shift between general monitoring and the processes-in-focus. All processes-in-focus comprise cognitive joint cycles of perceptions, decisions, and actions. However, depending on the framing of processes-in-focus, the patterns of joints, such as temporal extension and complexity, differ. In the remainder of the article, implications for the interaction design, in particular the potential for human–AI/automation teaming with higher levels of automation and cognitive autonomy, are discussed. [ABSTRACT FROM AUTHOR]

Text descriptions in museums provide detailed and rich information about artifacts that broadens museum visitors' knowledge and enriches their experience. However, since deaf and hard-of-hearing (DHH) individuals have low literacy compared to hearing people and communicate through sign language, museum descriptions are considerably limited in delivering a stimulating and informative environment for understanding and enjoying exhibits. To improve DHH individuals' museum experience, we investigated the potential of three interactive description prototypes: active-linked, graph-based, and chatbot-based. A comparative study with 20 DHH participants confirmed that our interaction-based prototypes improve information accessibility and provide an enhanced experience compared to conventional museum descriptions. Most participants preferred the graph-based prototype, while post-interviews suggested that each prototype has potential benefits and limitations according to DHH individuals' particular literacy skills and preferences. Text descriptions can be enlivened for DHH visitors by adding a simple interaction functionality, e.g., clicking, which can lead to a better museum experience. [ABSTRACT FROM AUTHOR]

The recent advancements in mobile technologies have enabled the widespread adoption of augmented reality (AR) to enrich cultural heritage (CH) digital experiences. Mobile AR leverages visual recognition capabilities and sensor data to superimpose digital elements into the user's view of their surroundings. The pervasive nature of AR serves several purposes in CH: visitor guidance, 3D reconstruction, educational experiences, and mobile location-based games. While most literature reviews on AR in CH focus on technological aspects such as tracking algorithms and software frameworks, there has been little exploration of the expressive affordances of AR for the delivery of meaningful interactions. This paper (based on the PRISMA guidelines) considers 64 selected publications, published from 2016 to 2023, that present mobile AR applications in CH, with the aim of identifying and analyzing the (mobile) AR (interaction) design patterns that have so far been discussed sporadically in the literature. We identify sixteen (16) main UX design patterns, as well as eight (8) patterns with a single occurrence in the paper corpus, that have been employed—sometimes in combination—to address recurring design problems or contexts, e.g., user navigation, representing the past, uncovering hidden elements, etc. We analyze each AR design pattern by providing a title, a working definition, principal use cases, and abstract illustrations that indicate the main concept and its workings (where applicable) and explanation with respect to examples from the paper corpus. We discuss the AR design patterns in terms of a few broader design and development concerns, including the AR recognition approach, content production and development requirements, and affordances for storytelling, as well as possible contexts and experiences, including indoor/outdoor settings, location-based experiences, mobile guides, and mobile games. We envisage that this work will thoroughly inform AR designers and developers abot the current state of the art and the possibilities and affordances of mobile AR design patterns with respect to particular CH contexts. [ABSTRACT FROM AUTHOR]

AbstractGiven the widespread use of word processing systems today, error correction and text editing tasks are frequently performed. A novel method for error correction and text editing using voice&mouse was developed and evaluated. A within-participants counterbalanced study design was used to compare users’ performance and satisfaction with the proposed method to their performance and satisfaction with two other methods that enable natural interaction with Microsoft Word, voice-only and voice&gaze, and with conventional interaction using the keyboard&mouse method, when performing error correction and text editing tasks. Our comprehensive evaluation showed that for all of the examined tasks the proposed voice&mouse method performed comparably to the voice-only and voice&gaze methods or significantly outperformed them on all evaluation measures. The keyboard&mouse method yielded significantly higher average SUS scores and lower NASA-TLX task loads than the other methods. However, participants significantly preferred using the voice&mouse method, in general, and especially for tasks that typically require typing in addition to using a mouse, such as fix, replace, and add, and the performance times for the two methods were comparable when performing these tasks. The findings support the use of the voice&mouse method for error correction and text editing along with the keyboard&mouse method. This would allow users to choose their preferred interaction method for each scenario and task while improving their performance and satisfaction. [ABSTRACT FROM AUTHOR]

Affective design plays a crucial role in creating satisfying user experiences by incorporating emotional elements into product or interface development. However, visually impaired individuals often face challenges in accessing positive interactions that cater to their unique needs. This research presents an iterative approach to developing and evaluating an affective design model specifically tailored for visually impaired users. The iterative triangulation methodology (ITM) was employed across theoretical, construction, and evaluation phases, incorporating expert reviews to refine the model. Results from the expert review revealed the need for a more nuanced breakdown of elements, particularly in content, user, design, multimedia and learning, affective, technology, and interaction components. The revised model addresses these insights, emphasizing adaptability for visually impaired users. Key enhancements include specific design components, multimedia theories, and learning approaches. The revised affective design model offers improved clarity and readability, reflecting a comprehensive synthesis of expert insights. It contributes to creating an inclusive interaction environment for visually impaired individuals, aligning with broader goals of accessibility and inclusivity in design. This research serves as a valuable resource for educators, curriculum developers, and policymakers working towards fostering inclusive learning experiences. [ABSTRACT FROM AUTHOR]

Pull-the-Strings presents a mapping model for digital puppetry based on a transparent framework to support generic device controllers and generic tools. Digital puppetry requires a creative interaction design, in particular in the way designers map the puppet to the puppeteer using specific devices. This process depends on a constantly changing interface technology, which limits the reuse of devices and mappings. This paper proposes a methodology and a set of tools that facilitate the mapping process, and promote the recycling of technologies. A flexible and generic environment independent from device specifications. By abstracting the hardware layer, the artist is motivated to think in terms of signal flow, establishing relations through meaningful mappings instead of handling the diverse specifications of each device and application. Pull-the-Strings is a data-flow ecosystem that focus on the functional usage of control signals. It provides a scalable environment for building semantic blocks that connect, transform and generate signals for the manipulation of virtual objects. Its goal is to make technology as transparent as possible, facilitating connections and reducing the obstacles between the performer and the performing object. On the other hand, it proposes an interaction design space that takes into account the manipulation and perception distance, responding to the specifications of the digital puppetry medium. This model was evaluated comparing a set of tools and methods with experienced and non-experienced users. [ABSTRACT FROM AUTHOR]