Search

Smart home inhabitants can specify trigger-condition-action rules to control the home's behavior. As the number of rules and their complexity grow, however, so does the probability of issues such as inconsistencies and redundancies. These can lead to unintended behavior, including security vulnerabilities and wasted resources, which harms the inhabitants' trust in the system. Existing approaches to handle unintended behavior typically require inhabitants to define all-encompassing, permanent solutions by modifying the rules. Although this is fitting in certain situations, some unforeseen situations might occur. We argue that the user always must have the last word to avoid unwanted behaviors, without altering the overall behavior. With FortClash, we present an approach to predict many different types of unintended behavior, and contribute four novel mechanisms to mediate them that rely on making one-time exceptions. With FortClash, inhabitants gain a new tool to deal with unintended behavior in the short-term that is compatible with existing long-term approaches such as editing rules.

As robots are equipped with software that makes them increasingly autonomous, it becomes harder for humans to understand and control these robots. Human users should be able to understand and, to a certain amount, predict what the robot will do. The software that drives a robotic system is often very complex, hard to understand for human users, and there is only limited support for ensuring robotic systems are also intelligible. Adding intelligibility to the behavior of a robotic system improves the predictability, trust, safety, usability, and acceptance of such autonomous robotic systems. Applying intelligibility to the interface design can be challenging for developers and designers of robotic systems, as they are expert users in robot programming but not necessarily experts on interaction design. We propose Choreobot, an interactive, online, and visual dashboard to use with our reference framework to help identify where and when adding intelligibility to the interface design is required, desired, or optional. The reference framework and accompanying input cards allow developers and designers of robotic systems to specify a usage scenario as a set of actions and, for each action, capture the context data that is indispensable for revealing when feedforward is required. The Choreobot interactive dashboard generates a visualization that presents this data on a timeline for the sequence of actions that make up the usage scenario. A set of heuristics and rules are included that highlight where and when feedforward is desired. Based on these insights, the developers and designers can adjust the interactions to improve the interaction for the human users working with the robotic system.

Currently process engineers are using documents or authoring tools to bring the assembly instructions to the work floor. This is a time-consuming task, as instructions need to be created for each assembly operation. Furthermore, the engineer needs to be familiar with the assembly sequence. To assist the engineer, a tool is developed that i) uses a heuristic based on visibility, part similarity and proximity to semi-automatically determine the assembly sequence from a CAD model and ii) according to the computed sequence generates digital work instructions including visualizations and animations extracted from the CAD model. In essence, the assembly sequence generation works reversely: it determines the order in which components can be removed from the assembly, by evaluating whether the visibility of a component is obstructed by the remaining assembly. The reversed order is then returned as assembly sequence. During this process the engineer can modify the proposed sequence, add annotations and alter the vi-sualizations of the proposed instructions, i.e., images or 3D-animations. We illustrate that the developed tool effectively supports process engineers and speeds up the creation of digital work instructions by some industrial validation cases, e.g., the assembly of a weaving machine. This research is supported by VLAIO (Flanders Innovation & En- trepreneurship) Flanders Make, the strategic center for the man- ufacturing industry in Flanders, within the framework of the Op- eratorKnowledge ICON-project ( HBC.2017.0395 ). We like to thank Jens Brulmans, Niels Billen, Robbe Cools and Georges Verpoorten for their contributions to the implementation, and our partners Arkite, Augnition, Barco, CNHi, Atlas Copco, ASCO and Picanol for providing test data and context for this work.

We present Rataplan, a robust and resilient pixel-based approach for linking multi-modal proxies to automated sequences of actions in graphical user interfaces (GUIs). With Rataplan, users demonstrate a sequence of actions and answer human-readable follow-up questions to clarify their desire for automation. After demonstrating a sequence, the user can link a proxy input control to the action which can then be used as a shortcut for automating a sequence. Alternatively, output proxies use a notification model in which content is pushed when it becomes available. As an example use case, Rataplan uses keyboard shortcuts and tangible user interfaces (TUIs) as input proxies, and TUIs as output proxies. Instead of relying on available APIs, Rataplan automates GUIs using pixel-based reverse engineering. This ensures our approach can be used with all applications that offer a GUI, including web applications. We implemented a set of important strategies to support robust automation of modern interfaces that have a flat and minimal style, have frequent data and state changes, and have dynamic viewports.

Virtual Reality (VR) allows simulation of machine control panels without physical access to the machine, enabling easier and faster initial exploration, testing, and validation of machine panel designs. However, haptic feedback is indispensable if we want to interact with these simulated panels in a realistic manner. We present HapticPanel, an encountered-type haptic system that provides realistic haptic feedback for machine control panels in VR. To ensure a realistic manipulation of input elements, the user’s hand is continuously tracked during interaction with the virtual interface. Based on which virtual element the user intends to manipulate, a motorized panel with stepper motors moves a corresponding physical input element in front of the user’s hand, enabling realistic physical interaction.

Funding Information: This work was partly funded by the Department of Communications and Networking (Comnet, Aalto University), and Academy of Finland projects ‘Human Automata’ and ‘BAD’. This research was partially funded by Flanders Make, the strategic research centre for the manufacturing industry, through its projects ‘SmartHandler’ and ‘Ergo-EyeHand’. Publisher Copyright: © 2021 ACM. The promise of on-body interactions has led to widespread development of wearable displays. They manifest themselves in highly variable shapes and form, and are realized using technologies with fundamentally different properties. Through an extensive survey of the field of wearable displays, we characterize existing systems based on key qualities of displays and wearables, such as location on the body, intended viewers or audience, and the information density of rendered content. We present the results of this analysis in an open, web-based interactive design space that supports exploration and refinement along various parameters. The design space, which currently encapsulates 129 cases of wearable displays, aims to inform researchers and practitioners on existing solutions and designs, and enable the identification of gaps and opportunities for novel research and applications. Further, it seeks to provide them with a thinking tool to deliberate on how the displayed content should be adapted based on key design parameters. Through this work, we aim to facilitate progress in wearable displays, informed by existing solutions, by providing researchers with an interactive platform for discovery and reflection.

In domains where users are exposed to large variations in visuo-spatial features among designs, they often spend excess time searching for common elements (features) on an interface. This article contributes individualised predictive models of visual search, and a computational approach to restructure graphical layouts for an individual user such that features on a new, unvisited interface can be found quicker. It explores four technical principles inspired by the human visual system (HVS) to predict expected positions of features and create individualised layout templates: (I) the interface with highest frequency is chosen as the template; (II) the interface with highest predicted recall probability (serial position curve) is chosen as the template; (III) the most probable locations for features across interfaces are chosen (visual statistical learning) to generate the template; (IV) based on a generative cognitive model, the most likely visual search locations for features are chosen (visual sampling modelling) to generate the template. Given a history of previously seen interfaces, we restructure the spatial layout of a new (unseen) interface with the goal of making its features more easily findable. The four HVS principles are implemented in Familiariser, a web browser that automatically restructures webpage layouts based on the visual history of the user. Evaluation of Familiariser (using visual statistical learning) with users provides first evidence that our approach reduces visual search time by over 10%, and number of eye-gaze fixations by over 20%, during web browsing tasks. The project has partially received funding from the Academy of Finland project COMPUTED and the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement 637991).

Physical exercise training and medication compliance are primary components of cardiac rehabilitation. When rehabilitating independently at home, patients often fail to comply with their prescribed medication and find it challenging to interpret exercise targets or be aware of the expected efforts. Our work aims to assist cardiac patients in understanding their condition better, promoting medication adherence and motivating them to achieve their exercise targets in a tele-rehabilitation setting. We introduce a patient-centric intelligible visualization approach to present prescribed medication and exercise targets to patients. We assessed efficacy of intelligible visualizations on patients’ comprehension in two lab studies. We evaluated the impact on patient motivation and health outcomes in field studies. Patients were able to adhere to medication prescriptions, manage their physical exercises, monitor their progress and gained better self-awareness on how they achieved their rehabilitation targets. Patients confirmed that the intelligible visualizations motivated them to achieve their targets better. We observed an improvement in overall physical activity levels and health outcomes of patients. Research Highlights Presents challenges currently faced in cardiac tele-rehabilitation. Demonstrates how intelligibility was applied to two core aspects of cardiac rehabilitation- promoting medication adherence and physical exercise training. Lab., field and clinical studies to demonstrate efficacy of intelligible visualization, impact on patient motivation and resultant health outcomes. Reflection on how similar HCI approaches could be leveraged for technology-supported management of critical health conditions such as cardiac diseases.

Feedback and feedforward are two fundamental mechanisms that support users’ activities while interacting with computing devices. While feedback can be easily solved by providing information to the users following the triggering of an action, feedforward is much more complex as it must provide information before an action is performed. For interactive applications where making a mistake has more impact than just reduced user comfort, correct feedforward is an essential step toward correctly informed, and thus safe, usage. Our approach, Fortunettes, is a generic mechanism providing a systematic way of designing feedforward addressing both action and presentation problems. Including a feedforward mechanism significantly increases the complexity of the interactive application hardening developers’ tasks to detect and correct defects. We build upon an existing formal notation based on Petri Nets for describing the behavior of interactive applications and present an approach that allows for adding correct and consistent feedforward.

The number of wearable devices that we carry increases, with smaller companion devices like smartwatches providing quick access for simple tasks. These devices are, however, not necessarily in direct sight of the user and during everyday activities, it is unlikely, even undesirable, that the user constantly focuses on or interacts with these screens. Furthermore, interaction is often limited because our hands are occupied carrying or holding items such as bags, papers, boxes, or tools. In this paper, we evaluate how encumbrance affects, among others, the time it takes to perceive and react to a notification depending on the placement of the companion device. Our experimental results can assist designers in choosing the right device for the task.

Listening to music while being on the move is common in our headphone society. However, if we want assistance in navigation from our smartphone, existing approaches either demand exclusive playback through the headphones or impact the listening experience of the music. We present a field evaluation of Attracktion, a spatial audio navigation system that leverages the access to single stems in a multi-track recording to minimize the impact on the listening experience. We compared Attracktion against current turn-by-turn navigation instructions in a field-study with 22 users and found that users perceived acoustic overlays with additional navigation information to have no impact on the listening experience. In terms of path efficiency, errors, and mental workload, Attracktion is on par with spoken turn-by-turn navigation instructions, and users liked it for the aspect of serendipity.

Makerspaces are creative and learning environments, home to activities such as fabrication processes and Do-It-Yourself (DIY) tasks. However, containing equipment that are not commonly seen or handled, these spaces can look rather challenging to novice users. This paper is based on the Smart Makerspace research from Autodesk, which uses a smart workbench for an immersive instructional space for DIY tasks. Having its functionalities in mind and trying to overcome some of its limitations, we approach the concept building an immersive instructional space as a web platform. The platform, introduced to users in a makerspace, had a feedback that reflects its potential between novice and intermediate users, for creating facilitators and encouraging these users.

This study focuses on innovative ways to digitally instrument the servicescape in bricks-and-mortar retailing. In the present digital era, technological developments allow for augmenting the shopping experience and capturing moments-of-truth along the shopper's path-to-purchase. This article provides an encompassing inventory of retail technologies resulting from a systematic screening of three secondary data sources, over 2008–2016: (1) the academic marketing literature, (2) retailing related scientific ICT publications, and (3) business practices (e.g., publications from retail labs and R&D departments). An affinity diagram approach allows for clustering the retail technologies from an HCI perspective. Additionally, a categorization of the technologies takes place in terms of the type of shopping value that they offer, and the stage in the path-to-purchase they prevail. This indepth analysis results in a comprehensive inventory of retail technologies that allows for verifying the suitability of these technologies for targeted in-store shopper marketing objectives (cf. the resulting online faceted-search repository at www.retail-tech.org). The findings indicate that the majority of the inventoried technologies provide cost savings, convenience and utilitarian value, whereas few offer hedonic or symbolic benefits. Moreover, at present the earlier stages of the path-to-purchase appear to be the most instrumented. The article concludes with a research agenda. This research has been funded by the Digitopia and Flanders Innovation & Entrepreneurship Baekeland grant number 150726 (‘In search of a sustainable competitive advantage: Digitally instrumenting bricks-and-mortar retailing in Flanders’; April 2016–March 2020). The authors furthermore acknowledge Randy Lauriers for her input in the data collection process for this study and the two anonymous reviewers whose suggestions helped in further strengthening a previous version of this manuscript.

Fig. 1. Based on self-sustaining predictions (e.g. the sun will set), FORTNIoT can deduce when trigger-condition-action rules (e.g. IF sun set AND anyone home THEN lower the rolling shutter) will trigger in the near future and what effects they will cause (e.g. the rolling shutter will lower). Ubiquitous environments, such as smart homes, are becoming more intelligent and autonomous. As a result, their behavior becomes harder to grasp and unintended behavior becomes more likely. Researchers have contributed tools to better understand and validate an environments' past behavior (e.g. logs, end-user debugging), and to prevent unintended behavior. There is, however, a lack of tools that help users understand the future behavior of such an environment. Information about the actions it will perform, and why it will perform them, remains concealed. In this paper, we contribute FORTNIoT, a well-defined approach that combines self-sustaining predictions (e.g. weather forecasts) and simulations of trigger-condition-action rules to deduce when these rules will trigger in the future and what state changes they will cause to connected smart home entities. We implemented a proof-of-concept of this approach, as well as a visual demonstrator that shows such predictions, including causes and effects, in an overview of a smart home's behavior. A between-subject evaluation with 42 participants indicates that FORTNIoT predictions lead to a more accurate understanding of the future behavior, more confidence in that understanding, and more appropriate trust in what the system will (not) do. We envision a wide variety of situations where predictions about the future are beneficial to inhabitants of smart homes, such as debugging unintended behavior and managing conflicts by exception, and hope to spark a new generation of intelligible tools for ubiquitous environments.

Feedback and feedforward are two fundamental mechanisms that supports users’ activities while interacting with computing devices. While feedback can be easily solved by providing information to the users following the triggering of an action, feedforward is much more complex as it must provide information before an action is performed. Fortunettes is a generic mechanism providing a systematic way of designing feedforward addressing both action and presentation problems. Including a feedforward mechanism significantly increases the complexity of the interactive application hardening developers’ tasks to detect and correct defects. This paper proposes the use of an existing formal notation for describing the behavior of interactive applications and how to exploit that formal model to extend the behavior to offer feedforward. We use a small login example to demonstrate the process and the results.

Notifications have become a core component of the smart-phone as our ubiquitous companion. Many of these only require minimal interaction, for which the smartwatch is a helpful companion device. However, its design and placement is influenced by its traditional ancestors. For applications where the user is constrained because of a specific usage situation, or performs tasks with both hands simultaneously, interaction with the smartwatch can be cumbersome. In this paper, we propose a wearable armstrap for minimal interaction in long-lived tasks. Placed around the elbow, it is outside the hands' proximal working space which reduces interference. Its flexible e-ink display provides screen space to provide overview information at minimal energy consumption for longer uptime. We designed the wearable for a professional use-case, meaning that is can easily be placed above protective clothing as its flexible round shape easily adjusts to various diameters. Capacitive touch sensing allows gesture input even under rough conditions, e.g., with gloves.

When using computer-aided translation systems in a typical, professional translation workflow, there are several stages at which there is room for improvement. The SCATE (Smart Computer-Aided Translation Environment) project investigated several of these aspects, both from a human-computer interaction point of view, as well as from a purely technological side. This paper describes the SCATE research with respect to improved fuzzy matching, parallel treebanks, the integration of translation memories with machine translation, quality estimation, terminology extraction from comparable texts, the use of speech recognition in the translation process, and human computer interaction and interface design for the professional translation environment. For each of these topics, we describe the experiments we performed and the conclusions drawn, providing an overview of the highlights of the entire SCATE project. The research in this project was funded by the Flemish Agency for Innovation and Technology IWT, project number 13007.

International audience; Feedback is commonly used to explain what happened in an interface. What if questions, on the other hand, remain mostly unanswered. In this paper, we present the concept of enhanced widgets capable of visualizing their future state, which helps users to understand what will happen without committing to an action. We describe two approaches to extend GUI toolkits to support widget-level feedforward, and illustrate the usefulness of widget-level feedforward in a standardized interface to control the weather radar in commercial aircraft. In our evaluation, we found that users require less clicks to achieve tasks and are more confident about their actions when feedforward information was available. These findings suggest that widget-level feedforward is highly suitable in applications the user is unfamiliar with, or when high confidence is desirable.

We present JigFab, an integrated end-to-end system that supports casual makers in designing and fabricating constructions with power tools. Starting from a digital version of the construction, JigFab achieves this by generating various types of constraints that configure and physically aid the movement of a power tool. Constraints are generated for every operation and are custom to the work piece. Constraints are laser cut and assembled together with predefined parts to reduce waste. JigFab's constraints are used according to an interactive step-by-step manual. JigFab internalizes all the required domain knowledge for designing and building intricate structures, consisting of various types of finger joints, tenon & mortise joints, grooves, and dowels. Building such structures is normally reserved for artisans or automated with advanced CNC machinery.

Part 4: Tools and Tool-Support; International audience; Collaborative robot-assisted production has great potential for high variety low volume production lines. These type of production lines are common in both personal fabrication settings as well as in several types of flexible production lines. Moreover, many assembly tasks are in fact hard to complete by a single user or a single robot, and benefit greatly from a fluent collaboration between both. However, programming such systems is cumbersome, given the wide variation of tasks and the complexity of instructing a robot how it should move and operate in collaboration with a human user.In this paper we explore the case of collaborative assembly for personal fabrication. Based on a CAD model of the envisioned product, our software analyzes how this can be composed from a set of standardized pieces and suggests a series of collaborative assembly steps to complete the product. The proposed tool removes the need for the end-user to perform additional programming of the robot. We use a low-cost robot setup that is accessible and usable for typical personal fabrication activities in Fab Labs and Makerspaces. Participants in a first experimental study testified that our approach leads to a fluent collaborative assembly process. Based on this preliminary evaluation, we present next steps and potential implications.

Translation environments offer various translation aids to support professional translators. However, translation aids typically provide only limited justification for the translation suggestions they propose. In this paper we present Intellingo, a translation environment that explores intelligibility for translation aids, to enable more sensible usage of translation suggestions. We performed a comparative study between an intelligible version and a non-intelligible version of Intellingo. The results show that although adding intelligibility does not necessarily result in significant changes to the user experience, translators can better assess translation suggestions without a negative impact on their performance. Intelligibility is preferred by translators when the additional information it conveys benefits the translation process and when this information is not part of the translator’s readily available knowledge. The SCATE (Smart Computer-Aided Translation Environment) project IWT 130041 is funded by the Flemish Institute for the Promotion of the Scientific-Technological Research in the Industry (IWT Vlaanderen).

The emergence of smart objects has the potential to radically change the way we interact with technology. Through embedded means for input and output, such objects allow for more natural and immediate interaction. The SmartObjects workshop will focus on how such embedded intelligence in objects situated in the user's physical environment can be used to provide more efficient and enjoyable interactions. We discuss the design from the technology and the user experience perspective.

We present a scalable Do-It-Yourself (DIY) fabrication workflow for prototyping highly stretchable yet robust devices using a CO2 laser cutter, which we call Silicone Devices. Silicone Devices are self-contained and thus embed components for input, output, processing, and power. Our approach scales to arbitrary complex devices as it supports techniques to make multi-layered stretchable circuits and buried VIAs. Additionally, high-frequency signals are supported as our circuits consist of liquid metal and are therefore highly conductive and durable. To enable makers and interaction designers to prototype a wide variety of Silicone Devices, we also contribute a stretchable sensor toolkit, consisting of touch, proximity, sliding, pressure, and strain sensors. We demonstrate the versatility and novel opportunities of our technique by prototyping various samples and exploring their use cases. Strain tests report on the reliability of our circuits and preliminary user feedback reports on the user-experience of our workflow by non-engineers.

Implementing multimodal interactions with event-driven languages results in a ‘callback soup', a source code littered with a multitude of flags that have to be maintained in a self-consistent manner and across different event handlers. Prototyping multimodal interactions adds to the complexity and error sensitivity, since the program code has to be refined iteratively as developers explore different possibilities and solutions. The authors present a declarative language for rapid prototyping multimodal interactions: Hasselt permits declaring composite events, sets of events that are logically related because of the interaction they support, that can be easily bound to dedicated event handlers for separate interactions. The authors' approach allows the description of multimodal interactions at a higher level of abstraction than event languages, which saves developers from dealing with the typical ‘callback soup' thereby resulting in a gain in programming efficiency and a reduction in errors when writing event handling code. They compared Hasselt with using a traditional programming language with strong support for events in a study with 12 participants each having a solid background in software development. When performing equivalent modifications to a multimodal interaction, the use of Hasselt leads to higher completion rates, lower completion times, and less code testing than when using a mainstream event-driven language.

Keeping track of design processes is a cumbersome task due to the apparently unconstrained and unstructured nature of creative work. Traceability is fundamental to revisit and reflect on the design narratives that describe artefact evolution. In this paper, we aim to identify what characteristics are necessary to facilitate traceability of creative design processes. For this end, we use a functional prototype to connect artefacts, design rationale, and decisions in a shared workspace. We evaluated this prototype for 15 weeks with six pairs of students engaged in a user-centered design project. Our findings show that having a lean repository of artefacts annotated with design rationale can facilitate tracking progress in different phases of the process. We found that creating a record of the participants' design work is useful to reflect on and for team agreement, ensure consistency of evolving artefacts, and help in planning future steps in the design project.

Physical exercise is a primary component of cardiac rehabilitation. Interpreting exercise targets and being aware of the expected effort while rehabilitating independently at home is challenging for patients. Our work aims to assist cardiac patients in understanding their condition better and motivating them to achieve their exercise targets in a tele-rehabilitation setting. We introduce a patient-centric intelligible visualization approach to present prescribed rehabilitation targets to patients based on Metabolic Equivalent of Tasks (METs). We assessed efficacy of intelligible visualizations on patients’ comprehension in a lab study. We evaluated the impact on patient motivation and health outcomes in field studies. Patients were able to manage their prescribed activities, monitor their progress, and gained understanding on how their physical activities contribute to their rehabilitation targets. Patients confirmed that the intelligible visualizations motivated them to achieve their targets better. We observed an improvement in overall physical activity levels and health outcomes of patients.

In domains where users are exposed to large variations in visuo-spatial features among designs, they often spend excess time searching for common elements (features) in familiar locations. This paper contributes computational approaches to restructuring layouts such that features on a new, unvisited interface can be found quicker. We explore four concepts of familiarisation, inspired by the human visual system (HVS), to automatically generate a familiar design for each user. Given a history of previously visited interfaces, we restructure the spatial layout of the new (unseen) interface with the goal of making its elements more easily found. Familiariser is a browser-based implementation that automatically restructures webpage layouts based on the visual history of the user. Our evaluation with users provides first evidence favouring familiarisation. The project has partially received funding from the Academy of Finland project COMPUTED and the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement 637991).

We present StrutModeling, a computationally enhanced construction kit that enables users without a 3D modeling background to prototype 3D models by assembling struts and hub primitives in physical space. Physical 3D models are immediately captured in software and result in readily available models for 3D printing. Given the concrete physical format of StrutModels, modeled objects can be tested and fine tuned in the presence of existing objects and specific needs of users. StrutModeling avoids puzzling with pieces by contributing an adjustable strut and universal hub design. Struts can be adjusted in length and snap to magnetic hubs in any configuration. As such, arbitrarily complex models can be modeled, tested, and adjusted during the design phase. In addition, the embedded sensing capabilities allow struts to be used as measuring devices for lengths and angles, and tune physical mesh models according to existing physical objects.

Part 7: Design Rationale and Camera-Control; International audience; In the design process, designers make a wide variety of decisions that are essential to transform a design from a conceptual idea into a concrete solution. Recording and tracking design decisions, a first step to capturing the rationale of the design process, are tasks that until now are considered as cumbersome and too constraining. We used a holistic approach to design, deploy, and verify decision cards; a low threshold tool to capture, externalize, and contextualize design decisions during early stages of the design process. We evaluated the usefulness and validity of decision cards with both novice and expert designers. Our exploration results in valuable insights into how such decision cards are used, into the type of information that practitioners document as design decisions, and highlight the properties that make a recorded decision useful for supporting awareness and traceability on the design process.

Design meetings with multidisciplinary stakeholders are instrumental for design projects. However, design teams face the challenges of synthetizing large amounts of information, often in a limited time, and with minimal common ground. We investigate these challenges through in-the-wild observations of six design meetings in three different projects, with professional design teams that follow a user-centered design methodology. We found that all the observed design meetings had a similar structure consisting of particular phases, in which design activities were organized around artefacts. These artefacts were used as input to disseminate and gather feedback of previous design outcomes, or as output to collect and process a variety of perspectives. From these findings, we synthetize practical guidelines to optimize artefact-based interactions during design meetings.

Empathic communication allows individuals to perceive and understand the feeling and emotion of the person with whom they are interacting. This could be particularly important during remote collaboration (such as remote assistance or distance learning) to enhance the social and emotional understanding of geographically distributed partners. However, supporting awareness in remote collaboration is very challenging especially when the interaction with the remote parties results in less information that can be communicated than in a physical interaction. We explore the effect of visualization using physiological cues that allow users to interpret emotional behaviors of remote parties with whom they are interacting in real time. The proposed visual representation allows users to infer emotional patterns from physiological cues that can potentially influence their communication approach toward a more aggressive style or maintain passive and peaceful interaction. We conducted a study involving participants who were paired up for a collaborative assessment task, interacting via voice only, videoconference, or a visual representation of the physiological measurements. Participants perceived the usage of our visual representation with higher group cohesiveness than using voice-only interaction. Further analysis shows that the visual representation significantly increases the positive affect score (i.e., participants are perceived to be more alert and demonstrate less distress) during remote collaboration. We discuss the possibilities of the proposed visual representation to support empathic communication during remote collaboration, and the benefits to the remote partners of having positive affect and group cohesiveness.

In einem Forschungsprojekt der Universitaten Hasselt, Belgien, und Fribourg, Schweiz, wird untersucht, wie Patienten mit leichter Demenz und ihre Betreuer (Arzt, Pflegepersonal, Angehorige) mit mobilen Technologien adaquat unterstutzt werden konnen. Besonderer Wert wird auf die Gestaltung der Benutzerschnittstellen gelegt. Mithilfe einer Storyboard Language gelingt es, wichtige Kontexttypen wie Aktivitat, Identitat, Ort oder Zeit aus unterschiedlichen Episoden zu extrahieren und als Grundlage fur kontextbasierte Demenz-Dienste zu verwenden.

Smart objects can be smart because of the information and communication technology that is added to human-made artifacts. It is not, however, the technology itself that makes them smart but rather the way in which the technology is integrated, and their smartness surfaces through how people are able to interact with these objects. Hence, the key challenge for making smart objects successful is to design usable and useful interactions with them. We list five features that can contribute to the smartness of an object, and we discuss how smart objects can help resolve the simplicity-featurism paradox. We conclude by introducing the three articles in this special issue, which dive into various aspects of smart object interaction: augmenting objects with projection, service-oriented interaction with smart objects via a mobile portal, and an analysis of input-output relations in interaction with tangible smart objects.

Part 7: Demonstrations; International audience; Patient coaching is integral to cardiac rehabilitation programs to help patients understand, cope better with their condition and become active participants in their care. The introduction of remote patient monitoring technologies and tele-monitoring solutions have proven to be effective and paved way for novel remote rehabilitation approaches. Nonetheless, these solutions focus largely on monitoring patients without a specific focus on coaching patients. Additionally, these systems lack personalization and a deeper understanding of individual patient needs. In our demonstration, we present a tool to personalize e-coaching based on individual patient risk factors, adherence rates and personal preferences of patients using a tele-rehabilitation solution. We developed the tool after conducting a workshop and multiple brainstorms with various caregivers involved in coaching cardiac patients to connect their perspectives with patient needs. It was integrated into a comprehensive tele-rehabilitation application.

Persons that suffered from a cardiac disease are often recommended to integrate a sufficient level of physical exercise in their daily life. Initially, cardiac rehabilitation takes place in a closely monitored setting in a hospital or a rehabilitation center. Sustaining the effort once the patient has left the ambulatory, supervised environment is a challenge, and drop-out rates are high. Emerging approaches such as telemonitoring and telerehabilitation have been proven to show the potential to support the cardiac patient in adhering to the advised physical exercise. However, most telerehabilitation solutions only support a limited range of physical exercise, such as step-counting during walking. We propose BoB (Back on Bike), a mobile application that guides cardiac patients while cycling. Design choices are explained according to three pillars: ease of use, reduce fear, and direct and indirect motivation. In this paper, we report the results from a field study with cardiac patients.

Human-Robot Collaboration is increasingly considered in manufacturing to better combine the strengths of humans and robots. Establishing this human-robot collaboration may require multi-modal interaction; input to and output from the robot can both use multiple channels in sequence or in parallel. Designing effective interaction requires the expertise from different domains, possibly originating from people with different backgrounds. In our work we explore how composite events — hierarchical composition of events — can be used in a way that eases the communication within a multi-disciplinary team. In this paper, we present how the concept of composite events can be used to create different layers of abstraction that can be used to ease prototyping and discussion of human-robot collaboration with stakeholders through a supporting tool called Hasselt UIMS. At the lower level(s) of abstraction, the composite events can be mapped to the message-based communication as implemented in the Robotic Operating System (ROS), which is used to program collaborative robots, such as the Baxter robot from Rethink Robotics.

We present Handly, an integrated upper-limb rehabilitation system for persons with a neurological disorder. Handly consists of tangibles for training four hand tasks with specific functional handgrips and a motivational game. These persons need intensive personalized therapy in order to sustain or enhance their abilities and aptitude in daily activities. Conventional approaches require intense support by a therapist or usage of expensive robots, both of which are not a sustainable model of training. Handly combines tangibles specifically designed for repetitive task-oriented motor skill training of typical daily activities with serious gaming, thus offering a comprehensive approach. A feedback mechanism guides the user and an accessible game environment stimulates individual training. We performed an initial evaluation of Handly with eight persons with Multiple Sclerosis. We show that a tangible-virtual environment for intensive upper-limb rehabilitation is feasible and that this approach is highly appreciated by the patients.

Intense and frequent motor training is essential in persons with neurological disorders as there are MS and stroke. Technology-based rehabilitation has been proven to be beneficial for specific patient groups, as it shows to be effective on muscle strength and active range of motion of the upper limbs. Personalized training in technology-supported rehabilitation setups using motivational techniques such as serious games have the potential to make repetitive training efforts more endurable. Most neurological rehabilitation approaches suffer from a strict separation between training scenarios and activities in daily living, but have difficulties to bridge the gap between exercising on a functional level and performing on the level of activities in daily living. To improve the integration of motor skill training in a daily living context we propose an approach and proof-of-concept implementation of the training device ReHappy, a tangible character that engages patient in performing additional training that complements the daily activities.

In this paper, we set out to find what encompasses an appropriate visual language for information presented on near-eye out-of-focus displays. These displays are positioned in a user's peripheral view, very near to the user's eyes, for example on the inside of the temples of a pair of glasses. We explored the usable display area, the role of spatial and retinal variables, and the influence of motion and interaction for such a language. Our findings show that a usable visual language can be accomplished by limiting the possible shapes and by making clever use of orientation and meaningful motion. We found that especially motion is very important to improve perception and comprehension of what is being displayed on near-eye out-of-focus displays, and that perception is further improved if direct interaction with the content is allowed.

Localisation is a standard feature in many mobile applications today, and there are numerous techniques for determining a user’s location both indoors and outdoors. The provided location information is often organised in a format tailored to a particular localisation system’s needs and restrictions, making the use of several systems in one application cumbersome. The presented approach models the details of localisation systems and uses this model to create a unified view on localisation in which special attention is paid to uncertainty coming from different localisation conditions and to its presentation to the user. The work discusses technical considerations, challenges and issues of the approach, and reports on a user study on the acceptance of a mobile application’s behaviour reflecting the approach. The results of the study show the suitability of the approach and reveal users’ preference toward automatic and informed changes they experienced while using the application.

Professional video searchers typically have to search for particular video fragments in a vast video archive that contains many hours of video data. Without having the right video archive exploration tools, this is a difficult and time consuming task that induces hours of video skimming. We propose the video archive explorer, a video exploration tool that provides visual representations of automatically detected concepts to facilitate individual and collaborative video search tasks. This video archive explorer is developed by employing a user-centred methodology, which ensures that the tool is more likely to fit to the end user needs. A qualitative evaluation with professional video searchers shows that the combination of automatic video indexing, interactive visualisations and user-centred design can result in an increased usability, user satisfaction and productivity. Haesen M., Meskens J., Luyten K., Coninx K., Becker J.H., Tuytelaars T., Poulisse G.-J., Pham The P., Moens M.-F., ''Finding a needle in a haystack: an interactive video archive explorer for professional video searchers'', Multimedia tools and applications, vol. 63, no. 2, pp. 331-356, 2013. ispartof: Multimedia Tools and Applications vol:63 issue:2 pages:331-356 status: published

Design artefacts are vital to communicate design outcomes, both in remote and co-located settings. However, it is unclear how artefacts are used to mediate interactions between designers and stakeholders of the design process. The purpose of this paper is exploring how professional design teams use artefacts to guide and capture discussions involving multidisciplinary stakeholders while they work in a co-located setting. An earlier draft of this paper was paper published in the Proceedings of the European Conference on Cognitive Ergonomics (ECCE 2017). This work adds substantial clarification of the methodology followed, further details and photographs of the case studies, and an extended discussion about our findings and their relevance for designing interactive systems. We report the observations of six design meetings in three different projects, involving professional design teams that follow a user-centered design approach. Meetings with stakeholders are instrumental for design projects. However, design teams face the challenge of synthesizing large amounts of information, often in a limited time, and with minimal common ground between meeting attendees. We found that all the observed design meetings had a similar structure consisting of a series of particular phases, in which design activities were organized around artefacts. These artefacts were used as input to disseminate and gather feedback of previous design outcomes, or as output to collect and process a variety of perspectives. We discuss the challenges faced by design teams during design meetings, and propose three design directions for interactive systems to coordinate design meetings revolving around artefacts The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement n° 610725 (COnCEPT project)

In mobile tele-rehabilitation applications for Coronary Artery Disease (CAD) patients, behavior change plays a central role in influencing better therapy adherence and prevention of disease recurrence. However, creating sustainable behavior change that holds a beneficial impact over a prolonged period of time remains an important challenge. In this paper we discuss various models and frameworks related to persuasion and behavior change, and investigate how to incorporate these with a multidisciplinary user-centered design approach for creating a mobile tele-rehabilitation application. By implementing different concepts that contribute to behavior change and applying a set of distinct persuasive design patterns, we were able to translate the high-level goals of behavior theory into a mobile application that explicitly incorporates behavior change techniques and also offers a good overall user experience. We evaluated our system, HeartHab, in a lab setting and show that our approach leads to a high user acceptance and willingness to use the system in daily activities.

Design, and in particular user-centered design processes for interactive systems, typically involve multidisciplinary teams. The different and complementary perspectives of the team members enrich the design ideas and decisions, and the involvement of all team members is needed to achieve a user interface for a system that carefully considers all aspects, ranging from user needs to technical requirements. The difficulty is getting all team members involved in the early stages of design and communicating design ideas and decisions in a way that all team members can understand them and use them in an appropriate way in later stages of the process. This chapter describes the COMuICSer storyboarding technique, which presents the scenario of use of a future system in a way that is understandable for each team member, regardless of their background. Based on an observational study in which multidisciplinary teams collaboratively created storyboards during a co-located session, we present recommendations for the facilitation of co-located collaborative storyboarding sessions for multidisciplinary teams and digital tool support for this type of group work.