Search

Ambient intelligence represents a paradigm in which the user does not react to the environment, but vice versa. Accordingly, smart environments can react to the presence and activities of users and support them unobtrusively from the background. Especially in the context of accessibility, this offers great potential that has so far only been demonstrated for individual user groups. To overcome this limitation, we propose the automated, user- and context-related adaptation of the modality as well as locality of the representation of building information in the form of both an adjustable table as well as two displays on the basis of a prototype for a library information center. For being independent from material and regulatory restrictions and for better planability (especially with the ongoing COVID-19 pandemic) we used in addition to the hardware components also a Virtual Reality simulation, which proved to be very useful. Further optimization and evaluation will be needed for a more in depth understanding and dissemination in the long run, yet our prototype aims to help fostering further activities in the field of ambient intelligence, accessibility and virtual reality as a planning tool.

Virtual Reality (VR) is attracting more and more attention from academic research and practical application with the current availability of low-cost and end-user friendly devices. In terms of haptic (rather than visual) interaction, however, this technology is still in its infancy and there are few devices that are inexpensive and technologically simple to operate, respectively to procure. In this context, we present a concept of how haptic interaction with VR data gloves can also succeed by means of a commercially available web cam, sophisticated tracking software, and homemade low-cost hardware. All hardware and software components are to be obtained inexpensively or are open-source in order to achieve the greatest possible dissemination potential. With this work, we intend to provide an important trigger for future improvements and dissemination in terms of both technology and areas of application.

Virtual Reality (VR) promises expanded access to spatial information, especially for blind and visually impaired people. Through haptic and acoustic feedback, real world's limitations like the risk of injury or the necessity of a sighted safety assistant can be circumvented. However, the best possible profit of this technology requires interactive locomotion in large virtual environments to overcome real world space limitations. Thus, we present formative insights of blind people's egocentric VR locomotion by comparing four different implementations (i.e., two VR treadmills, trackers on the ankles or joystick based locomotion) in a qualitative and quantitative user study with seven blind and visually impaired participants. Our results reveal novel insights on characteristics of each implementation in terms of usability and practicability and also provide recommendations for further work in this field with the target user group in sight.

When thinking of Virtual Reality (VR), most people think of stunning audio-visual environments in the context of entertainment. However, VR can also provide haptic information, e.g., to convey spatial information to blind and visually impaired people. In this context of accessibility they might be able to explore independently and self-determined tactile graphics, e.g., the structure of unknown real places prior to visiting them. Thus, we propose and evaluate tabletop virtual objects that can be felt by nowadays commercially available VR components, instead of exploring physical models (e.g., 3D printed maps) with the bare hand. These can be easily placed on an empty table, giving the blind user faster and more independent access to tactile information than with real physical representations. Our comprehensive pilot user study shows that it is possible to recognize floor plans and simple geometric shapes in this context. Also, the insights gained with regard to the suitability for practical application in this context point out the way to eased access to spatial (virtual) information using off-the-shelf components which can significantly support blind and visually impaired users' autonomy.

3D models are an important means for understanding spatial contexts. Today these models can be materialized by 3D printing, which is increasingly used at schools for people with visual impairments. In contrast to sighted people, people with visual impairments have so far, however, neither been able to search nor to print 3D models without assistance. This article describes our work to develop an aid for people with visual impairments that would facilitate autonomous searching for and printing of 3D models. In our initial study, we determined the requirements to accomplish this task by means of a questionnaire and developed a first approach that allowed personal computer-based 3D printing. An extended approach allowed searching and printing using common smartphones. In our architecture, technical details of 3D printers are abstracted by a separate component that can be accessed via Wi-Fi independently of the actual 3D printer used. It comprises a search of the models in an annotated database and 3D model retrieval from the internet. The whole process can be controlled by voice interaction. The feasibility of autonomous 3D printing for people with visual impairments is shown with a first user study. Our second user study examines the usability of the user interface when searching for 3D models on the internet and preparing them for the materialization. The participants were able to define important printing settings, whereas other printing parameters could be determined algorithmically.

Tactile graphics play an essential role in knowledge transfer for blind people. The tactile exploration of these graphics is often challenging because of the cognitive load caused by physiological constraints and their complexity. The coupling of physical tactile graphics with electronic devices offers to support the tactile exploration by auditory feedback. Often, these systems have strict constraints regarding their mobility or the process of coupling both components. Additionally, visually impaired people cannot appropriately benefit from their residual vision. This article presents a concept for 3D printed tactile graphics, which offers to use audio-tactile graphics with usual smartphones or tablet-computers. By using capacitive markers, the coupling of the tactile graphics with the mobile device is simplified. These tactile graphics integrating these markers can be printed in one turn by off-the-shelf 3D printers without any post-processing and allows us to use multiple elevation levels for graphical elements. Based on the developed generic concept on visually augmented audio-tactile graphics, we presented a case study for maps. A prototypical implementation was tested by a user study with visually impaired people. All the participants were able to interact with the 3D printed tactile maps using a standard tablet computer. To study the effect of visual augmentation of graphical elements, we conducted another comprehensive user study. We tested multiple types of graphics and obtained evidence that visual augmentation may offer clear advantages for the exploration of tactile graphics. Even participants with a minor residual vision could solve the tasks with visual augmentation more quickly and accurately.

Electronic markers can be used to link physical representations and virtual content for tangible interaction, such as visual markers commonly used for tabletops. Another possibility is to leverage capacitive touch inputs of smartphones, tablets and notebooks. However, existing approaches either do not couple physical and virtual representations or require significant post-processing. This paper presents and evaluates a novel approach using a coding scheme for the automatic identification of tangibles by touch inputs when they are touched and shifted. The codes can be generated automatically and integrated into a great variety of existing 3D models from the internet. The resulting models can then be printed completely in one cycle by off-the-shelf 3D printers; post processing is not needed. Besides the identification, the object's position and orientation can be tracked by touch devices. Our evaluation examined multiple variables and showed that the CapCodes can be integrated into existing 3D models and the approach could also be applied to untouched use for larger tangibles.

Haptic feedback may support immersion and presence in virtual reality (VR) environments. The emerging market of consumer devices offers first devices which are expected to increase the degree of feeling being actually present in a virtual environment. In this paper we introduce a novel evaluation that examines the influence of different types of haptic feedback on presence and performance regarding manual tasks in VR. Therefore, we conducted a comprehensive user study involving 14 subjects, who performed throwing, stacking and object identification tasks in VR with visual (i.e., sensory substitution), vibrotactile or force feedback. We measured the degree of presence and task-related performance metrics. Our results indicate that regarding presence vibrotactile feedback outperforms haptic feedback which performs better than visual feedback only. In addition, force feedback significantly lowered the execution time for the throwing and the stacking task. In object identification tasks, the vibrotactile feedback increased the detection rates compared to the vibrotactile and force feedback, but also increased the required time of identification. Despite the inadequacies of the still young consumer technology, there were nevertheless strong indications of connections between presence, task fulfillment and the type of haptic feedback.

The interest in virtual and augmented reality increased rapidly in the last years. Recently, haptic interaction and its applications get into focus. In this paper, we suggest the exploration of virtual objects using off-the-shelf VR game controllers. These are held like a pen with both hands and were used to palpate and identify the virtual object. Our study largely coincides with comparable previous work and shows that a ready-to-use VR system can be basically used for haptic exploration. The results indicate that virtual objects are more effectively recognized with closed eyes than with open eyes. In both cases, objects with a bigger morphological difference were identified the most frequently. The limitations due to quality and quantity of tactile feedback should be tackled in future studies that utilize currently developed wearable haptic devices and haptic rendering involving all fingers or even both hands. Thus, objects could be identifiable more intuitively and haptic feedback devices for interacting with virtual objects will be further disseminated.

This paper presents the first results on a user study in which people with visual impairments (PVI) explored a virtual environment (VE) by walking in a virtual reality (VR) treadmill. As recently suggested, we have now acquired first results from our feasibility study investigating this walk-in-place interaction. This represents a new, more intuitive way of for example virtually exploring unknown spaces in advance. Our prototype consists of off-the-shelf VR components (i.e., treadmill, headphones, glasses, and controller) providing a simplified white cane simulation and was tested by six visually impaired subjects. Our results indicate that this interaction is yet difficult, but promising and an important step to make VR more and better usable for PVIs. As an impact on the CHI community, we would like to make this research field known to a wider audience by sharing our intermediate results and suggestions for improvements, on some of which we are already working on.

Although most readers associate the term virtual reality (VR) with visually appealing entertainment content, this technology also promises to be helpful to disadvantaged people like blind or visually impaired people. While overcoming physical objects’ and spaces’ limitations, virtual objects and environments that can be spatially explored have a particular benefit. To give readers a complete, clear and concise overview of current and past publications on touchable and walkable audio supplemented VR applications for blind and visually impaired users, this survey paper presents a high-level taxonomy to cluster the work done up to now from the perspective of technology, interaction and application. In this respect, we introduced a classification into small-, medium- and large-scale virtual environments to cluster and characterize related work. Our comprehensive table shows that especially grounded force feedback devices for haptic feedback (‘small scale’) were strongly researched in different applications scenarios and mainly from an exocentric perspective, but there are also increasingly physically (‘medium scale’) or avatar-walkable (‘large scale’) egocentric audio-haptic virtual environments. In this respect, novel and widespread interfaces such as smartphones or nowadays consumer grade VR components represent a promising potential for further improvements. Our survey paper provides a database on related work to foster the creation process of new ideas and approaches for both technical and methodological aspects.

With Tangible User Interfaces, the computer user is able to interact in a fundamentally different and more intuitive way than with usual 2D displays. By grasping real physical objects, information can also be conveyed haptically, i.e., the user not only sees information on a 2D display, but can also grasp physical representations. To recognize such objects (“tangibles”) it is skillful to use capacitive sensing, as it happens in most touch screens. Thus, real objects can be located and identified by the touch screen display automatically. Recent work already addressed such capacitive markers, but focused on their coding scheme and automated fabrication by 3D printing. This paper goes beyond the fabrication by 3D printers and, for the first time, applies the concept of capacitive codes to laser cutting and another immediate prototyping approach using modeling clay. Beside the evaluation of additional properties, we adapt recent research results regarding the optimized detection of tangible objects on capacitive screens. As a result of our comprehensive study, the detection performance is affected by the type of capacitive signal processing (respectively the device) and the geometry of the marker. 3D printing revealed to be the most reliable technique, though laser cutting and immediate prototyping of markers showed promising results. Based on our findings, we discuss individual strengths of each capacitive marker type.

Virtual reality is currently experiencing a comeback. A considerable market has developed for VR computer games and educational applications. Some solutions integrate tracked devices which allow users to freely move within a certain space. Virtual 3D model can be visually explored, implemented collision detected allows users to get a feedback for instance by sound or vibration. For research projects there are several approaches which offer to get the actual feedback for the fingers of a hand, when the users virtually touches the surface of a 3D model. However, in the consumer market currently no product is sold which offers this direct feedback for the whole hand. In this paper we introduce a low-cost hand exoskeleton which is usable in conjunction with commodity hardware. It covers each of the five fingers of the user's hand, its design is open-source, low-cost, can be customized and 3D printed by individuals. It aims at improving the haptic perception of users, bases of a popular physical computing platform and is designed to be assembled even by electronically unexperienced users. We show the integration of our lean interface of the wireless exoskeleton into exemplary VR environment and describe a calibration process which is flexible for customizations.

Despite increasing digitalization of our society many blind persons still have very limited access to predominantly pictorial information such as maps. In this paper we introduce a novel approach to improve the accessibility of maps for blind users by utilizing the abilities of standard smartphones. A major issue of tactile maps is the limited discriminability of the humans' tactile sense. Textual annotation of maps is crucial, but adds much complexity to tactile maps. Additionally, only few Braille labels can be accommodated to maintain legibility. In our approach we link smartphones with adapted tactile maps which transforms the physical maps into interactive surfaces using both the tactile and the auditory modality. We integrate machine readable metadata into these maps which can be recognized by the smartphones' camera to immediately obtain detailed map descriptions from a free global database. During tactile exploration of the map, blind users can request auditory explanations by interacting with the mobile application. An experimental application and a user study demonstrate the feasibility of our approach.

Towards Non-Photorealistic Rendering in Car Navigation Since in the year 2000 the Global Positioning System (GPS) gained more accuracy, the market for car navigation systems grew constantly. Nowadays, these driver assistances are available in many different variants, such as build-in car navigation systems, mobile navigation devices or just as application for smart phones. In the last decade, the visual complexity of driving instructions for navigation applications has grown in a fast pace.

In the past years car navigation systems have significantly developed. Beside many important features to support drivers the advanced graphics is the most visible part. After starting with simple arrows and numbers, maps were displayed in order to provide hints for the spatial orientation of the driver. Later on, those maps were rendered perspectively in bird's eye view and finally 3D data was integrated to generate more realistic views using city models and terrain models. However, one drawback of these 3D navigation systems is the use of monoscopic displays. Using these displays, the only way to mediate spatial depth has been to facilitate monoscopic depth cues. Whereas for desktop computers stereoscopic displays are used in order to allow a better depiction of 3D scenes, they were not used for mobile navigation systems yet. Since this application field has specific characteristics and requirements, this paper addresses the challenges and perspectives for the use of (auto—) stereoscopic displays in prospective car navigation systems.

Small mobile devices such as smartwatches are a rapidly growing market. However, they share the issue of limited input and output space which could impede the success of these devices in future. Hence, suitable alternatives to the concepts and metaphors known from smartphones have to be found. In this paper we present InclineType a tilt-based keyboard input that uses a 3-axis accelerometer for smartwatches. The user may directly select letters by moving his/her wrist and enters them by tapping on the touchscreen. Thanks to the distribution of the letters on the edges of the screen, the keyboard dedicates a low amount of space in the smartwatch. In order to optimize the user input our concept proposes multiple techniques to stabilize the user interaction. Finally, a user study shows that users get familiar with this technique with almost no previous training, reaching speeds of about 6 wpm in average.

Object: This paper presents a 3D framework for Anatomy teaching. We are mainly concerned with the proper understanding of human anatomical 3D structures. Materials and methods: The main idea of our approach is taking an electronic book such as Henry Gray’s Anatomy of the human body, and a set of 3D models properly labeled, and constructing the correct linking that allows users to perform mutual searches between both media. Results: We implemented a system where learners can interactively explore textual descriptions and 3D visualizations. Conclusion: Our approach allows easily performing two search tasks: first, the user may select a text region and get a view showing the objects that contain the selected structures, and second, using the interactive exploration of a 3D model the user may automatically search for the textual description of the structures visible in the current view.