Search

This paper describes a special type of drone called "Flying User Interface", comprised of a robotic projector-camera system, an onboard digital computer connected with the Internet, sensors, and a hardware interface capable of sticking to any surface such as wall, ceilings, etc. Computer further consists of other subsystems, devices, and sensors such as accelerometer, compass, gyroscope, flashlight, etc. Drone flies from one place to another, detects a surface, and attaches itself to it. After a successful attachment, the device stops all its rotators; it then projects or augments images, information, and user interfaces on nearby surfaces and walls. User interface may contain applications, information about object being augmented and information from Internet. User can interact with user-interface using commands and gestures such as hand, body, feet, voice, etc.

We propose a user interface that superimposes a virtual touch panel on a flat surface using an optical see-through head-mounted display and an RGB-D camera. The user can use the interface in a hands-free state, and can perform the operation with both hands. The interface performs markerless superimposition of virtual objects on a real scene. In addition, the interface can recognize three-dimensional information of the user's fingers, allowing the user to operate with the virtual touch panel. We developed some applications in which the user can perform various operations on the virtual touch panel.

Human-machine interaction requires the proposal of new systems, which can be adapted to the needs of the user at any time. This paper proposes the use of natural user interface as an alternative to the traditional contact-based Graphical User Interface. This new interface does not require touching the surface of the device, and thus provides touch-free management of applications in mobile devices. This paper will show the simplicity and efficacy of a natural user interface, in comparison to a Graphical User Interface alternative.

This paper presents an experimental system to support a two-step User-Interface (UI) design method. The semantic user interface may be useful for research and student training of issues related to the user interface by focusing on some cognitive ergonomic aspects of UI usage.

With the enormous growth in the amount of information and functionality available, it is increasingly important that the desired information and functions can be easily found and made use of through user interface. To enable users to easily find and use the desired information and functions, both user interface content (logical structure) and user interface appearance (physical structure) need to be easily comprehensible for the user. We have addressed this need by developing a system to support user interface designers following a dual approach, that is logical structure design support based on objective and quantitative analysis of languages used by users themselves, and physical structure design support that takes the stages in the design process into account. The proposed system will make it easier for designers to design user interface using the language of users, as well as user interface that reflects their own creativity.

User interface design and coding can be complex and messy. We describe a system that uses code search to simplify and automate the generation of such code. We start with a simple sketch of the desired interface along with a set of keywords describing the application context. We then use existing code search engines to find results based on the keywords. We look for potential Java-based user interface solutions within those results and apply a series of code transformations to the solutions to generate derivative solutions, aiming to get solutions that constitute only the user interface and that will compile and run. We run the resultant solutions and compare the generated interfaces to the user's sketches. Finally, we let programmers interact with the matched solutions and return the running code for the solutions they choose. The system can be used not only for generating initial user interface code for an application, but also for exploring alternative interfaces and for looking at the user interfaces in a code repository.

The distribution of user interfaces is a reality. To represent this reality this paper presents a metamodel to characterize user interface distribution capabilities and states. This metamodel allows analyzers/designers to manipulate user interface distribution models by the means of two model editors in order to calculate their capabilities and states. Based on these characteristics, five cases of study are analyzed and as result of this analysis, we redefine the distributed user interface concept as a user interface state, and define the distributable user interface concept as a user interface capability. Finally, we present the Proxywork system to illustrate the distributable user interface concept.

The design of a 3D space in 3D user interfaces has an impact on the user experience. This paper presents a small user experience study of service applications on a 3D user interface with different 3D background contexts. The aim is to investigate the impact on user expectations for activity, service (3D object) population and relationship between the objects and space. Our studies show that people make a strong determination of what occurs in a 3D space based on the visual appearance. Users interpret the functionality of the space (room), degree of privacy implied by the space and how the space should be populated with applications.

Some individuals have difficulty using standard hand-manipulated computer input devices such as a mouse and a keyboard effectively. However, if these users have sufficient control over their face and head movement, a robust face tracking user interface can bring significant usability benefits. Using consumer-grade computer vision devices and signal processing techniques, a robust user interface can be made readily available at low cost, and can provide a number of benefits, including non-intrusive usage. Designing and implementing this type of user interface presents many challenges particularly with regards to accuracy and usability.Continuing previously published research, we now present results based on an analysis and comparison of different options for face tracking user interfaces. Five different options are evaluated each with different architectural stages of a face tracking user interface -- namely user input, capture technology, feature retrieval, feature processing, and pointer behavior. Usability factors were also included in the evaluation. A prototype system, configured to use different options, was created and compared with existing similar solutions. Tests were designed that ran on an Internet browser and a quantitative evaluation was done. The results show which of the evaluated options performed better than the others and how the best performing prototype compares to currently available solutions. These findings can serve as a precursor to a full-scale usability study, various improvements, and future deployment for public use.

This workshop seeks to help increase the volume and quality of HCI research and innovative practice around user interfaces for television. Internet connectivity is driving a rapid increase in the range and scope of interactive experiences on the TV platform and it represents an exciting new opportunity for developing new HCI practice and methodology, as well as innovative forms of user experience.

Command Line Interface (CLI) is the most popular and basic user interface to interact with computers. Despite its simplicity, it has some limitations in terms of user experience. For example, sometimes it is hard to understand and interpret the textual output of the command. In this paper we describe the limitations of command line interfaces and propose Gracoli1: A graphical command line interface that takes advantage of both text-based interface and graphical user interface to provide better user experience and perform complex tasks. We demonstrate some of the useful applications and features of Gracoli. Sometime such a hybrid system provides and combines the strengths of CLI and GUI to perform specific tasks. We explore some useful applications of Gracoli to create a new kind of user experience. Command line interface makes accessibility faster and Graphical User-Interface makes output more interactive and understandable.

One form of natural user interaction with a personal computer is based on natural face movements. This is especially helpful for users who cannot effectively use common input devices with their hands but have sufficient control of their heads. Using vision-based consumer devices makes such a user interface readily available and allows its use to be non-intrusive. This user interface presents some significant challenges particularly with accuracy and design. This research aims to investigate such problems and discover solutions to creating a usable and robust face tracking user interface using currently available technology. Design requirements were set and different design options were implemented and evaluated.

As user interfaces are becoming more ubiquitous and abundant, users may feel perplexed by the pure number of user interfaces surrounding them. In order to increase user acceptance, ubiquitous user interfaces should be designed to be as calm and nonintrusive as possible. This paper presents the design and evaluation of a calm user interface prototype, Living Wood. Living Wood is a touch sensitive graphical user interface for smart home applications, and designed to fade into the background and hide itself when it is not used. A prototype for lighting control was built and installed in a smart home laboratory. To investigate how the self-hiding nature of the panel, its aesthetic features and usability was experienced by users, we tested Living Wood with 11 users.

Paper prototyping is commonly used to identify usability problems in the early stages of user interface design, but it is not very well suited for the evaluation of mobile interfaces. The reason is that mobile applications are used in a rich real-world context, which is hard to emulate with a paper prototype. A more powerful technique is to test the design on a mobile device, but building a functional design prototype requires much more effort. In this paper, we try to get the best of both worlds by building interactive prototypes with a digital pen. We developed a system which allows for sketching a user interface on paper and manually associating the interface elements with functionality. This enables designers to bring their design ideas to paper without any restrictions, define the meaning of selected interface elements, and test them on a mobile device instantaneously. We conducted a user study in which the participants had to design and test a small application with our system. The results provide evidence for the feasibility and positive aspects of our approach, but also showed some limitations and missing functionalities of its current implementation.

An abstract user interface is defined according the Cameleon Reference Framework as a user interface supporting an interactive task abstracted from its implementation, independently of any target computing platform and interaction modality. While an abstract user interface could be specified in isolation, it could also be produced from various models such as a task model, a domain model, or a combination of both, possibly based on information describing the context of use (i.e., the user, the platform, and the environment). This paper presents a general-purpose algorithm that systematically generates all potential abstract user interfaces from a task model as candidates that could then be refined in two ways: removing irrelevant candidates based on constraints imposed by the temporal operators and grouping or ungrouping candidates according to constraints imposed by the context of use. A model-driven engineering environment has been developed that applies this general-purpose algorithm with multiple levels of refinement ranging from no contextual consideration to full-context consideration. This algorithm is exemplified on a some sample interactive application to be executed in various contexts of use, such as different categories of users using different platforms for the same task.

In this demo paper, we describe our user-generated video search system, compromising of an iPad interface communicating with a remote server. The goal of this system is to provide an easy access to video content lacking textual annotations by clustering key frames. Moreover, the graphical user interface allows users to filter video content based on various semantic concepts.

Sketching is viewed as an efficient way to design the user interface. However, there are few tools that help designers go from sketching the user interface to simulating its behavior with endusers during early evaluation. We have developed a pen-based tool called UISKEI, which goes beyond allowing designers to define simple navigation between user interface snapshots, into allowing them to define more complex interactive behavior with conditional changes in the state of the user interface. We have conducted two studies on how UISKEI compares to similar prototyping techniques: paper and pencil; widget-based (Balsamiq) and other sketch-based user interface prototyping tools (DENIM and SketchiXML). The studies revealed that UISKEI's sketch-based definition of the user interface behavior for later simulation is better than the analogous mechanisms provided by the other tools.

This SIG brings together practitioners and academic user researchers and designers who are interested in or working on defining both the software and hardware aspects of the user experience for TV. This SIG will be useful to people at all stages ranging from early research to released products. We especially welcome people from product labs.

Natural User Interfaces are often described as familiar, evocative and intuitive, predictable, based on common skills. Though un-questionable in principle, such definitions don't provide the de-signer with effective means to design a natural interface or evalu-ate a design choice vs another. Two main issues in particular are open: (i) how do we evaluate a natural interface, is there a way to measure 'naturalness'; (ii) do natural user interfaces provide a concrete advantage in terms of efficiency, with respect to more tradi-tional interface paradigms? In this paper we discuss and compare observations of user behavior in the task of pair programming, performed at a traditional desktop versus a multi-touch table. We show how the adoption of a multi-touch user interface fosters a significant, observable and measurable, increase of nonverbal communication in general and of gestures in particular, that in turn appears related to the overall performance of the users in the task of algorithm understanding and debugging.

Ambient Assisted Living environments provide support to people with disabilities and elderly people, usually at home. This concept can be extended to public spaces, where ubiquitous accessible services allow people with disabilities to access intelligent machines such as information kiosks. One of the key issues in achieving full accessibility is the instantaneous generation of an adapted accessible interface suited to the specific user that requests the service. In this paper we present the method used by the EGOKI interface generator to select the most suitable interaction resources and modalities for each user in the automatic creation of the interface. The validation of the interfaces generated for four different types of users is presented and discussed.

We present a mobile user interface which dynamically reformulates the layout based on the touch input pattern of users. By analyzing the touch input, it infers users' physical characteristics such as handedness, finger length, or usage habits, thereby calculates the optimal touch area for the user. The user interface is gradually adapted to each user by automatically rearranging graphic objects such as application icons to the most easy-to-touch positions. To compute the optimal touch area, we designed software architecture and implemented an Android application which analyzes touch input and determines the touch frequency in specific screen areas, the handedness and hand size of users. As proof of concept, this research prototype shows acceptable performance and accuracy. To decide which items should be placed in the optimal touch area, we plan to integrate our machine learning algorithm which prioritizes applications according to the context of users into the proposed system.

In this paper we evaluate the possibilities of autostereo-scopic three-dimensional displays in aiding the user in a selection task on a mobile touch-screen user interface. We describe a user study which measures the effectiveness of realistic depth illusion as an emphasizing method in a conventional mobile user interface concept. In our experiment, 35 people completed simple thumbnail visual search tasks, where horizontal disparity, color shading, and their combination were used as the emphasizing method. The results indicate that using disparity alone as a visual indicator does not provide enough support in find-and-select tasks to improve the user performance or perceived comfort with the task. However, when combined with other visual cues, disparity can significantly improve performance and satisfaction.

Historically, real-time strategy video games, such as Star-craft (1999) and Command and Conquer (1995), were intended to be played on desktop or laptop computers, with interfaces that afford the user dozens of keys and key combinations, mouse gestures including clicking and dragging, and several mouse buttons to further complicate the interface while allowing customization and a wide range of possibilities to the user. On a mobile multi-touch platform, there are constraints of limited visual real estate, which is actually shared with the touch command interface. Though work has been done to port real-time strategy games to the mobile platform, to date, there has not been a significant effort to enhance the usability of these interfaces by removing redundancies and tailoring the game commands to these multi-touch devices.The touch interface presents unique challenges as there are touches and gestures rather than buttons and key combinations. In this paper, we present a rapidly-prototyped user-centered design in a ten-week project of a real-time strategy user interface native for the iPad. As the user's experience is key in creating a robust and intuitive interface, we incorporate the user's feedback in several stages of the design and prototyping of the project. We show changes to the design of the user interface over several iterations and, finally, show a prototype of the user interface system using a game of our own design as a test platform. The contributions of this project are the interface designed for a new mode of interaction (i.e., the iPad platform), the bubble menu, and the ability to cancel orders.

We introduce a research framework which enables to use the OpenOffice.org as a platform for HCI research, particularly for performing user studies or prototyping and evaluating intelligent user interfaces. We make two contributions: (1) we introduce an innovative hybrid logging technique which provides high-level, rich and accurate information about issued user commands, command parameters and used interaction styles. Our logging technique also avoids an unwanted requirement for further complex processing of logged user interface events to infer user commands, which must be performed on most loggers these days. (2) Our logging tool acts as a component object in OpenOffice.org with an easy-to-use Application Program Interface (API) which enables, along with deep OpenOffice.org programmability, to use OpenOffice.org as a research framework for developing and evaluating intelligent user interfaces.

The paper presents a novel user interface combining bare hands and the line of sight (LoS) by using a depth camera from far distance without any handheld devices; as well as a 3D GUI providing both stereoscopy and motion parallax for smart displays. The proposed user interface provides a precise and convenient manipulation which is applicable to browsing thousands of channels andor media files. Especially, the combined interaction methods of the two modalities achieve 120(x) × 70(y) × 5(z) manipulation resolution. And then various user tasks were performed so as to assess the proposed user interface.

Home Automation System connects the digital technology and computers to the appliances at home and manages it. It's the frequency of use an position in the home that makes it important to have an aesthetic friendly user interface. There are numerous UI design cases of Display panel or the buttons. However, the usability or aesthetic sensibility design through using a variety of multi-layered emotional satisfaction of feeling that provides the interface design needs to be studied. This study explores the ways to satisfy the emotional needs of Home Automation System and Tangible User Interface (TUI).

The availability of numerous networked interaction devices within smart environments makes the exploitation of these devices for innovative and more natural interaction possible. In our work we make use of TVs with remote controls, picture frames, mobile phones, touch screens, stereos and PCs to create multimodal user interfaces. The combination of the interaction capabilities of the different devices allows to achieve a more suitable interaction for a situation. Changing situations can then require the dynamic redistribution of the created interfaces and the alteration of the used modalities and devices to keep up the interaction. In this paper we describe our approach for dynamically (re-) distributing user interfaces at run-time. A distribution component is responsible for determining the devices for the interaction based on the (changing) environment situation and the user interface requirements. The component provides possibilities to the application developer and to the user to influence the distribution according to their needs. A user interface model describes the interaction and the modality relations according to the CARE properties (Complementarity, Assignment, Redundancy and Equivalency) and a context model gathers and provides information about the environment.

HandsDown is a novel technique for user identification on interactive surfaces. It enables users to access personal data on a shared surface, to associate objects with their identity, and to fluidly customize appearance, content, or functionality of the user interface. To identify, users put down their hand flat on the surface. HandsDown is based on hand contour analysis; neither user instrumentation nor external devices are required for identification. Characteristic features of the hand are initially extracted from images captured by the surface's camera system and then classified using Support Vector Machines (SVM).We present a proof-of-concept implementation and show results of our evaluation which indicates the technique's robustness for user identification within small groups. Additionally, we introduce a set of interaction techniques to illustrate how HandsDown can improve the user experience, and we discuss the design space of such interactions.

User interface design by sketching, as well as other sketching activities, typically involves sketching objects through representations that should combine meaningfulness for the end users and easiness for the recognition engines. To investigate this relationship, a multi-platform user interface design tool has been developed that enables designers to sketch design ideas in multiple levels of fidelity with multi-stroke gestures supporting widget representations and commands. A usability analysis of these activities, as they are submitted to a recognition engine, suggests that the level of fidelity, the amount of constraints imposed on the representations, and the visual difference of representations positively impact the sketching activity as a whole. Implications for further sketch representations in user interface design and beyond are provided based on usability guidelines.

Based on extensive research on users' needs, three simplistic interaction concepts for interactive TV are proposed, developing physical and graphical interface together. This paper describes the development of a user interface by comparing three interface designs, which aim to simplify the interaction and minimize the number of keys on a remote control. With the goal to improve the usability of the interaction concept for various kinds of iTV services, the user interface design concept with a six key remote control has shown to be the best solution in terms of usability and ease of learning, compared to navigation systems using less keys. The concept also shows its advantage in allowing cross-media usage of the navigation concept even on PCs and mobile devices.

We present the design of Make a Riddle and TeleStory, educational applications developed on the Siftables platform for children aged 4-7 years. Siftables are hybrid tangible-graphical user interface devices with motion and neighbor sensing, graphical display, and wireless communication. Siftables provide a unique opportunity to give children responsive feedback about the movement and arrangement of a distributed set of objects. We contrast the use case that includes an external display to their use as a standalone application platform. We outline design strategies for communicating information about the affordances of the Siftables and methods of providing dynamic feedback to encourage manipulation and to increase engagement during application use for hybrid tangible-graphical user interfaces.

The primary goal of the work in this paper is to present a novel visual user interface design that can be used by even novice users without much effort. The design of the user interface needs to ensure that the users require short learning curve. A compact WHEEL structure was chosen as it not only requires less screen space, but also, enables users to view and explore the data of large datasets (having many relationships) with minimal clicks and scrolling. The paper describes the design choices, design process, the final design and the results from the user tests which were conducted to evaluate the usability and utility of the interface.

In this paper we present our newly developed graphical user interface xM that allows us to interface, observe and control Sensor and PDA networks. We introduce the design concepts and ideas behind xM. In particular, we detail solutions to two important issues that arise when debugging and experimenting with our ad-hoc routing protocols: handling different hardware and managing device output. xM is designed to support the developer and researcher in optimizing and speeding up common and often repetitive tasks. The goal of our user interface is to present features, like different network and failure scenarios, offered by our backend implementation in a clear and simple way.

Creating a new model of human computer interaction is not straightforward. Only a handful of such models have been commercially successful. Those that have, such as the graphical user interface (GUI), can provide valuable lessons. When we were challenged to develop a new natural user interface design for Microsoft Surface, we drew from these lessons and from modern user research techniques. A prominent starting point resulting from this was using metaphors to develop the new user interface. We used metaphors for two reasons: To create a user interface world that was understandable and predictable for our users, and to guide the design team in creating the detailed user interface design. We continued this practice in the user research: We focused on which metaphors worked best in the studies, and learned if users understood the metaphors we were using and which metaphor they preferred. This case study describes the process we followed, and the lessons we learned from this.

In this paper, we describe an intelligent graphical user interface (IGUI) and a User Application Interface (UAI) tailored to Brain Computer Interface (BCI) interaction, designed for people with severe communication needs. The IGUI has three components; a two way interface for communication with BCI2000 concerning user events and event handling; an interface to user applications concerning the passing of user commands and associated device identifiers, and the receiving of notification of device status; and an interface to an extensible mark-up language (xml) file containing menu content definitions. The interface has achieved control of domotic applications. The architecture however permits control of more complex 'smart' environments and could be extended further for entertainment by interacting with media devices. Using components of the electroencephalogram (EEG) to mediate expression is also technically possible, but is much more speculative, and without proven efficacy. The IGUI-BCI approach described could potentially find wider use in the augmentation of the general population, to provide alternative computer interaction, an additional control channel and experimental leisure activities.

The development of user interface technologies for elderly people with memory problems is a difficult task. This paper proposes a wearable projection based communication system and communication language based on path based structured user interface. The path based user interface is based on Augmentive and Alternative communication systems which focus on picture communication. A conceptualized view of this communication channel is modeled on an abstract level using User Interface Description Language which will provide the best support for various different wearable solutions. The Projection interface consists of a camera, projector and acceleration sensor which detects the users input operation by tap operations.

One of the traditional way of performing surveillance is physical monitoring by the security personnel. We envision a sensory media system that can be used on a mobile device carried by the security personnel while patrolling the public areas. The realization of such a system raises many research issues including user interface design, which we essentially focus on in this paper. Due to the limited display space, designing a Graphical User Interface (GUI) for these kind of portable devices is challenging. We present a user friendly interface which consists of different views that help the security personnel in controlling sensory devices such as surveillance cameras, seeing the region layouts, selecting the images of a suspected person and extracting more details about him/her. The usability study shows that the proposed GUI is easy to use and effective in performing physical monitoring.

Due to the large amount of mobile devices that continue to appear on the consumer market, mobile user interface design becomes increasingly important. The major issue with many existing mobile user interface design approaches is the time and effort that is needed to deploy a user interface design to the target device. In order to address this issue, we propose the plug-and-design tool that relies on a continuous multi-device mouse pointer to design user interfaces directly on the mobile target device. This will shorten iteration time since designers can continuously test and validate each design action they take. Using our approach, designers can empirically learn the specialities of a target device which will help them while creating user interfaces for devices they are not familiar with.

Single-user, desktop-based computer applications are pervasive in our daily lives and work. The prospect of using these applications with innovative interaction systems, like multi-touch tabletops, tangible user interfaces, large displays or public/private displays, would enable large scale field studies of these technologies, and has the potential to significantly improve their usefulness and, in turn, their availability. This paper focuses on the architectural requirements, design, and implementation of such a technology. First, we review various software technologies for using a single-user desktop application with a different model of user inputs and graphical output. We then present a generic technique for using any closed-source or open-source application with different input and output devices. In our approach, the application is separated from the user input and graphical output subsystem. The core part of the application runs in a system-specific virtual environment. This virtual environment exposes the same API as the removed standard subsystems. This eliminates the need to rewrite the "legacy" application and provides high performances by using the application native way to communicate with the system.

Today, mobile phones are no longer devices supporting only voice communications. Many people use their mobile phones as multimedia players, cameras, messaging systems, etc. Therefore, it is required to design a user interface that improves the usability of multi-functional mobile phones. For this purpose, we proposed a novel user interface that utilizes touch sensing technology to support multi-functional devices. The proposed user interface is based on the assumption that the device can detect how a user holds the device. By analyzing the user's grip-pattern, the device recognizes the user's intention and adjusts itself to meet the specific needs of the user such as accessing an application. The concept of the user interface is presented through several use-case scenarios. In addition, the technical feasibility of the proposed interface is validated by implementing a working prototype system.

Natural user interfaces (NUI) such as multitouch and surface computing are positioned as the next major evolution in computing and user interfaces. Just graphical user interfaces (GUIs) brought unprecedented interaction capabilities to their command-line predecessors, we believe multitouch and surface computing will spawn novel ways to interact with media and improve social usage patterns. Since experimentation and deployment are currently limited, the exploration of applications and interfaces in this area is still at an early stage.

Graphical user interfaces (GUIs) make software easy to use by providing the user with visual controls. Therefore, correctness of GUI's code is essential to the correct execution of the overall software. Models can help in the evaluation of interactive applications by allowing designers to concentrate on its more important aspects.This paper presents a generic model for language-independent reverse engineering of graphical user interface based applications, and we explore the integration of model-based testing techniques in our approach, thus allowing us to perform fault detection.A prototype tool has been constructed, which is already capable of deriving and testing a user interface behavioral model of applications written in Java/Swing.

This paper describes TinkerSheets, a paper-based interface to tangible simulations. The proposed interface combines the advantages of form-based input and paper. Form-based input allows to set an arbitrary number of parameters. Using paper as a medium for the interface keeps the interaction modality consistently physical. TinkerSheets are also used as an output screen to display summarized information about the simulation. A user study conducted in an authentic context shows how the characteristics of the interface shape real world usage. We also describe how the affordances of this control and visualization interface support the co-design of interaction with end-users.

Even though over the years a multitude of user interface design tools have been created, designers in practice find themselves limited to a small set of realistic options. These options include interface builders that are attached to development environments, or general-purpose tools such as Microsoft Visio. We claim that the inability of many user interface tools to find their way into a designer's toolbox is due in great part to their failure to support the process of designing a user interface. In this paper, we introduce UI Fin, a user interface design tool that: (a) fits within and supports a common process for user interface design, (b) enables user-centered, as opposed to widget-centered, screen design, (c) provides decision-support for designers, and (d) bridges the transitions between the multiple actors in the design and engineering of a user interface. UI Fin has been used in real-world interface design projects and it appears to improve the efficiency of the design process, to enable multiple types of users to create design artifacts, and to present a relatively low barrier for novice users to become productive with the tool.

We describe a system designed for simple and intuitive interaction with a large screen from a distance. The approach is based on an optical pointing and tracking system which has the important property that the tracking is absolute in nature. This provides several advantages over traditional methods used for input devices and remote controls, especially when the interaction is performed at a distance from the screen and where the user is not constrained to a surface.

Despite of decades of research, creating intuitive and easy to learn interfaces for 3D virtual environments (VE) is still not obvious, requiring VE specialists to dene, implement and evaluate solutions in an iterative way, often using lowlevel programming code. Moreover, quite frequently the interaction with the virtual environment may also vary dependent on the context in which it is applied, such as the available hardware setup, user experience, or the pose of the user (e.g. sitting or standing). Lacking other tools, the context-awareness of an application is usually implemented in an ad-hoc manner, using low-level programming, as well. This may result in code that is diffcult and expensive to maintain. One possible approach to facilitate the process of creating these highly interactive user interfaces is by adopting a model-based user interface design. This lifts the creation of a user interface to a higher level allowing the designer to reason more in terms of high-level concepts, rather than writing programming code. In this paper, we adopt a model-based user interface design (MBUID) process for the creation of VEs, and explain how a context system using an Event-Condition-Action paradigm is added. We illustrate our approach by means of a case study. ispartof: pages:129-136 ispartof: Proceedings of The Tenth International Conference on Multimodal Interfaces (ICMI) pages:129-136 ispartof: International Conference on Multimodal Interfaces location:Crete status: published

This poster describes a novel approach that is intended to combine graphical user interfaces (GUI) and voice interaction in the Web throughout the design and the development of intuitive and user-friendly multimodal interfaces. We are considering the user interface design modeling aspects, principles and guidelines that are being used to design voice and GUI. Our goal is to get an organized process to the design of multimodal interfaces that will let the designers to evaluate the interfaces with real users, find out usability issues and report the rationale to correct those issues. Moreover it will capture and store the acquired knowledge gathered during the multimodal interfaces design by using the design rationale (DR) and design patterns techniques.