Search

For a long time emotions have been kept out of the deliberate tools of science; scientists have expressed emotion, but no tools could sense and respond to their affective information. This paper highlights research at the MIT Media Laboratory aimed at giving computers the ability to comfortably sense, recognize, and respond to the human communication of emotion, especially affective states such as frustration, confusion, interest, distress, anger, and joy. Two main themes of sensing--self-report and concurrent expression--are described, together with examples of systems that give users new ways to communicate emotion to computers and, through computers, to other people. In addition to building systems that try to elicit and detect frustration, our research group has built a system that responds to user frustration in a way that appears to help alleviate it. This paper highlights applications of this research to interface design, wearable computing, entertainment, and education, and briefly presents some potential ethical concerns and how they might be addressed. [ABSTRACT FROM AUTHOR]

Most interactive stories, such as hypertext narratives and interactive movies achieve an interactive "feel" by allowing the user to choose among multiple story paths. In this paper we discuss physically interactive environments with narrative structure in which the ability to choose among multiple story lines is replaced with having users, first, interact with the story characters in small, local "windows" of the narrative and, second, actively engage their bodies in movement. In particular, we found that compelling interactive narrative story systems can be perceived as highly responsive, engaging, and interactive even when the overall story has a single-path structure, in what we call a "less-choice, more-responsiveness" approach to the design of story-based interactive environments. We have also observed that unencumbering, rich sensor technology can facilitate user immersion in the experience as the story progresses--users can act as they typically would without worrying about manipulating a computer interface. To support these arguments, the paper describes the physical setup, the interactive story, the technology, and the user experience of four projects developed at the MIT Media Laboratory: KidsRoom, It/I, Personal Aerobics Trainer, and Swamped! [ABSTRACT FROM AUTHOR]

This paper describes four different systems that we have developed for capturing various manners of gesture near interactive surfaces. The first is a low-cost scanning laser rangefinder adapted to accurately track the position of bare hands in a plane just above a large projection display. The second is an acoustic system that detects the position of taps on a large, continuous surface (such as a table, wall, or window) by measuring the differential time-of-arrival of the acoustic shock impulse at several discrete locations. The third is a sensate carpet that uses a grid of piezoelectric wire to measure the dynamic location and pressure of footfalls. The fourth is a swept radio frequency (RF) tag reader that measures the height, approximate location, and other properties (orientation or a control variable like pressure) of objects containing passive, magnetically coupled resonant tags, and updates the continuous parameters of all tagged objects at 30 Hz. In addition to discussing the technologies and surveying different approaches, sample applications are given for each system. [ABSTRACT FROM AUTHOR]

As an outgrowth of our interest in dense wireless sensing and expressive applications of wearable computing, the Responsive Environments Group at the MIT Media Laboratory has developed a very versatile human-computer interface for the foot. By dense wireless sensing, we mean the remote acquisition of many different parameters with a compact, autonomous sensor cluster. We have developed such a low-power sensor card to measure over 16 continuous quantities and transmit them wirelessly to a remote base station, updating all variables at 50 Hz. We have integrated a pair of these devices onto the shoes of dancers and athletes, measuring continuous pressure at three points near the toe, dynamic pressure at the heel, bidirectional bend of the sole, height of each foot off conducting strips in the stage, angular rate of each foot about the vertical, angular position of each foot about the Earth's local magnetic field, as well as foot tilt and acceleration, 3-axis shock acceleration (from kicks and jumps), and position (via an integrated sonar). This paper describes the sensor and electronics systems, then outlines several projects in which we have applied these shoes for interactive dance and the capture of high-level podiatric gesture. We conclude by outlining several applications of our sensor system that are unrelated to footwear. [ABSTRACT FROM AUTHOR]

In hyperlinked video, objects are selectable-resulting in an associated action--akin to linked words or graphics on Web pages. Possible venues for hyperlinked video include broadcast television, streaming video (e.g., video on the Internet or other forms of video-on-demand systems), and published media such as DVD (digital versatile disc). Hyperlinked video offers new interaction possibilities with streaming media and the opportunity to move electronic commerce from the personal computer to the television receiver while making it more dynamic and engaging. In this paper we examine some opportunities and challenges of hyperlinked video, describe an object tracking and identification algorithm and an authoring tool we have developed, and discuss two prototype hyperlinked television programs--one an augmented broadcast and one a video-on-demand application. [ABSTRACT FROM AUTHOR]

This paper describes recent progress toward a framework and toolset for Very Distributed Storytelling. It focuses on three independent but interconnected axes of development: continuous story playout environments, story authoring systems, and scenarios for interaction, particularly those that operate in casual or formal architectural spaces. Aspects of these are explored in several systems currently under development at the Interactive Cinema Group of the MIT Media Laboratory. Agent Stories invites authors to develop story segments that know about their role in the story and agents that can use these role designations to orchestrate the playout of story parts. Happenstance, an ecologically based, context-sensitive "stage" for the performance of interactive narratives, provides an information landscape that is continuous in space and time, supports multiple viewpoints, and acts as a semi-porous membrane to information and messages from the outside world. The CINEMAT and other large-scale interactive media pieces--situated in sensor-rich architectural spaces--explore the relationships among immersion, interaction, narrative guidance, and public space. [ABSTRACT FROM AUTHOR]

Describes the efforts of the authors at the Massachusetts Institute of Technology Media Laboratory toward realizing an electronic book with hundreds of electronically addressable display pages printed on real paper. Features of the electronic book; Information on the electronic ink (e-ink) that will be used in the book; Development from illuminated manuscript to animated manuscript.

Introduces the projects and programs on computer systems at the Media Laboratory of the Massachusetts Institute of Technology, featured in the June 2000 issue of the`IBM Systems Journal.' Description of the papers on perspective of arts and media; Discussion on the perspective of learning and expressing; Conclusions.