Interacting with a Tabletop Display Using a Camera Equipped Mobile Phone.

Today's mobile phones have not only become the most representative device in the new ubiquitous computing era but also dramatically improved in terms of their multi-modal sensing and display capabilities. This advance makes the mobile phone an ideal candidate for a more natural interaction device in ubiquitous computing environment. This paper proposes techniques which use camera-equipped mobile phones for interacting with 2D and 3D applications on a tabletop display environment. The camera acts as the main sensor for a gesture-based interaction. Using the mobile phone with an interactive touch screen allows the use of techniques that move beyond single hand/finger input to improve task performance. The interaction performances of the proposed techniques and design guidelines are also described in this paper. [ABSTRACT FROM AUTHOR]