Search

Your search keyword '"hand tracking"' showing total 480 results
Start Over Descriptor "hand tracking"
480 results on '"hand tracking"'

451. Vision-based recognition of gestures with context

Author

Fritsch, Jan Nikolaus

Subjects
Gesture recognition, Kontextbezogenes System, Image processing, Bilderkennung, Hand tracking, Hand, Particle filtering, Motion Capturing, Gestik, Mensch-Maschine-Kommunikation
Abstract

Out of the large range of human actions, gestures performed with the hands play a very important role during everyday life. Therefore, their automatic recognition is highly relevant for constructing userfriendly human-machine interfaces. This dissertation presents a new approach to the recognition of manipulative gestures that interact with objects in the environment. The proposed gesture recognition can serve to realize pro-active human-machine interfaces enabling technical systems to observe humans acting in their environment and to react appropriately. For observing the motions of natural hands, a non-intrusive vision-based technique is required. For this purpose, an adaptive skin color segmentation approach that is capable of detecting skin-colored hands in a wide range of lighting conditions is developed. The adaptation step is controlled by using additional scene information to restrict updating of the color model to image areas that actually contain skin areas. With the trajectory data that results from detecting hands in a sequence of images, gesture recognition can be performed. To recognize gestures with context, a new method for incorporating additional scene information in the recognition process is described. The context of a gesture model consists of the current state of the hand and the object that is manipulated. The current hand state is needed to capture the applicability of a gesture model while the manipulated object needs to be present in the vicinity of the hand to enable recognizing the gesture model. Through the proposed context integration, the developed recognition system allows to observe gestures that are mainly characterized by their interaction with the environment and do not have a characteristic trajectory. The performance of the gesture recognition approach is demonstrated with gestures performed in an assembly construction scenario and in a typical office environment. The use of the recognition results for improving human-machine interfaces is shown by applying the gesture recognition in a 'situated artifical communicator' system that is situated in an assembly construction domain. Here the information about the executed gesture can be used for improving dialog interaction by providing information about the hand contents. Besides this direct improvement of the human-machine interface, the recognized gestures can also be used as context knowledge for other system components. This is demonstrated with the observation of construction gestures that provide relevant context information for the vision algorithms aiming at recognizing the objects and assemblies in the construction scenario. In this way the gesture recognition results improve the human-machine interface also indirectly.

Published
2003

452. Hand Tracking and Gesture Recognition for Human-Computer Interaction

Author

Javier Varona, Ramon Mas, Francisco J. Perales, and Cristina Manresa

Subjects
Computer engineering. Computer hardware, Interfaces de usuario perceptuales, Computer science, Gesture Recognition, Perceptual User Interfaces, 02 engineering and technology, Reconocimiento de gestos, TK7885-7895, 0202 electrical engineering, electronic engineering, information engineering, Interacció humà-computadora, Segmentation, Computer vision, Finite state, Video game, Hand Tracking, Pixel, business.industry, 020207 software engineering, Usability, QA75.5-76.95, Interacción humano-computadora, Human-Computer Interaction, Interfícies d'usuari perceptuals, Reconeixement de gestos, Gesture recognition, Electronic computers. Computer science, 020201 artificial intelligence & image processing, Computer Vision and Pattern Recognition, Artificial intelligence, business, Classifier (UML), Software, Gesture
Abstract

The proposed work is part of a project that aims for the control of a videogame based on hand gesture recognition. This goal implies the restriction of real-time response and unconstrained environments. In this paper we present a real-time algorithm to track and recognise hand gestures for interacting with the videogame. This algorithm is based on three main steps: hand segmentation, hand tracking and gesture recognition from hand features. For the hand segmentation step we use the colour cue due to the characteristic colour values of human skin, its invariant properties and its computational simplicity. To prevent errors from hand segmentation we add a second step, hand tracking. Tracking is performed assuming a constant velocity model and using a pixel labeling approach. From the tracking process we extract several hand features that are fed to a finite state classifier which identifies the hand configuration. The hand can be classified into one of the four gesture classes or one of the four different movement directions. Finally, using the system’s performance evaluation results we show the usability of the algorithm in a video game environment.

Published
2005

453. Hand Tracking by Fusion of Color and a Range Sensor

Author

Sen, Abhishek

Subjects
Hand tracking, Graphical model
Abstract

Abstract: In this work we have developed a decentralized algorithm for efficient localization and tracking of hands from a sequence of depth and colour images. We deduce the location of key-points using a Bayesian framework. We use anthropomorphic constraints for modelling the interaction between body-parts.Furthermore, we incorporate an occlusion reasoning and data association preservation procedure for dealing with ambiguities. Our work is adaptive to illumination changes despite utilizing the skin-color information for tracking. Experimental results demonstrate that our system produces more accurate tracking of the head and hands in video, compared to prior research.

Published
2012

454. Model-Based 3D Hand Pose Estimation from Monocular Video.

Author

de La Gorce, Martin, Fleet, David J., and Paragios, Nikos

Subjects
*MODEL-based reasoning, *MONOCULARS, *AUTOMATIC tracking, *THREE-dimensional display systems, *MATHEMATICAL optimization, *ESTIMATION theory
Abstract

A novel model-based approach to 3D hand tracking from monocular video is presented. The 3D hand pose, the hand texture, and the illuminant are dynamically estimated through minimization of an objective function. Derived from an inverse problem formulation, the objective function enables explicit use of temporal texture continuity and shading information while handling important self-occlusions and time-varying illumination. The minimization is done efficiently using a quasi-Newton method, for which we provide a rigorous derivation of the objective function gradient. Particular attention is given to terms related to the change of visibility near self-occlusion boundaries that are neglected in existing formulations. To this end, we introduce new occlusion forces and show that using all gradient terms greatly improves the performance of the method. Qualitative and quantitative experimental results demonstrate the potential of the approach. [ABSTRACT FROM PUBLISHER]

Published
2011
Full Text
View/download PDF

455. Rigid and Articulated Point Registration with Expectation Conditional Maximization.

Author

Horaud, Radu, Forbes, Florence, Yguel, Manuel, Dewaele, Guillaume, and Zhang, Jian

Subjects
*IMAGE registration, *FEATURE extraction, *DATA modeling, *ANALYSIS of covariance, *COMPUTER algorithms, *ITERATIVE methods (Mathematics), *ROBUST control, *MATRICES (Mathematics)
Abstract

This paper addresses the issue of matching rigid and articulated shapes through probabilistic point registration. The problem is recast into a missing data framework where unknown correspondences are handled via mixture models. Adopting a maximum likelihood principle, we introduce an innovative EM-like algorithm, namely, the Expectation Conditional Maximization for Point Registration (ECMPR) algorithm. The algorithm allows the use of general covariance matrices for the mixture model components and improves over the isotropic covariance case. We analyze in detail the associated consequences in terms of estimation of the registration parameters, and propose an optimal method for estimating the rotational and translational parameters based on semidefinite positive relaxation. We extend rigid registration to articulated registration. Robustness is ensured by detecting and rejecting outliers through the addition of a uniform component to the Gaussian mixture model at hand. We provide an in-depth analysis of our method and compare it both theoretically and experimentally with other robust methods for point registration. [ABSTRACT FROM AUTHOR]

Published
2011
Full Text
View/download PDF

456. Cost-Efficient Video Interactions for Virtual Training Environment

Author

Gasparyan, Arsen

Subjects
Computer Science, virtual environment, virtual reality, web-cam, video interactions, computer vision, hand tracking
Abstract

In this thesis we propose the paradigm for video-based interaction in virtual training environment; explore and develop image recognition techniques to estimate the position of user’s head and hands; and use this data to control virtual 3D avatar. Moreover, we target to develop a cost efficient system using only cross-platform and freely available software components, establishing interaction via common hardware (computer, monocular web-cam), and an ordinary internet channel. Consequently we aim increasing accessibility and cost efficiency of the system and avoidance of expensive instruments for essential interaction in virtual space. The results of this work are the following: the method for estimation the hand positions; the proposed design solutions for the system; the proof of concepts based on the two test cases (“Ball game” and “Chemistry lab”); and the discussion regarding the advantages, limitations and possible future research on the video-based interactions in the virtual environments.

Published
2007

457. A multicamera system for gesture tracking with three dimensional hand pose estimation

Author

Cockburn, Juan, Savakis, Andreas, Shaaban, Muhammad, Clark, Evan, Cockburn, Juan, Savakis, Andreas, Shaaban, Muhammad, and Clark, Evan

Abstract

The goal of any visual tracking system is to successfully detect then follow an object of interest through a sequence of images. The difficulty of tracking an object depends on the dynamics, the motion and the characteristics of the object as well as on the environment. For example, tracking an articulated, self-occluding object such as a signing hand has proven to be a very difficult problem. The focus of this work is on tracking and pose estimation with applications to hand gesture interpretation. An approach that attempts to integrate the simplicity of a region tracker with single hand 3D pose estimation methods is presented. Additionally, this work delves into the pose estimation problem. This is accomplished by both analyzing hand templates composed of their morphological skeleton, and addressing the skeleton’s inherent instability. Ligature points along the skeleton are flagged in order to determine their effect on skeletal instabilities. Tested on real data, the analysis finds the flagging of ligature points to proportionally increase the match strength of high similarity image-template pairs by about 6%. The effectiveness of this approach is further demonstrated in a real-time multicamera hand tracking system that tracks hand gestures through three-dimensional space as well as estimate the three-dimensional pose of the hand.

458. Kreslení s projektorem pomocí Leap Motion

Author

Zahrádka, Jiří, Najman, Pavel, Zahrádka, Jiří, and Najman, Pavel

Abstract

Cílem této práce bylo navrhnout rozhraní využívajíci projektor a prostorový senzor leap motion pro aplikaci kreslení a kalibračního programu. Navrhované rozhraní implementovat v libovolném jazyce. Práce se zabýva kalibracií kamery a projektoru. Využití kalibrace v systému projektor - senzor, kde se kalibruje projektor podle dat ze senzoru. Výsledkem práce je multiplatformní program napsán v jazyce C++ s využitím knihovny Qt, který využíva senzor leap motion a projektor na kreslení., Purpose of this bachelor´s thesis is to design interface for application, that is using projector and sensor leap motion. Application is divided to 2 applications, calibration and drawing. Designed interface should be implemented in one of optional programming languages. Thesis is focused on calibration and calibration methods used in computer vision and drawing application. The result of work is multiplatform application written in C++ programming language and Qt library, that uses leap motion and projector to draw.

459. Kreslení s projektorem pomocí Leap Motion

Author

Zahrádka, Jiří, Najman, Pavel, Zahrádka, Jiří, and Najman, Pavel

Abstract

Cílem této práce bylo navrhnout rozhraní využívajíci projektor a prostorový senzor leap motion pro aplikaci kreslení a kalibračního programu. Navrhované rozhraní implementovat v libovolném jazyce. Práce se zabýva kalibracií kamery a projektoru. Využití kalibrace v systému projektor - senzor, kde se kalibruje projektor podle dat ze senzoru. Výsledkem práce je multiplatformní program napsán v jazyce C++ s využitím knihovny Qt, který využíva senzor leap motion a projektor na kreslení., Purpose of this bachelor´s thesis is to design interface for application, that is using projector and sensor leap motion. Application is divided to 2 applications, calibration and drawing. Designed interface should be implemented in one of optional programming languages. Thesis is focused on calibration and calibration methods used in computer vision and drawing application. The result of work is multiplatform application written in C++ programming language and Qt library, that uses leap motion and projector to draw.

460. Využití gest v uživatelských rozhraních

Author

Mlích, Jozef, Beran, Vítězslav, Mlích, Jozef, and Beran, Vítězslav

Abstract

Tato diplomová práce se zabývá využitím gest v uživatelských rozhraních. Cílem této práce je tvorba knihovny pro sledování rukou a klasifikaci gest v reálném čase. Pro sledování rukou byl zvolen algoritmus Flock of Features. Klasifikace gest se provádí pomocí algoritmu DTW. Součástí práce je návrh scény, návrh a implementace systému využívajícího této knihovny. V rámci testů bylo otestováno ovládání různých aplikací pomocí vytvořené knihovny., This master thesis deals with the use of gestures in user interfaces. The goal of this thesis is to create library for hand tracking and gesture recognition in real time. For hand tracking was choosen algorithm Flock of Features. Classification of gestures is done by using algorithm DTW. This thesis also contains stage design, design and implementation of a system that uses this library. Within the tests was tested control of various application using this library.

461. Rozpoznávání objektů a gest v obraze

Author

Zemčík, Pavel, Beran, Vítězslav, Zemčík, Pavel, and Beran, Vítězslav

Abstract

Tato práce je zaměřena na rozpoznávání gest ve videu. Cílem práce bylo vytvořit aplikaci, která by umožnila pomocí obyčejné webové kamery rozpoznávání malého množství gest za účelem ovládání počítače. Pro tento účel bylo použito vybraných metod pro získávání deskriptorů z obrazu, pro sledování určitých oblastí ve videu a strojového učení., This thesis is focused on gesture recognition in video. The main purpose of this thesis was to create an algorithm and an application that can recognize selected gestures using a~video obtained through a~standard webcamera. The intention was to control an application program, such as video player. The approach used to achieve this goal was to exploit methods of feature extraction, tracking, and machine learning.

462. Kreslení s projektorem pomocí Leap Motion

Author

Zahrádka, Jiří, Najman, Pavel, Zahrádka, Jiří, and Najman, Pavel

Abstract

Cílem této práce bylo navrhnout rozhraní využívajíci projektor a prostorový senzor leap motion pro aplikaci kreslení a kalibračního programu. Navrhované rozhraní implementovat v libovolném jazyce. Práce se zabýva kalibracií kamery a projektoru. Využití kalibrace v systému projektor - senzor, kde se kalibruje projektor podle dat ze senzoru. Výsledkem práce je multiplatformní program napsán v jazyce C++ s využitím knihovny Qt, který využíva senzor leap motion a projektor na kreslení., Purpose of this bachelor´s thesis is to design interface for application, that is using projector and sensor leap motion. Application is divided to 2 applications, calibration and drawing. Designed interface should be implemented in one of optional programming languages. Thesis is focused on calibration and calibration methods used in computer vision and drawing application. The result of work is multiplatform application written in C++ programming language and Qt library, that uses leap motion and projector to draw.

463. Rozpoznávání objektů a gest v obraze

Author

Zemčík, Pavel, Beran, Vítězslav, Zemčík, Pavel, and Beran, Vítězslav

Abstract

Tato práce je zaměřena na rozpoznávání gest ve videu. Cílem práce bylo vytvořit aplikaci, která by umožnila pomocí obyčejné webové kamery rozpoznávání malého množství gest za účelem ovládání počítače. Pro tento účel bylo použito vybraných metod pro získávání deskriptorů z obrazu, pro sledování určitých oblastí ve videu a strojového učení., This thesis is focused on gesture recognition in video. The main purpose of this thesis was to create an algorithm and an application that can recognize selected gestures using a~video obtained through a~standard webcamera. The intention was to control an application program, such as video player. The approach used to achieve this goal was to exploit methods of feature extraction, tracking, and machine learning.

464. Rozpoznávání objektů a gest v obraze

Author

Zemčík, Pavel, Beran, Vítězslav, Zemčík, Pavel, and Beran, Vítězslav

Abstract

Tato práce je zaměřena na rozpoznávání gest ve videu. Cílem práce bylo vytvořit aplikaci, která by umožnila pomocí obyčejné webové kamery rozpoznávání malého množství gest za účelem ovládání počítače. Pro tento účel bylo použito vybraných metod pro získávání deskriptorů z obrazu, pro sledování určitých oblastí ve videu a strojového učení., This thesis is focused on gesture recognition in video. The main purpose of this thesis was to create an algorithm and an application that can recognize selected gestures using a~video obtained through a~standard webcamera. The intention was to control an application program, such as video player. The approach used to achieve this goal was to exploit methods of feature extraction, tracking, and machine learning.

465. Kreslení s projektorem pomocí Leap Motion

Author

Zahrádka, Jiří, Najman, Pavel, Zahrádka, Jiří, and Najman, Pavel

Abstract

Cílem této práce bylo navrhnout rozhraní využívajíci projektor a prostorový senzor leap motion pro aplikaci kreslení a kalibračního programu. Navrhované rozhraní implementovat v libovolném jazyce. Práce se zabýva kalibracií kamery a projektoru. Využití kalibrace v systému projektor - senzor, kde se kalibruje projektor podle dat ze senzoru. Výsledkem práce je multiplatformní program napsán v jazyce C++ s využitím knihovny Qt, který využíva senzor leap motion a projektor na kreslení., Purpose of this bachelor´s thesis is to design interface for application, that is using projector and sensor leap motion. Application is divided to 2 applications, calibration and drawing. Designed interface should be implemented in one of optional programming languages. Thesis is focused on calibration and calibration methods used in computer vision and drawing application. The result of work is multiplatform application written in C++ programming language and Qt library, that uses leap motion and projector to draw.

466. Využití gest v uživatelských rozhraních

Author

Mlích, Jozef, Beran, Vítězslav, Mlích, Jozef, and Beran, Vítězslav

Abstract

Tato diplomová práce se zabývá využitím gest v uživatelských rozhraních. Cílem této práce je tvorba knihovny pro sledování rukou a klasifikaci gest v reálném čase. Pro sledování rukou byl zvolen algoritmus Flock of Features. Klasifikace gest se provádí pomocí algoritmu DTW. Součástí práce je návrh scény, návrh a implementace systému využívajícího této knihovny. V rámci testů bylo otestováno ovládání různých aplikací pomocí vytvořené knihovny., This master thesis deals with the use of gestures in user interfaces. The goal of this thesis is to create library for hand tracking and gesture recognition in real time. For hand tracking was choosen algorithm Flock of Features. Classification of gestures is done by using algorithm DTW. This thesis also contains stage design, design and implementation of a system that uses this library. Within the tests was tested control of various application using this library.

467. Rozpoznávání objektů a gest v obraze

Author

Zemčík, Pavel, Beran, Vítězslav, Zemčík, Pavel, and Beran, Vítězslav

Abstract

Tato práce je zaměřena na rozpoznávání gest ve videu. Cílem práce bylo vytvořit aplikaci, která by umožnila pomocí obyčejné webové kamery rozpoznávání malého množství gest za účelem ovládání počítače. Pro tento účel bylo použito vybraných metod pro získávání deskriptorů z obrazu, pro sledování určitých oblastí ve videu a strojového učení., This thesis is focused on gesture recognition in video. The main purpose of this thesis was to create an algorithm and an application that can recognize selected gestures using a~video obtained through a~standard webcamera. The intention was to control an application program, such as video player. The approach used to achieve this goal was to exploit methods of feature extraction, tracking, and machine learning.

468. Využití gest v uživatelských rozhraních

Author

Mlích, Jozef, Beran, Vítězslav, Mlích, Jozef, and Beran, Vítězslav

Abstract

Tato diplomová práce se zabývá využitím gest v uživatelských rozhraních. Cílem této práce je tvorba knihovny pro sledování rukou a klasifikaci gest v reálném čase. Pro sledování rukou byl zvolen algoritmus Flock of Features. Klasifikace gest se provádí pomocí algoritmu DTW. Součástí práce je návrh scény, návrh a implementace systému využívajícího této knihovny. V rámci testů bylo otestováno ovládání různých aplikací pomocí vytvořené knihovny., This master thesis deals with the use of gestures in user interfaces. The goal of this thesis is to create library for hand tracking and gesture recognition in real time. For hand tracking was choosen algorithm Flock of Features. Classification of gestures is done by using algorithm DTW. This thesis also contains stage design, design and implementation of a system that uses this library. Within the tests was tested control of various application using this library.

469. Kreslení s projektorem pomocí Leap Motion

Author

Zahrádka, Jiří, Najman, Pavel, Cilip, Peter, Zahrádka, Jiří, Najman, Pavel, and Cilip, Peter

Abstract

Cílem této práce bylo navrhnout rozhraní využívajíci projektor a prostorový senzor leap motion pro aplikaci kreslení a kalibračního programu. Navrhované rozhraní implementovat v libovolném jazyce. Práce se zabýva kalibracií kamery a projektoru. Využití kalibrace v systému projektor - senzor, kde se kalibruje projektor podle dat ze senzoru. Výsledkem práce je multiplatformní program napsán v jazyce C++ s využitím knihovny Qt, který využíva senzor leap motion a projektor na kreslení., Purpose of this bachelor´s thesis is to design interface for application, that is using projector and sensor leap motion. Application is divided to 2 applications, calibration and drawing. Designed interface should be implemented in one of optional programming languages. Thesis is focused on calibration and calibration methods used in computer vision and drawing application. The result of work is multiplatform application written in C++ programming language and Qt library, that uses leap motion and projector to draw.

470. Rozpoznávání objektů a gest v obraze

Author

Zemčík, Pavel, Beran, Vítězslav, Johanová, Daniela, Zemčík, Pavel, Beran, Vítězslav, and Johanová, Daniela

Abstract

Tato práce je zaměřena na rozpoznávání gest ve videu. Cílem práce bylo vytvořit aplikaci, která by umožnila pomocí obyčejné webové kamery rozpoznávání malého množství gest za účelem ovládání počítače. Pro tento účel bylo použito vybraných metod pro získávání deskriptorů z obrazu, pro sledování určitých oblastí ve videu a strojového učení., This thesis is focused on gesture recognition in video. The main purpose of this thesis was to create an algorithm and an application that can recognize selected gestures using a~video obtained through a~standard webcamera. The intention was to control an application program, such as video player. The approach used to achieve this goal was to exploit methods of feature extraction, tracking, and machine learning.

471. Kreslení s projektorem pomocí Leap Motion

Author

Zahrádka, Jiří, Najman, Pavel, Cilip, Peter, Zahrádka, Jiří, Najman, Pavel, and Cilip, Peter

Abstract

Cílem této práce bylo navrhnout rozhraní využívajíci projektor a prostorový senzor leap motion pro aplikaci kreslení a kalibračního programu. Navrhované rozhraní implementovat v libovolném jazyce. Práce se zabýva kalibracií kamery a projektoru. Využití kalibrace v systému projektor - senzor, kde se kalibruje projektor podle dat ze senzoru. Výsledkem práce je multiplatformní program napsán v jazyce C++ s využitím knihovny Qt, který využíva senzor leap motion a projektor na kreslení., Purpose of this bachelor´s thesis is to design interface for application, that is using projector and sensor leap motion. Application is divided to 2 applications, calibration and drawing. Designed interface should be implemented in one of optional programming languages. Thesis is focused on calibration and calibration methods used in computer vision and drawing application. The result of work is multiplatform application written in C++ programming language and Qt library, that uses leap motion and projector to draw.

472. Rozpoznávání objektů a gest v obraze

Author

Zemčík, Pavel, Beran, Vítězslav, Johanová, Daniela, Zemčík, Pavel, Beran, Vítězslav, and Johanová, Daniela

Abstract

Tato práce je zaměřena na rozpoznávání gest ve videu. Cílem práce bylo vytvořit aplikaci, která by umožnila pomocí obyčejné webové kamery rozpoznávání malého množství gest za účelem ovládání počítače. Pro tento účel bylo použito vybraných metod pro získávání deskriptorů z obrazu, pro sledování určitých oblastí ve videu a strojového učení., This thesis is focused on gesture recognition in video. The main purpose of this thesis was to create an algorithm and an application that can recognize selected gestures using a~video obtained through a~standard webcamera. The intention was to control an application program, such as video player. The approach used to achieve this goal was to exploit methods of feature extraction, tracking, and machine learning.

473. Využití gest v uživatelských rozhraních

Author

Mlích, Jozef, Beran, Vítězslav, Bednář, Luboš, Mlích, Jozef, Beran, Vítězslav, and Bednář, Luboš

Abstract

Tato diplomová práce se zabývá využitím gest v uživatelských rozhraních. Cílem této práce je tvorba knihovny pro sledování rukou a klasifikaci gest v reálném čase. Pro sledování rukou byl zvolen algoritmus Flock of Features. Klasifikace gest se provádí pomocí algoritmu DTW. Součástí práce je návrh scény, návrh a implementace systému využívajícího této knihovny. V rámci testů bylo otestováno ovládání různých aplikací pomocí vytvořené knihovny., This master thesis deals with the use of gestures in user interfaces. The goal of this thesis is to create library for hand tracking and gesture recognition in real time. For hand tracking was choosen algorithm Flock of Features. Classification of gestures is done by using algorithm DTW. This thesis also contains stage design, design and implementation of a system that uses this library. Within the tests was tested control of various application using this library.

474. Interactive Hand Pose Estimation using a Stretch-Sensing Soft Glove

Author

Glauser, Oliver, Wu, Shihao, Panozzo, Daniele, Hilliges, Otmar, and Sorkine-Hornung, Olga

Subjects
ComputingMilieux_THECOMPUTINGPROFESSION, Data glove, Hand tracking, 16. Peace & justice, GeneralLiterature_REFERENCE(e.g.,dictionaries,encyclopedias,glossaries), GeneralLiterature_MISCELLANEOUS, Sensor array, ComputingMethodologies_COMPUTERGRAPHICS, Stretch-sensing
Abstract

ACM Transactions on Graphics, 38 (4), ISSN:0730-0301, ISSN:1557-7368

475. Human-computer interaction using robust gesture recognition

Author

Endler, M., Oleg Lobachev, Guthe, M., and Skala, Václav

Subjects
Physics::Instrumentation and Detectors, gesture recognition, ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION, human computer interaction, High Energy Physics::Experiment, sledování rukou, interakce člověk-počítač, hand tracking, rozpoznávání gest, počítačové vidění, computer vision
Abstract

We present a detector cascade for robust real-time tracking of hand movements on consumer-level hardware. We adapt existing detectors to our setting: Haar, CAMSHIFT, shape detector, skin detector. We use all these detectors at once. Our main contributions are: first, utilization of bootstrapping: Haar bootstraps itself, then its results are used to bootstrap the other filters; second, the usage of temporal filtering for more robust detection and to remove outliers; third, we adapted the detectors for more robust hand detection. The resulting system produces very robust results in real time. We evaluate both the robustness and the real-time capability.

476. 3D hand tracking using Kalman filter in depth space

Author

Sungjin Kim, Sangyoun Lee, Sunjin Yu, Sangheon Park, and Joongrock Kim

Subjects
hand detection, hand tracking, depth information, Computer science, business.industry, Tracking system, Kalman filter, Space (commercial competition), Tracking (particle physics), Motion (physics), Variable (computer science), Computer vision, Artificial intelligence, business, Natural language, Gesture
Abstract

Hand gestures are an important type of natural language used in many research areas such as human-computer interaction and computer vision. Hand gestures recognition requires the prior determination of the hand position through detection and tracking. One of the most efficient strategies for hand tracking is to use 2D visual information such as color and shape. However, visual-sensor-based hand tracking methods are very sensitive when tracking is performed under variable light conditions. Also, as hand movements are made in 3D space, the recognition performance of hand gestures using 2D information is inherently limited. In this article, we propose a novel real-time 3D hand tracking method in depth space using a 3D depth sensor and employing Kalman filter. We detect hand candidates using motion clusters and predefined wave motion, and track hand locations using Kalman filter. To verify the effectiveness of the proposed method, we compare the performance of the proposed method with the visual-based method. Experimental results show that the performance of the proposed method out performs visual-based method.

Full Text
View/download PDF

477. 3D Hand Model Fitting for Virtual Keyboard System

Author

Edoardo Charbon and Huan Du

Subjects
Speedup, Matching (graph theory), business.industry, Computer science, 3D vision, Virtual reality, Hash table, law.invention, Range (mathematics), law, Computer graphics (images), Virtual human-computer interface, Computer vision, Artificial intelligence, User interface, Hand tracking, business, Virtual keyboard, Structured light
Abstract

In this paper, a 3D hand model fitting method is presented which can recover the accurate finger positions for a virtual keyboard system. The 3D hand model consists of a detailed polygonal skin driven by an underlying skeleton system. The system uses a structured light sensor to generate dense range measurements of user’s hand motion. We exploit depth information and match it against the model to estimate the pose of the hand. The parameters for model deformation are optimized with the guide of the applied forces between model points and range measurements. To speed up the optimization, we simplify the physical model and apply hash table- based fast point pair matching. The system can be used in any application requiring zero formfactor and requires no contact with a medium. Examples of applications include virtual reality, gaming, design, etc.

478. Robust Articulated-ICP for Real-Time Hand Tracking

Author

Anastasia Tkach, Sofien Bouaziz, Andrea Tagliasacchi, Matthias Schröder, Mario Botsch, and Mark Pauly

Subjects
Computer science, business.industry, Process (computing), ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION, Kinematics, Tracking (particle physics), Computer Graphics and Computer-Aided Design, Motion capture, Motion (physics), Silhouette, realtime registration, motion capture, Computer vision, Artificial intelligence, hand tracking, business
Abstract

We present a robust method for capturing articulated hand motions in realtime using a single depth camera. Our system is based on a realtime registration process that accurately reconstructs hand poses by fitting a 3D articulated hand model to depth images. We register the hand model using depth, silhouette, and temporal information. To effectively map low-quality depth maps to realistic hand poses, we regularize the registration with kinematic and temporal priors, as well as a novel data-driven prior built from a database of realistic hand poses. We present a principled way of integrating such priors into our registration optimization to enable robust tracking without severely restricting the freedom of motion. A core technical contribution is a new method for computing tracking correspondences that directly models occlusions typical of single-camera setups. To ensure reproducibility of our results and facilitate future research, we fully disclose the source code of our implementation.

479. Projector-leap motion calibration for gestural interfaces

Author

Najman, P., Zahradka, J., Pavel Zemcik, Skala, Václav, and Gavrilova, Marina

Subjects
HCI, leap motion, skokový pohyb, ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION, dynamické mapování, ruční sledování, projektor, hand tracking, dynamic mapping, calibration, projector, kalibrace
Abstract

Calibration of a projector and a tracking device is an essential step for interaction with projected content using gestures. We propose a novel technique for calibration of a data projector and a Leap Motion sensor. Using the proposed approach, users can calibrate the system by touching few points on the screen plane and in the space above it. No printed patterns, reflective markers, or additional tools are needed. The calibration process involves two steps. In the first step, we collect finger positions which we then use in the second step to find the calibration matrix and projector position. We compared the accuracy and precision of the proposed method to the accuracy and precision of a capacitive touchscreen in a touch based interaction task. During the evaluation we measured the Euclidean distance between the displayed and touched points. The best average distance for our method was 1.23 mm which is comparable to 0.79 mm for touch screen. The experiments demonstrate that the technique is suitable for an interaction with user interface elements designed in the usual way.

480. Σχεδίαση παιχνιδιού εικονικής πραγματικότητας χρησιμοποιώντας τεχνολογίες Oculus Rift και Leap Motion

Author

Σταυρουλακης Αλεξιος http://users.isc.tuc.gr/~astavroulakis, Stavroulakis Alexios http://users.isc.tuc.gr/~astavroulakis, Μανια Αικατερινη, Mania Aikaterini, Δεληγιαννακης Αντωνιος, Deligiannakis Antonios, Ουγγρινης Κωνσταντινος-Αλκετας, Ouggrinis Konstantinos-Alketas, Επιβλέπων: Μανια Αικατερινη, Advisor: Mania Aikaterini, Μέλος επιτροπής: Δεληγιαννακης Αντωνιος, Committee member: Deligiannakis Antonios, Μέλος επιτροπής: Ουγγρινης Κωνσταντινος-Αλκετας, and Committee member: Ouggrinis Konstantinos-Alketas

Subjects
Leap Motion, Head tracking, Gaming, Oculus Rift, Graphics, Hand tracking, Γραφικά
Abstract

Περίληψη: Στην παρούσα διπλωματική εργασία υλοποιήθηκε ένα παιχνίδι δράσης πρώτου προσώπου εικονικής πραγματικότητας χρησιμοποιώντας τεχνολογίες Oculus Rift και Leap Motion. Επιλέχθηκε η πλατφόρμα ανάπτυξης γραφικών Unity3D πάνω στην οποία βασίστηκε όλη η ανάπτυξη της εφαρμογής. Η γλώσσα προγραμματισμού που χρησιμοποιήθηκε είναι η C#, η οποία αποτελεί γλώσσα σεναρίων και είναι κατάλληλη για εφαρμογές που σχετίζονται με γραφικά. Ο χρήστης βρίσκεται σε όρθια θέση φορώντας το Oculus Rift στο κεφάλι και αντιλαμβάνεται το εικονικό περιβάλλον μέσω των δύο οθονών που βρίσκονται στο Head Mount Display. To HMD εμπεριέχει σύστημα ανίχνευσης θέσης και σύστημα ανίχνευσης περιστροφής καθορίζοντας την ακριβή θέση του χρήστη στο εικονικό περιβάλλον. Επιπλέον, χρησιμοποιείται η συσκευή Leap Motion, ανιχνεύοντας κάθε χειρονομία των χεριών, αντικατοπτρίζοντάς τις στον εικονικό κόσμο, χαρακτηριστικό απαραίτητο για τις ευθύγραμμες κινήσεις στο ψηφιακό κόσμο. Η δράση διαδραματίζεται σε ένα πολύπλοκο, ορθογώνιο, γεωμετρικό τερέν, με πλούσια γεωμορφολογία εδάφους με τα διάφορα στατικά μοντέλα, ήχους και υφές να είναι τοποθετημένα με καλλιτεχνικό τρόπο πάνω σε αυτό. Παράλληλα, χρησιμοποιήθηκε η τεχνική φωτισμού “Precomputed Real Time Global Illumination” ώστε να προσομοιώσουμε τη φωτορεαλιστική συμπεριφορά των ακτινών του ήλιου. Ο χρήστης εμβυθίζεται στο εικονικό περιβάλλον, καλούμενος να διεκπεραιώσει μία σειρά τεσσάρων αποστολών ενώ διάφοροι εχθροί παρεμποδίζουν την ολοκλήρωσή τους. Οι εχθροί είναι χαρακτήρες-μοντέλα προγραμματισμένοι με διαφορετική συμπεριφορά ανάλογα το είδος τους. Είναι εμπλουτισμένοι με κινούμενα σχέδια (animation) ώστε η κίνησή τους να είναι ρεαλιστική και λειτουργούν ως αυτόνομοι πράκτορες, βασισμένοι στις αρχές της τεχνητής νοημοσύνης. Επίσης, σχεδιάστηκε ένα εύχρηστο User Interface τεχνολογίας αφής, αξιοποιώντας το Hand Tracking του Leap Motion. Όλα τα παραπάνω έχουν στόχο την εξερεύνηση της διευρυμένης εικονικής πραγματικότητας και τη δημιουργία εφαρμογής όπου θα εξασφαλίζεται η επιτυχημένη διαδραστικότητα μεταξύ χρήστη και ψηφιακού κόσμου. Summarization: In this diploma thesis, a first-person virtual reality action game was implemented using Oculus Rift and Leap Motion technologies. The Unity3D graphics development platform was chosen on which the entire development of the application was based. The programming language used is C #, which is a script language and is suitable for graphics-related applications. The user is standing while wearing the Oculus Rift on the head in order to perceive the virtual environment through the two monitors on the Head Mount Display. The HMD includes a position detection system and a rotation detection system in order to specify the user's exact location in the virtual environment. Additionally, Leap Motion is used, detecting every hand gesture, transferring it in the virtual world, essential feature for linear movements in digital world. The game takes place in a complex, rectangular, geometric terrain with rich soil geomorphology while various static models, sounds and textures being artistically arranged on it. At the same time, the "Precomputed Real Time Global Illumination" lighting technique was used to simulate the photorealistic behavior of the sun's rays. The user is placed in the virtual environment, called to perform a series of four missions while various enemies prevent their completion. Enemies are model characters programmed with different behavior depending on their type. They are enriched with animation to make their movement realistic and act as autonomous agents based on the principles of artificial intelligence. Also, a user-friendly Touch Interface User Interface has been designed, utilizing Leap Motion's Hand Tracking. All of the above aim into exploring the wider virtual reality and creating an application where successful interactivity between the user and the digital world will be ensured.

Catalog

Books, media, physical & digital resources
See catalog results