Premium
Markerless 4 gestures 6 DOF real‐time visual tracking of the human hand with automatic initialization
Author(s) -
Schlattmann Markus,
Kahlesz Ferenc,
Sarlette Ralf,
Klein Reinhard
Publication year - 2007
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/j.1467-8659.2007.01069.x
Subject(s) - computer science , initialization , computer vision , artificial intelligence , gesture , tracking (education) , augmented reality , translation (biology) , rotation (mathematics) , feature (linguistics) , tracking system , gesture recognition , frame rate , laptop , computer graphics (images) , psychology , pedagogy , biochemistry , chemistry , linguistics , philosophy , filter (signal processing) , messenger rna , gene , programming language , operating system
In this paper we present a novel computer vision based hand‐tracking technique, which is capable of robustly tracking 6+4DOF of the human hand in real‐time (at least 25 frames per second) with the help of 3 (or more) off‐the‐shelf consumer cameras. ‘6+4DOF’ means that the system can track the global pose (6 continuous parameters for translation and rotation) of 4 different gestures. A key feature of our system is its fully automatic real‐time initialization procedure, which, along with a sound tracking‐lost detector, makes the system fit for real‐world applications. Because of this, our method acts as an enabling technology for uncumbersome hand‐based 3D Human‐Computer‐Interaction (HCI). Previously, using the hand as an at least 6DOF input device involved the use of either datagloves or markers. Using our tracking we evaluated the use of the hand as an input device for two prevalent Virtual Reality applications: fly‐through exploration of a virtual world and a simple digital assembly simulation.