Markerless 4 gestures 6 DOF real‐time visual tracking of the human hand with automatic initialization
Markerless 4 gestures 6 DOF real‐time visual tracking of the human hand with automatic initialization
复制标题
DOI：
10.1111/j.1467-8659.2007.01069.x
复制
发表时间：
2007-09
影响因子：
2.5
通讯作者：
M. Schlattmann;F. Kahlesz;Ralf Sarlette;R. Klein
中科院分区：
文献类型：
--
作者：
M. Schlattmann;F. Kahlesz;Ralf Sarlette;R. Klein
本文提出了一种新的基于计算机视觉的手部跟踪技术，它能够在3个(或更多)现成的消费类摄像机的帮助下，实时地(至少25帧/秒)鲁棒地跟踪人类手的6+4个自由度。‘6+4自由度’意味着系统可以跟踪4种不同手势的全局姿势(平移和旋转的6个连续参数)。我们系统的一个关键特征是它的全自动实时初始化过程，与声音跟踪丢失检测器一起，使该系统适合于现实世界的应用。正因为如此，我们的方法为简单的基于手的3D人机交互(HCI)提供了一种使能技术。以前，使用手作为至少6个自由度的输入设备需要使用数据手套或记号笔。使用我们的跟踪，我们评估了将手作为两个流行的虚拟现实应用程序的输入设备的使用：虚拟世界的飞行探索和简单的数字装配模拟。
In this paper we present a novel computer vision based hand‐tracking technique, which is capable of robustly tracking 6+4DOF of the human hand in real‐time (at least 25 frames per second) with the help of 3 (or more) off‐the‐shelf consumer cameras. ‘6+4DOF’ means that the system can track the global pose (6 continuous parameters for translation and rotation) of 4 different gestures. A key feature of our system is its fully automatic real‐time initialization procedure, which, along with a sound tracking‐lost detector, makes the system fit for real‐world applications. Because of this, our method acts as an enabling technology for uncumbersome hand‐based 3D Human‐Computer‐Interaction (HCI). Previously, using the hand as an at least 6DOF input device involved the use of either datagloves or markers. Using our tracking we evaluated the use of the hand as an input device for two prevalent Virtual Reality applications: fly‐through exploration of a virtual world and a simple digital assembly simulation.