Constraint-Based Visual Hand Gesture Analysis

视觉手/手指跟踪和分析具有许多重要的潜在应用，包括人机交互、康复和手语识别。实时视觉手/手指跟踪的主要障碍是配置空间的巨大维数。 例如，在一个示例中，用指关节角度来表示姿态，自由度约为27。 在这种高维空间里追踪是不可能的。 然而，手指移动受到高度限制。 我们建议使用基于3D模型的方法，其中模型将包括姿势和运动约束。 通过匹配真实的手的图像和来自3D模型的手的预测视图的图像来完成跟踪。 关键是利用约束减少搜索时间。 到建议的时间结束时，我们希望有一个良好的约束表示和一个良好的实时手/手指跟踪算法，并已证明实时跟踪的虚拟对象操作的应用程序。

Visual hand/finger tracking and analysis has many important potential applications, including human-computer interaction, rehabilitation, and the recognition of sign languages. The major obstacle to real-time visual hand/finger tracking is the huge dimensionality of the configuration space. E.g., using the finger joint angles to represent the posture, the number of degrees of freedom is about 27. Tracking in this high- dimensional space is computationally impossible. However, finger movement is highly constrained. We propose to use a 3D model-based approach, where the model will include both posture and motion constraints. Tracking is done by matching the image of the real hand and that of the predicted view of the hand from the 3D model. The crux is to use the constraints to reduce the search time. By the end of the proposed period, we expect to have a good constraint representation and a good real-time hand/finger tracking algorithm, and to have demonstrated real-time tracking for the application of virtual object manipulation.