Fingers and Gesture Recognition with Kinect v2 Sensor
Fingers and Gesture Recognition with Kinect v2 Sensor
复制标题
DOI：
10.1515/itc-2017-0009
复制
发表时间：
2016-09
期刊：
影响因子：
--
通讯作者：
A. Lekova;D. Ryan;R. Davidrajuh
中科院分区：
文献类型：
--
作者：
A. Lekova;D. Ryan;R. Davidrajuh
摘要本文介绍了[3]中提出的手指跟踪和手势识别算法的增强和创新解决方案，该算法基于描述手势的新定义特征，并利用Kinect v2传感器的新跟踪尖端和拇指关节。动态时间规整（DTW）算法用于手势识别。我们通过定义新的3D特征角度来描述手势，并用于训练手势数据库，从而提高了其准确性，尺度和旋转不变性。从深度传感器数据中提取指尖的3D位置，并用于计算向量之间的特征角。Kinect v2提供的拇指、指尖和手关节的3D位置也参与识别阶段。与最新发表的方法进行了比较手指跟踪。通过真实的实验验证了算法的可行性。
Abstract The paper presents enhancements and innovative solutions of the proposed in [3] algorithms for fingers tracking and hand gesture recognition based on new defined features describing hand gestures and exploiting new-tracked tip and thumb joints from Kinect v2 sensor. Dynamic Time Warping (DTW) algorithm is used for gestures recognition. We increased its accuracy, scale and rotational invariance by defining new 3D featuring angles describing gestures and used for training a gesture database. 3D positions for fingertips are extracted from depth sensor data and used for calculation of featuring angles between vectors. The provided by Kinect v2 3D positions for thumb, tip and hand joints also participates during the phases of recognition. A comparison with the latest published approach for finger tracking has been performed. The feasibility of the algorithms have been proven by real experiments.