Tracking of object deformations in color and depth video: deformation models and applications
Tracking of object deformations in color and depth video: deformation models and applications
复制标题
DOI：
10.1117/12.2190780
复制
发表时间：
2015-06
期刊：
影响因子：
--
通讯作者：
Andreas Jordt;Stefan Reinhold;R. Koch
中科院分区：
文献类型：
--
作者：
Andreas Jordt;Stefan Reinhold;R. Koch
基于彩色图像数据的变形跟踪研究在过去的15年里一直受到广泛的关注。此外，使用诸如Microsoft Kinect的深度传感器，允许通过添加深度信息来减轻当试图仅在彩色图像上解决变形跟踪任务时出现的模糊性问题。然而，颜色和深度数据的融合并不是直接的，并且由于缺乏通用的变形模型，变形跟踪任务仍然是不适定的。通常通过为手头的任务提供特殊的变形函数来规避该问题，例如，基于三角形的用于重建人或基于三角形的用于跟踪平面表面。在这篇文章中，我们总结了在深度和彩色视频变形跟踪的合成分析（AbS）方法，并展示了一些成功的应用程序的专门变形功能。为了克服基于NURBS的变形跟踪的问题，我们提出了一种新的基于测地线RBF的变形模型，它可以适应任何表面拓扑和形状，同时保持变形参数的数量低。给出了不同拓扑结构的对象的变形示例，显示了所提出的模型的多功能性和效率。
The research on deformation tracking based on color image data has continuously gained a wide interest in the last 15 years. In addition, using depth sensors such as the Microsoft Kinect, allows to mitigate the ambiguity problems that arise when trying to solve the deformation tracking tasks on color images only, by adding depth information. However, the fusion of color and depth data is not straight forward, and the deformation tracking task is still ill-posed due to the lack of a general deformation model. The problem is usually circumvented by providing special deformation functions for the task at hand, e.g., skeleton-based for reconstructing people or triangle-based for tracking planar surfaces. In this article we summarize the Analysis by Synthesis (AbS) approach for deformation tracking in depth and color video and show some successful applications of specialized deformation functions. To overcome the issues with NURBS based deformation tracking we propose a new geodesic RBF-based deformation model, which can adapt to any surface topology and shape, while keeping the number of deformation parameters low. Example deformations for objects of different topologies are given, showing the versatility and efficiency of the proposed model.