Timing-Based Local Descriptor for Dynamic Surfaces

Timing-Based Local Descriptor for Dynamic Surfaces
复制标题

DOI:
10.1109/cvpr.2014.60
复制
发表时间:
2014-06
期刊:
2014 IEEE Conference on Computer Vision and Pattern Recognition
影响因子:
--
通讯作者:
Tony Tung;T. Matsuyama
Tony Tung;T. Matsuyama
中科院分区:
其他
文献类型:
--
作者:
Tony Tung;T. Matsuyama

文献摘要

相似文献

在本文中,我们提出了第一个局部描述符设计的动态表面。动态表面是可以经历非刚性变形的表面(例如,人体表面)。使用最先进的技术,可以准确地重建动态表面上的细节,如衣服褶皱或面部表情。因此,各种结果(例如,表面刚性或弹性)可以通过表面元素的微观分类来获得。我们提出了一个基于时间的描述模型的表面内在属性的局部时空变化。低级描述符使用线性动态系统(LDS)的时序结构对相邻关键点的局部事件动态之间的间隙进行编码。我们还介绍了袋的时间(BoT)的范例表面动力学表征。在合成和真实世界的数据集上进行实验。我们表明,所提出的描述符可用于具有挑战性的动态表面分类和分割方面的表面关键点的刚性。
In this paper, we present the first local descriptor designed for dynamic surfaces. A dynamic surface is a surface that can undergo non-rigid deformation (e.g., human body surface). Using state-of-the-art technology, details on dynamic surfaces such as cloth wrinkle or facial expression can be accurately reconstructed. Hence, various results (e.g., surface rigidity, or elasticity) could be derived by microscopic categorization of surface elements. We propose a timing-based descriptor to model local spatiotemporal variations of surface intrinsic properties. The low-level descriptor encodes gaps between local event dynamics of neighboring keypoints using timing structure of linear dynamical systems (LDS). We also introduce the bag-of-timings (BoT) paradigm for surface dynamics characterization. Experiments are performed on synthesized and real-world datasets. We show the proposed descriptor can be used for challenging dynamic surface classification and segmentation with respect to rigidity at surface keypoints.