Temporally Coherent Segmentation of 3D Reconstructions
Temporally Coherent Segmentation of 3D Reconstructions
复制标题
DOI：
--
复制
发表时间：
2010-05
期刊：
影响因子：
--
通讯作者：
Kiran Varanasi;Edmond Boyer
中科院分区：
文献类型：
--
作者：
Kiran Varanasi;Edmond Boyer
在本文中，我们解决了在不同的时间帧上对单独重建的进化3D场景进行一致分割的问题。近年来，多视点三维物体的空间重建问题得到了广泛的研究。存在各种方法来将真实演员的表现捕捉到基于体素或基于网格的表示中。然而，在不了解被观察场景的性质的情况下，这样的重建会受到诸如孔洞和拓扑不一致等伪影的影响。我们探讨了以时间连贯的方式分割这种重建的问题，将其分解成刚性移动的部分。我们使用基于网格的表示法，尽管我们的方法也可以扩展到其他3D表示法。与相关工作不同的是，我们的方法独立于被观察的场景，并且可以处理多个演员之间的交互。我们也不需要先验的运动估计，这是我们在分割场景时同时计算的。我们将每个重建的场景单独分割成近似凸起的部分，并通过序列上的刚性运动估计来计算它们的可靠性。我们最终将这些不同的部分合并在一起，形成对序列的整体和一致的分割。我们介绍了在公开可用的数据集上的结果。
In this paper, we address the problem of segmenting consistently an evolving 3D scene reconstructed individually at different time-frames. The spatial reconstruction of 3D objects from multiple views has been studied extensively in the recent past. Various approaches exist to capture the performance of real actors into voxel-based or mesh-based representations. However, without any knowledge about the nature of the scene being observed, such reconstructions suffer from artifacts such as holes and topological inconsistencies. We explore the problem of segmenting such reconstructions in a temporally coherent manner, as a decomposition into rigidly moving parts. We work with mesh-based representations, though our method can be extended to other 3D representations as well. Unlike related works, our method is independent of the scene being observed, and can handle multiple actors interacting with each other. We also do not require an 'a priori' motion-estimate, which we compute simultaneously as we segment the scene. We individually segment each of the reconstructed scenes into approximately convex parts, and compute their reliability through rigid motion estimates over the sequence. We finally merge these various parts together into a holistic and consistent segmentation over the sequence. We present results on publicly available data sets.