Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras
Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras
复制标题
DOI：
10.1109/tmm.2012.2229264
复制
发表时间：
2013-02-01
影响因子：
7.3
通讯作者：
Daras, Petros
中科院分区：
文献类型：
--
作者：
Alexiadis, Dimitrios S.;Zarpalas, Dimitrios;Daras, Petros
尽管进行了广泛的研究，但鲁棒、真实且特别快速的物体 3D 重建问题仍然是一项具有挑战性的研究任务。大多数针对实时应用（例如沉浸式现实）的最先进方法主要解决针对给定视点合成中间视图的问题，而不是生成单个完整的 3D 表面。在本文中，我们提出了一种多 Kinect 捕捉系统和一种新颖的方法，用于创建准确、逼真、完整的 3D 重建移动前景对象（例如人类），以便在实时应用中使用。所提出的方法从多个 RGB 深度流生成多个纹理网格，应用从粗到细的配准算法，最后将单独的网格合并为单个 3D 表面。尽管 Kinect 传感器吸引了许多研究人员和家庭爱好者的注意，并且已经出现在互联网上的许多应用中，但已经提出的作品都不能从多个 Kinect 流中实时生成移动物体的完整 3D 模型。我们介绍了捕获设置、校准方法以及所提出的多个网格实时融合算法的细节。所提出的实验结果验证了该方法在 3D 重建质量以及所实现的帧速率方面的有效性。
The problem of robust, realistic and especially fast 3-D reconstruction of objects, although extensively studied, is still a challenging research task. Most of the state-of-the-art approaches that target real-time applications, such as immersive reality, address mainly the problem of synthesizing intermediate views for given view-points, rather than generating a single complete 3-D surface. In this paper, we present a multiple-Kinect capturing system and a novel methodology for the creation of accurate, realistic, full 3-D reconstructions of moving foreground objects, e.g., humans, to be exploited in real-time applications. The proposed method generates multiple textured meshes from multiple RGB-Depth streams, applies a coarse-to-fine registration algorithm and finally merges the separate meshes into a single 3-D surface. Although the Kinect sensor has attracted the attention of many researchers and home enthusiasts and has already appeared in many applications over the Internet, none of the already presented works can produce full 3-D models of moving objects from multiple Kinect streams in real-time. We present the capturing setup, the methodology for its calibration and the details of the proposed algorithm for real-time fusion of multiple meshes. The presented experimental results verify the effectiveness of the approach with respect to the 3-D reconstruction quality, as well as the achieved frame rates.