Real-time dynamic 3-D object shape reconstruction, and high-fidelity texture mapping for 3-D video
Real-time dynamic 3-D object shape reconstruction, and high-fidelity texture mapping for 3-D video
复制标题
DOI：
10.1109/tcsvt.2004.823396
复制
发表时间：
2004-03-01
影响因子：
8.4
通讯作者：
Wada, T
中科院分区：
文献类型：
--
作者：
Matsuyama, T;Wu, XJ;Wada, T
三维（3-D）视频是记录物体的完整的3-D形状、运动和精确的表面纹理的真实的3-D电影。本文首先提出了一种从多视点视频图像重建动态三维物体形状的并行流水线处理方法，通过该方法可以在真实的时间内获得物体行为的完整三维体素表示的时间序列。为了实现实时处理，我们首先介绍了一种基于平面的体求交算法：首先用一组平行的平面切片表示可观察的三维空间，然后将观察到的多视图物体轮廓反投影到每个切片上，最后在每个切片上应用二维轮廓求交。切片然后，我们提出了一种方法来并行化该算法使用PC集群，在那里我们采用五个阶段的流水线处理在每个PC以及切片的并行轮廓相交。给出了几个定量性能评价的结果，以证明所提出的方法的有效性。在论文的后半部分，我们提出了一种在重建的动态三维物体表面上生成视频纹理的算法。我们首先描述了一个朴素的视图无关的绘制方法，并显示其问题。然后，我们通过引入基于图像的绘制技术来改进该方法。实验结果表明，改进的方法可以有效地从任意视点生成高保真的目标图像。
Three-dimensional (3-D) video is a real 3-D movie recording the object's full 3-D shape, motion, and precise surface texture. This paper first proposes a parallel pipeline processing method for reconstructing a dynamic 3-D object shape from multiview video images, by which a temporal series of full 3-D voxel representations of the object behavior can be obtained in real time. To realize the real-time processing, we first introduce a plane-based volume intersection algorithm: first represent an observable 3-D,space by a group of parallel plane slices, then back-project observed multiview object silhouettes onto each slice, and finally apply two-dimensional silhouette intersection on each. slice. Then, we propose a method to parallelize this algorithm using a PC cluster, where we employ five-stage pipeline processing in each PC as well as slice-by-slice parallel silhouette intersection. Several results of the quantitative performance evaluation are given to demonstrate the effectiveness of the proposed methods. In the latter half of the paper, we present an algorithm of generating video texture on the reconstructed dynamic 3-D object surface. We first describe a naive view-independent rendering method and show its problems. Then, we improve the method by introducing image-based rendering techniques. Experimental results demonstrate the effectiveness of the improved method in generating high fidelity object images from arbitrary viewpoints.