Robust Multiview Photometric Stereo Using Planar Mesh Parameterization
Robust Multiview Photometric Stereo Using Planar Mesh Parameterization
复制标题
DOI：
10.1109/tpami.2016.2608944
复制
发表时间：
2017-08
影响因子：
23.6
通讯作者：
Jaesik Park;Sudipta N. Sinha;Y. Matsushita;Yu-Wing Tai;In-So Kweon
中科院分区：
文献类型：
--
作者：
Jaesik Park;Sudipta N. Sinha;Y. Matsushita;Yu-Wing Tai;In-So Kweon
我们提出了一种鲁棒的未经校准的多视点光度立体方法，用于高质量的三维形状重建。在我们的方法中，使用多视图立体方法获得的粗糙初始3D网格使用平面网格参数化技术投影到二维平面域上。我们描述了在参数化二维空间中工作的表面法线估计方法，该方法联合了来自多个视点的所有几何和光度线索。利用估算的表面法线映射，在相同的二维平面域中通过计算最优位移映射来恢复精细的三维网格。我们的方法避免了传统方法中合并依赖于视图的表面法线贴图的需要。我们对各种现实世界的物体进行了评估，这些物体包含镜面反射、多重反照率和复杂的拓扑结构，并在受控和非受控设置下进行了评估，并证明了通过我们的方法可以恢复具有精细几何细节的精确3D网格。
We propose a robust uncalibrated multiview photometric stereo method for high quality 3D shape reconstruction. In our method, a coarse initial 3D mesh obtained using a multiview stereo method is projected onto a 2D planar domain using a planar mesh parameterization technique. We describe methods for surface normal estimation that work in the parameterized 2D space that jointly incorporates all geometric and photometric cues from multiple viewpoints. Using an estimated surface normal map, a refined 3D mesh is then recovered by computing an optimal displacement map in the same 2D planar domain. Our method avoids the need of merging view-dependent surface normal maps that is often required in conventional methods. We conduct evaluation on various real-world objects containing surfaces with specular reflections, multiple albedos, and complex topologies in both controlled and uncontrolled settings and demonstrate that accurate 3D meshes with fine geometric details can be recovered by our method.