Shape Estimation Using Polarization and Shading from Two Views
Shape Estimation Using Polarization and Shading from Two Views
复制标题
DOI：
10.1109/tpami.2007.1099
复制
发表时间：
2007-11
影响因子：
23.6
通讯作者：
G. Atkinson;E. Hancock
中科院分区：
文献类型：
--
作者：
G. Atkinson;E. Hancock
本文提出了一种新的方法，用于三维表面重建，利用偏振和阴影信息从两个视图。该方法依赖于使用标准数码相机和线性偏振器获得的偏振数据。菲涅尔理论被用来处理原始图像，并获得表面法线的初始估计，假设反射类型是漫反射。基于这一思想，本文提出了两个新的贡献的问题的表面重建。第一个是一种技术，以提高表面正常的估计，将阴影信息的方法。这是使用稳健的统计来估计所测量的像素亮度如何取决于表面取向来完成的。这给出了对象材质反射函数的估计值，该函数用于细化曲面法线的估计值。第二个贡献是使用改进的估计来建立对象的两个视图之间的对应关系。为此，从每个视图中提取表面补丁，然后通过基于表面法线估计和局部地形特性最小化能量泛函来对齐。然后使用不同补丁对的最佳对准参数来建立立体对应。这个过程会产生一个明确的表面法线场，可以将其积分以恢复表面深度。我们的技术最适合于光滑的非金属表面。它补充了现有的立体声算法，因为它不需要显着的表面特征来获得对应关系。一组广泛的实验，产生重建的对象和反射函数，提出和地面真相相比。
This paper presents a novel method for 3D surface reconstruction that uses polarization and shading information from two views. The method relies on the polarization data acquired using a standard digital camera and a linear polarizer. Fresnel theory is used to process the raw images and to obtain initial estimates of surface normals, assuming that the reflection type is diffuse. Based on this idea, the paper presents two novel contributions to the problem of surface reconstruction. The first is a technique to enhance the surface normal estimates by incorporating shading information into the method. This is done using robust statistics to estimate how the measured pixel brightnesses depend on the surface orientation. This gives an estimate of the object material reflectance function, which is used to refine the estimates of the surface normals. The second contribution is to use the refined estimates to establish correspondence between two views of an object. To do this, surface patches are extracted from each view, which are then aligned by minimising an energy functional based on the surface normal estimates and local topographic properties. The optimum alignment parameters for different patch pairs are then used to establish stereo correspondence. This process results in an unambiguous field of surface normals, which can be integrated to recover the surface depth. Our technique is most suited to smooth nonmetallic surfaces. It complements existing stereo algorithms since it does not require salient surface features to obtain correspondences. An extensive set of experiments, yielding reconstructed objects and reflectance functions, are presented and compared to ground truth.