Colour Helmholtz Stereopsis for Reconstruction of Dynamic Scenes with Arbitrary Unknown Reflectance
Colour Helmholtz Stereopsis for Reconstruction of Dynamic Scenes with Arbitrary Unknown Reflectance
复制标题
DOI：
10.1007/s11263-016-0951-0
复制
发表时间：
2016-09
影响因子：
19.5
通讯作者：
Nadejda Roubtsova;Jean-Yves Guillemaut
中科院分区：
文献类型：
--
作者：
Nadejda Roubtsova;Jean-Yves Guillemaut
亥姆霍兹立体视觉是一种用于重建具有任意反射特性的场景的强大技术。然而，由于要求顺序捕获对等的图像对（即相机和光源位置相互交换的两幅图像），以前的配方仅限于静态对象。本文提出了彩色亥姆霍兹立体视——一种基于波长复用的亥姆霍兹立体视框架。为了解决多光谱数据采集带来的新挑战，提出的彩色亥姆霍兹立体视觉管道独特地结合了针对多相机/光源对的量身定制的光度校准，时空表面色度校准的新程序和最先进的贝叶斯公式，以便从最少数量的倒数对进行精确重建。在这个框架中，反射率在空间上不受色度和依赖于照明入射和视角的方向分量的约束。提出的方法首次使用由少量摄像机和光源组成的实际采集装置，对具有任意未知和空间变化反射率的动态场景进行建模。实验结果证明了该技术在各种静态和动态场景下的准确性和灵活性，这些场景具有任意未知的BRDF和从均匀到任意和空间变化的色度。
Helmholtz Stereopsis is a powerful technique for reconstruction of scenes with arbitrary reflectance properties. However, previous formulations have been limited to static objects due to the requirement to sequentially capture reciprocal image pairs (i.e. two images with the camera and light source positions mutually interchanged). In this paper, we propose colour Helmholtz Stereopsis—a novel framework for Helmholtz Stereopsis based on wavelength multiplexing. To address the new set of challenges introduced by multispectral data acquisition, the proposed Colour Helmholtz Stereopsis pipeline uniquely combines a tailored photometric calibration for multiple camera/light source pairs, a novel procedure for spatio-temporal surface chromaticity calibration and a state-of-the-art Bayesian formulation necessary for accurate reconstruction from a minimal number of reciprocal pairs. In this framework, reflectance is spatially unconstrained both in terms of its chromaticity and the directional component dependent on the illumination incidence and viewing angles. The proposed approach for the first time enables modelling of dynamic scenes with arbitrary unknown and spatially varying reflectance using a practical acquisition set-up consisting of a small number of cameras and light sources. Experimental results demonstrate the accuracy and flexibility of the technique on a variety of static and dynamic scenes with arbitrary unknown BRDF and chromaticity ranging from uniform to arbitrary and spatially varying.