Separating Transparent Layers and Photometric Modeling

透过窗户看去，窗户后面的物体经常被另一个物体的反射所干扰。构建虚拟博物馆的必要技术之一是测量布置在玻璃/亚克力陈列柜中的艺术品而不将艺术品从陈列柜中取出的技术。为了解决这些问题，我们开发了一种分离两幅图像的混合图像的方法，一种分离任意数量图像的混合图像的方法，以及一种光度立体方法。第一种方法是基于属性层对输入图像中的边缘进行分类，并将单图像分解为两层图像的问题形式化为基于该分类更容易解决的优化问题，然后用确定性退火法求解该优化问题。分离任意数目的图像的混合的第二种方法实现了从具有未知系数的一组线性混合中盲分离任意数目的图像。该方法首先在一幅图像和一组多幅图像之间引入了一种新的多重相关性。然后，这种多重相关性导致我们提供一组用于更新每个图像混合的联立线性方程。最后，通过在解方程组和循环排列图像混合之间迭代来恢复源图像。第三种光度立体方法估计布置在透明陈列柜内的艺术品的形状和反射率。如果我们照亮展示柜，光线会在其表面反射，因此，我们不能按原样应用传统的光度立体。该方法采用五光测光立体，在光被反射到展示柜的情况下，估计具有镜面的物体的形状和反射率。

Looking through a window, the object behind the window is often disturbed by a reflection of another object One of the necessary techniques for constructing virtual museum is the technique to measure the artwork arranged inside a glass/acrylic display case without bringing the artwork out from the display case. To solve these problems, we developed a method of separating mixtures of two images, a method of separating mixtures of an arbitrary number of images, and a photometric stereo method. The first method of separating mixtures of two images is realized by classifying edges in the input image based on the belonging layer and formalizing the problem of decomposing the single image into two layer images as an optimization problem easier to solve based on this classification, and then solving this optimization with a deterministic annealing. The second method of separating mixtures of an arbitrary number of images accomplishes the blind separation of an arbitrary number of images from a set of their linear mixtures with unknown coefficients. This method first introduces a novel multiple correlation between one image and a set of multiple images. Then this multiple correlation leads us to provide a set of simultaneous linear equations for updating each mixture of images. Finally, source images are recovered by iterating between solving the sets of equations and cyclically permuting the mixtures of images. The third photometric stereo method estimates the shape and the reflectance of the artwork arranged inside a transparent display case. If we illuminate the display case, the light will reflect at its surface, thus, we cannot apply conventional photometric stereo as is. This method adopts a five-light photometric stereo that estimates the shape and the reflectance of the object which has specularities, under the circumstances that the light is reflected at the display case.