Integration Methods for Reliable Information Extraction from Multiple Color Images

我们研究了通过系统地改变相机参数、虹膜和焦距拍摄的多幅图像的整合方法。研究报告描述了多虹膜和多聚焦图像的分析，并给出了提取可靠场景信息的综合方法，如色度、亮度、边缘、深度等。1.多虹膜彩色图像分析我们提出了一种从不同光圈大小的多幅彩色图像中提取可靠颜色信息的方法。我们还展示了多虹膜彩色图像的其他用途：光源色度的估计和相对深度的推导。2.多聚焦图像的分析我们分析了沿焦点轴的多聚焦图像，得到了两种代表综合信息的图像：一种是累积的散焦图像，其过零点对应于场景的边缘；另一种是空间聚焦图像，可以用来估计边缘的深度。3.多聚焦图像的遮挡边缘特性分析我们提出了一种基于光通量的模糊模型，称为反投影模糊模型，用于分析模糊遮挡边缘的光度特性。利用所提出的模型，我们证明了：(1)如果较远物体的辐射在遮挡边缘周围是均匀的，则遮挡边缘的光学图像与较近物体上的表面边缘的光学图像重合；(2)如果遮挡边缘位于较远物体上，则在遮挡边缘中引入了复杂的局部强度极值，即谷和峰。

We have investigated the integration methods of multiple images taken by systematically varying camera parameters, iris and focus. The research report describes the analyzes of multiiris and multi-focus images and shows integration methods to extract reliable scene information such as chromaticity, brightness, edge, depth, and so on.1.Analysis of Multi-Iris Color ImagesWe proposed a method to obtain the reliable color information, i.e. chromaticity and brightness, from multiple color images taken with different aperture sizes. We also demonstrate other utilities of the multi-iris color images : estimation of light source chromaticity and derivation of relative depth.2.Analysis of Multi-Focus ImagesWe analyzed multi-focus images along the focus axis to yield two types of images representing integrated information ; one is an accumulated defocus image whose zero-crossings correspond to edges of the scene, and the other a spatio-focal image with which the depth of the edges can be estimated.3.Analysis of Occluding Edge Properties in Multi-Focus ImagesWe proposed an optical flux based blurring model named the reversed projection blurring model to analyze photometric properties of blurred occluding edges. Using the proposed model, we showed that (1) the optical image of an occluding edge coincides with that of a surface edge on the nearer object, if the radiance of the farther object is uniform around the occluding edge, (2) complex local intensity extrema, i.e. valleys and peaks, are introduced into an occluding edge, if a surface edge is located on the farther object around the occluding edge.