Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion.
Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion.
复制标题
基于遮挡的多层可见性传播合成孔径成像
DOI：
10.3390/s150818965
复制
发表时间：
2015-08-04
期刊：
影响因子：
--
通讯作者：
Ran L
中科院分区：
文献类型：
--
作者：
Yang T;Li J;Yu J;Zhang Y;Ma W;Tong X;Yu R;Ran L
杂乱场景中的严重遮挡给许多计算机视觉应用带来了重大挑战。最近的光场成像系统通过合成孔径成像（SAI）提供新的透视能力以克服遮挡问题。然而，现有的合成孔径成像方法模拟在特定深度层处的聚焦，但是不能产生全聚焦透视图像。替代的图像修复算法可以生成视觉上合理的结果，但不能保证结果的正确性。在本文中，我们提出了一种新的无深度的全聚焦SAI技术的基础上，光场可见性分析。具体来说，我们将场景划分为多个可见性层，以直接处理逐层遮挡，并应用优化框架在多个层之间传播可见性信息。在每一层上，可见性和最佳聚焦深度估计被公式化为多标签能量最小化问题。逐层能量将来自其先前层的所有可见性掩模、多视图强度一致性和深度平滑度约束集成在一起。我们比较我们的方法与国家的最先进的解决方案，和广泛的实验结果表明，我们的方法的有效性和优越性。
Heavy occlusions in cluttered scenes impose significant challenges to many computer vision applications. Recent light field imaging systems provide new see-through capabilities through synthetic aperture imaging (SAI) to overcome the occlusion problem. Existing synthetic aperture imaging methods, however, emulate focusing at a specific depth layer, but are incapable of producing an all-in-focus see-through image. Alternative in-painting algorithms can generate visually-plausible results, but cannot guarantee the correctness of the results. In this paper, we present a novel depth-free all-in-focus SAI technique based on light field visibility analysis. Specifically, we partition the scene into multiple visibility layers to directly deal with layer-wise occlusion and apply an optimization framework to propagate the visibility information between multiple layers. On each layer, visibility and optimal focus depth estimation is formulated as a multiple-label energy minimization problem. The layer-wise energy integrates all of the visibility masks from its previous layers, multi-view intensity consistency and depth smoothness constraint together. We compare our method with state-of-the-art solutions, and extensive experimental results demonstrate the effectiveness and superiority of our approach.