Efficient Multi‐image Correspondences for On‐line Light Field Video Processing
Efficient Multi‐image Correspondences for On‐line Light Field Video Processing
复制标题
用于在线光场视频处理的高效多图像对应
DOI：
10.1111/cgf.13037
复制
发表时间：
2016
影响因子：
2.5
通讯作者：
Tobias Ritschel
中科院分区：
文献类型：
--
作者：
Lukasz Dabala;M. Ziegler;P. Didyk;Frederik Zilly;J. Keinert;K. Myszkowski;H. Seidel;Przemyslaw Rokita;Tobias Ritschel
光场视频表达了动画场景的全部视觉信息，但它们的剪切尺寸通常使捕获、处理和显示成为离线过程，即。即，初始捕获和最终显示之间的时间远非实时。在本文中，我们针对此类处理流程中的关键瓶颈之一提出了一种解决方案，即对于许多视图来说可能是可靠的深度重建。这是通过一种新颖的对应算法实现的，该算法将视频流从稀疏的现成摄像机阵列转换为动画深度图阵列。该算法基于经典多分辨率 Lucas-Kanade 对应算法（从一对图像到整个数组）的推广。特殊的图像间置信度整合允许从某些位置和某些视图中的不可靠匹配中恢复。它可以在大规模并行硬件中有效实现，从而允许交互式计算。由此产生的深度质量和计算性能优于其他最先进的光场到深度方法以及立体匹配技术。这项工作的另一个成果是使用稀疏相机阵列的多种变体捕获的光场视频数据集。
Light field videos express the entire visual information of an animated scene, but their shear size typically makes capture, processing and display an off‐line process, i. e., time between initial capture and final display is far from real‐time. In this paper we propose a solution for one of the key bottlenecks in such a processing pipeline, which is a reliable depth reconstruction possibly for many views. This is enabled by a novel correspondence algorithm converting the video streams from a sparse array of off‐the‐shelf cameras into an array of animated depth maps. The algorithm is based on a generalization of the classic multi‐resolution Lucas‐Kanade correspondence algorithm from a pair of images to an entire array. Special inter‐image confidence consolidation allows recovery from unreliable matching in some locations and some views. It can be implemented efficiently in massively parallel hardware, allowing for interactive computations. The resulting depth quality as well as the computation performance compares favorably to other state‐of‐the art light field‐to‐depth approaches, as well as stereo matching techniques. Another outcome of this work is a data set of light field videos that are captured with multiple variants of sparse camera arrays.
影响因子：
6.2
作者：
Manakov, Alkhazur;Restrepo, John F.;Ihrke, Ivo
通讯作者：
Ihrke, Ivo
登记。
DOI：
10.1007/978-1-4939-7647-8_1
发表时间：
2018
期刊：
Neuromethods
影响因子：
--
作者：
Joshi,AnandA
通讯作者：
Joshi,AnandA