Variational Light Field Analysis for Disparity Estimation and Super-Resolution
Variational Light Field Analysis for Disparity Estimation and Super-Resolution
复制标题
DOI：
10.1109/tpami.2013.147
复制
发表时间：
2014-03-01
影响因子：
23.6
通讯作者：
Goldluecke, Bastian
中科院分区：
文献类型：
--
作者：
Wanner, Sven;Goldluecke, Bastian
我们开发了一个连续的框架分析的4D光场，并描述了新的变分方法的视差重建以及空间和角度的超分辨率。视差图估计本地使用核平面图像分析，而不需要昂贵的匹配成本最小化。该方法工作速度快，固有的亚像素精度，因为没有离散化的视差空间是必要的。在变分框架中，我们采用视差图来生成场景的超分辨新视图，这对应于在空间和角度方向上增加4D光场的采样率。与以前的工作相比，我们制定的问题，视图合成作为一个连续的逆问题，这使我们能够正确地考虑到由场景几何变换引起的透视效果。所有优化问题都是用最先进的凸松弛技术解决的。我们测试我们的算法在一些现实世界的例子，以及我们的新的基准数据集的光场，并比较结果的多视图立体方法。所提出的方法是更快，以及更准确。数据集和源代码在线提供，以供进一步评估。
We develop a continuous framework for the analysis of 4D light fields, and describe novel variational methods for disparity reconstruction as well as spatial and angular super-resolution. Disparity maps are estimated locally using epipolar plane image analysis without the need for expensive matching cost minimization. The method works fast and with inherent subpixel accuracy since no discretization of the disparity space is necessary. In a variational framework, we employ the disparity maps to generate super-resolved novel views of a scene, which corresponds to increasing the sampling rate of the 4D light field in spatial as well as angular direction. In contrast to previous work, we formulate the problem of view synthesis as a continuous inverse problem, which allows us to correctly take into account foreshortening effects caused by scene geometry transformations. All optimization problems are solved with state-of-the-art convex relaxation techniques. We test our algorithms on a number of real-world examples as well as our new benchmark data set for light fields, and compare results to a multiview stereo method. The proposed method is both faster as well as more accurate. Data sets and source code are provided online for additional evaluation.