Light Field Image Processing: An Overview
Light Field Image Processing: An Overview
复制标题
DOI：
10.1109/jstsp.2017.2747126
复制
发表时间：
2017-10-01
影响因子：
7.5
通讯作者：
Liu, Yebin
中科院分区：
文献类型：
--
作者：
Wu, Gaochang;Masia, Belen;Liu, Yebin
光场成像已经成为一种允许从我们的世界捕获更丰富的视觉信息的技术。与传统摄影相反，传统摄影捕捉场景中整合角域的光的2D投影，光场收集来自所有方向上的射线的辐射，解复用传统摄影中丢失的角信息。一方面，这种视觉数据的高维表示为场景理解提供了强大的能力，并大大提高了传统计算机视觉问题的性能，如深度感知，捕获后重聚焦，分割，视频稳定，材料分类等。另一方面，光场的高维性也在数据捕获，数据压缩，内容编辑和显示。将这两个元素结合在一起，光场图像处理的研究在计算机视觉、计算机图形学和信号处理领域变得越来越流行。在本文中，我们提出了一个全面的概述和讨论在这一领域的研究在过去的20年。我们专注于光场图像处理的各个方面，包括基本的光场表示和理论，采集，超分辨率，深度估计，压缩，编辑，光场显示的处理算法，以及光场数据的计算机视觉应用。
Light field imaging has emerged as a technology allowing to capture richer visual information from our world. As opposed to traditional photography, which captures a 2D projection of the light in the scene integrating the angular domain, light fields collect radiance from rays in all directions, demultiplexing the angular information lost in conventional photography. On the one hand, this higher dimensional representation of visual data offers powerful capabilities for scene understanding, and substantially improves the performance of traditional computer vision problems such as depth sensing, post-capture refocusing, segmentation, video stabilization, material classification, etc. On the other hand, the high-dimensionality of light fields also brings up new challenges in terms of data capture, data compression, content editing, and display. Taking these two elements together, research in light field image processing has become increasingly popular in the computer vision, computer graphics, and signal processing communities. In this paper, we present a comprehensive overview and discussion of research in this field over the past 20 years. We focus on all aspects of light field image processing, including basic light field representation and theory, acquisition, super-resolution, depth estimation, compression, editing, processing algorithms for light field display, and computer vision applications of light field data.