Low Bitrate Light Field Compression With Geometry and Content Consistency
Low Bitrate Light Field Compression With Geometry and Content Consistency
复制标题
具有几何和内容一致性的低比特率光场压缩
DOI：
10.1109/tmm.2020.3046860
复制
发表时间：
2022-01-01
影响因子：
7.3
通讯作者：
Shen, Liquan
中科院分区：
文献类型：
--
作者：
Huang, Xinpeng;An, Ping;Shen, Liquan
光场成像可以同时记录光线的位置和方向信息；因此，使用光场数据的结构一致性可以实现数字重新关注和完整的视野扩展 - 无法访问的传统图像函数。为了应对有限的带宽和存储的挑战，必须将如此大量的光场数据压缩到低比特率。但是，当前的压缩解决方案忽略了追求低比特率的光场的内在一致性，从而导致了光场能力的丧失。为了解决此问题，这项工作着重于结构性一致性，以低比特率实现有效的光场压缩。提出的光场压缩方法编码了稀疏选择的子孔径图像（SAI）和与未选择的SAI相对应的差异图。从几何一致性的角度来看，使用颜色引导的改进算法可以改善最初估计的差异图的一致性，从而降低了差异图的比特率。从内容一致性的角度来看，SAI转换的伪序列的一致性通过所提出的基于内容相似的排列算法以及特定的预测结构提高了。因此，稀疏选择的SAI的比特率减少了。实验结果表明，所提出的压缩方法可以降低总比特率，同时保持良好的结构一致性。
Light field imaging can simultaneously record the position and direction information of light rays; thus, digital refocusing and full depth-of-field extension - functions that are inaccessible for conventional images - can be achieved using the structural consistency of light field data. To meet the challenges of limited bandwidth and storage, such vast numbers of light field data must be compressed to a low bitrate. However, current compression solutions ignore the intrinsic consistency of light fields in pursuit of a low bitrate, thereby leading to the loss of light field capabilities. To solve this issue, this work focuses on structural consistency to achieve efficient light field compression with a low bitrate. The proposed light field compression method encodes the sparsely selected sub-aperture images (SAIs) and the disparity maps corresponding to the unselected SAIs. From the perspective of geometry consistency, the consistency of the initially estimated disparity maps is improved by using a color-guided refinement algorithm, thereby reducing the bitrate of the disparity maps. From the perspective of content consistency, the consistency of the SAI-transformed pseudo sequence is improved by the proposed content-similarity-based arrangement algorithm along with a specific prediction structure; thereby, the bitrate of the sparsely selected SAIs is reduced. The experimental results show that the proposed compression method can reduce the total bitrate while preserving good structural consistency.