High-Efficiency 3D Depth Coding Based on Perceptual Quality of Synthesized Video
High-Efficiency 3D Depth Coding Based on Perceptual Quality of Synthesized Video
复制标题
基于合成视频感知质量的高效 3D 深度编码
DOI：
10.1109/tip.2016.2615290
复制
发表时间：
2016
影响因子：
10.6
通讯作者：
Kwong Sam
中科院分区：
文献类型：
--
作者：
Zhang Yun;Yang Xiaoxiang;Liu Xiangkai;Zhang Yongbing;Jiang Gangyi;Kwong Sam
在3D视频系统中，不完美的深度图像常常引起令人讨厌的时间噪声，例如，闪烁到合成视频。然而，合成视图的质量通常是衡量峰值信噪比或均方误差，这主要集中在逐帧像素的失真，而不是明显的时间伪影。本文提出了一种新的全参考合成视频质量度量（SVQM）来衡量三维视频系统中合成视频的感知质量。在SVQM算法的基础上，提出了一种改进的率失真优化（RDO）算法，其目标是在给定比特率下最小化合成视图的感知失真。然后，将改进的RDO算法结合到3D高效视频编码（3D-HEVC）软件中，以提高3D深度视频编码效率。实验结果表明，与现有的图像/视频质量评价算法相比，所提出的SVQM指标在评价合成视图时具有更好的一致性。同时，该SVQM度量保持了低复杂度并且易于集成到当前视频编解码器。此外，与最新的3D-HEVC参考模型和现有技术的深度编码算法相比，所提出的基于SVQM的深度编码方案可以分别实现大约15.27%和17.63%的总体比特率降低或在平均SVQM质量分数方面的0.42 dB和0.46 dB增益。
In 3D video systems, imperfect depth images often induce annoying temporal noise, e.g., flickering, to the synthesized video. However, the quality of synthesized view is usually measured with peak signal-to-noise ratio or mean squared error, which mainly focuses on pixelwise frame-by-frame distortion regardless of the obvious temporal artifacts. In this paper, a novel full reference synthesized video quality metric (SVQM) is proposed to measure the perceptual quality of the synthesized video in 3D video systems. Based on the proposed SVQM, an improved rate-distortion optimization (RDO) algorithm is developed with the target of minimizing the perceptual distortion of synthesized view at given bit rate. Then, the improved RDO algorithm is incorporated into the 3D High Efficiency Video Coding (3D-HEVC) software to improve the 3D depth video coding efficiency. Experimental results show that the proposed SVQM metric has better consistency with human perception on evaluating the synthesized view compared with the state-of-the-art image/video quality assessment algorithms. Meanwhile, this SVQM metric maintains low complexity and easy integration to the current video codec. In addition, the proposed SVQM-based depth coding scheme can achieve approximately 15.27% and 17.63% overall bit rate reduction or 0.42- and 0.46-dB gain in terms of SVQM quality score on average as compared with the latest 3D-HEVC reference model and the state-of-the-art depth coding algorithm, respectively.