Texture Plus Depth Video Coding Using Camera Global Motion Information
Texture Plus Depth Video Coding Using Camera Global Motion Information
复制标题
DOI：
10.1109/tmm.2017.2700622
复制
发表时间：
2017-05
影响因子：
7.3
通讯作者：
Fei Cheng;T. Tillo;Jimin Xiao;B. Jeon
中科院分区：
文献类型：
--
作者：
Fei Cheng;T. Tillo;Jimin Xiao;B. Jeon
在视频编码中，传统的运动估计方法对具有摄像机平移运动的视频效果较好，但对其他运动（如旋转运动和小车运动）效果较差。针对纹理加深度的三维视频，提出了一种基于运动信息的三维视频编码方法。利用深度和摄像机的运动信息，将相邻的纹理帧和深度帧投影到当前帧的位置，从而获得摄像机的同步全局运动信息，以帮助编码器提高其率失真性能。然后，将投影帧作为虚拟参考帧添加到参考缓冲区列表中。由于这些虚拟参考帧可能比传统参考帧更类似于当前要编码的帧，因此表示残差所需的比特将减少。实验结果表明，该方案在所有摄像机运动类型、H.264和HEVC标准下的各种场景设置和分辨率下都提高了编码性能。在计算机图形序列下，对于H.264，纹理编码和深度编码的平均增益分别可达2 dB和1 dB。对于HEVC和HD分辨率序列，纹理编码增益达到0.4 dB。对于现实序列，高达0.5 dB增益（H.264）是实现纹理视频，而高达0.7 dB增益是实现深度序列。
In video coding, traditional motion estimation methods work well for videos with camera translational motion, but their efficiency drops for other motions, such as rotational and dolly motions. In this paper, a motion-information-based three-dimensional (3D) video coding method is proposed for texture plus depth 3D video. The synchronized global motion information of the camera is obtained to assist the encoder improve its rate-distortion performance by projecting the temporal neighboring texture and depth frames into the position of the current frame, using the depth and camera motion information. Then, the projected frames are added into the reference buffer list as virtual reference frames. As these virtual reference frames could be more similar to the current to-be-encoded frame than the conventional reference frames, the required bits to represent the residual will be reduced. The experimental results demonstrate that the proposed scheme enhances the coding performance for all camera motion types and for various scene settings and resolutions using H.264 and HEVC standards, respectively. With the computer graphic sequences, for H.264, the average gain of texture and depth coding are up to 2 dB and 1 dB, respectively. For HEVC and HD resolution sequences, the gain of texture coding reaches 0.4 dB. For realistic sequences, up to 0.5 dB gain (H.264) is achieved for the texture video, while up to 0.7 dB gain is achieved for the depth sequences.