Joint Bit Allocation and Rate Control for Coding Multi-View Video Plus Depth Based 3D Video
Joint Bit Allocation and Rate Control for Coding Multi-View Video Plus Depth Based 3D Video
复制标题
DOI：
10.1109/tmm.2013.2269897
复制
发表时间：
2013-12
影响因子：
7.3
通讯作者：
F. Shao;G. Jiang;Weisi Lin;Mei Yu;Qionghai Dai
中科院分区：
文献类型：
--
作者：
F. Shao;G. Jiang;Weisi Lin;Mei Yu;Qionghai Dai
在三维(3D)视频编码中，纹理视频和深度图的失真都会影响合成的虚拟视图的质量。因此，在总码率约束下，纹理和深度信息之间的有效比特分配对于3D视频编码是非常重要的。本文的主要技术贡献是建立了3D视频编码中优化资源分配的视点合成质量公式，因为这样的质量对系统的最终用户(即观众)来说是最重要的；具体地说，提出了一种新的基于多视点视频加深度(MVD)的3D视频编码的联合比特分配和码率控制方法。我们首先推导了一个视图合成失真模型来表征纹理视频和深度图的编码失真对合成的虚拟视图的影响。在此模型的基础上，我们推导了一个码率失真模型来描述码率和视点合成失真之间的关系，并通过求解相关的优化问题自适应地建立了纹理和深度之间的最优码率比。最后，在视点级别、纹理/深度级别和帧级别上执行了码率控制算法。实验结果表明，与其他方法相比，本文提出的比特分配方法获得了更高的视图合成性能。此外，所提出的码率控制方法能够准确地控制码率以满足总码率约束。
In three-dimensional (3D) video coding, distortion in texture video and depth maps can all affect the quality of the synthesized virtual views. Therefore, under the total bitrate constraint, effective bit allocation between texture and depth information is very important for 3D video coding. In this paper, the major technical contribution is to formulate view synthesis quality for optimal resource allocation in 3D video coding, since such quality is what that matters most to the ultimate user (i.e., the viewer) of the system; to be more specific, a new joint bit allocation and rate control method for multi-view video plus depth (MVD) based 3D video coding is proposed accordingly. We firstly derive a view synthesis distortion model to characterize the effect of coding distortion of texture video and depth maps on the synthesized virtual views. Based on this model, we derive a rate-distortion model to characterize the relationship between the bitrate and the view synthesis distortion, and the optimal bitrate ratio between texture and depth is established adaptively by solving the associated optimization problem. Finally, the rate control algorithm is performed on view level, texture/depth level and frame level. Experimental results show that compared with other methods, the proposed bit allocation method obtains higher performance of view synthesis. Moreover, the proposed rate control method can accurately control the bitrate to satisfy the total bitrate constraint.