3D High-Efficiency Video Coding for Multi-View Video and Depth Data
3D High-Efficiency Video Coding for Multi-View Video and Depth Data
复制标题
DOI：
10.1109/tip.2013.2264820
复制
发表时间：
2013-09-01
影响因子：
10.6
通讯作者：
Wiegand, Thomas
中科院分区：
文献类型：
--
作者：
Mueller, Karsten;Schwarz, Heiko;Wiegand, Thomas
本文描述用于多视图视频和深度数据的译码的高效视频译码（HEVC）标准的扩展。除了已知的残差补偿预测的概念之外，还开发和集成了用于对依赖视频视图进行编码的视图间运动参数和视图间残差预测。此外，对于深度编码，新的帧内编码模式、修改的运动补偿和运动矢量编码以及运动参数继承的概念是HEVC扩展的一部分。一种新颖的编码器控制使用视图合成优化，这保证了可以基于解码数据生成高质量的中间视图。比特流格式支持部分比特流的提取，使得可以从单个比特流解码传统的2D视频、立体视频和全多视图视频加深度格式。客观和主观的结果，表明所提出的方法提供了50%的比特率节省相比，HEVC联播和20%相比，一个简单的多视图扩展的HEVC没有新开发的编码工具。
This paper describes an extension of the high efficiency video coding (HEVC) standard for coding of multi-view video and depth data. In addition to the known concept of disparity-compensated prediction, inter-view motion parameter, and inter-view residual prediction for coding of the dependent video views are developed and integrated. Furthermore, for depth coding, new intra coding modes, a modified motion compensation and motion vector coding as well as the concept of motion parameter inheritance are part of the HEVC extension. A novel encoder control uses view synthesis optimization, which guarantees that high quality intermediate views can be generated based on the decoded data. The bitstream format supports the extraction of partial bitstreams, so that conventional 2D video, stereo video, and the full multi-view video plus depth format can be decoded from a single bitstream. Objective and subjective results are presented, demonstrating that the proposed approach provides 50% bit rate savings in comparison with HEVC simulcast and 20% in comparison with a straightforward multi-view extension of HEVC without the newly developed coding tools.