Highly Efficient Multiview Depth Coding Based on Histogram Projection and Allowable Depth Distortion
Highly Efficient Multiview Depth Coding Based on Histogram Projection and Allowable Depth Distortion
复制标题
基于直方图投影和允许深度畸变的高效多视图深度编码
DOI：
10.1109/tip.2020.3036760
复制
发表时间：
2020-11
影响因子：
10.6
通讯作者：
Yo-Sung Ho
中科院分区：
文献类型：
--
作者：
Yun Zhang;Linwei Zhu;Raouf Hamzaoui;Sam Kwong;Yo-Sung Ho
在3D视频系统中表示视差、深度值和渲染位置的精度之间的不匹配导致深度图表示中的冗余。在本文中，我们提出了一种高效的多视图深度编码方案的基础上的深度直方图投影（DHP）和允许的深度失真（ADD）的视图合成。首先，DHP利用从立体匹配生成的深度图的稀疏表示来减少来自深度编码中的INTER和INTRA预测的残余误差。从理论上分析了基于DHP的无损深度编码的率失真代价，为基于DHP的无损深度编码提供了数学基础。然后，由于深度值和绘制位置之间的不匹配，在视图合成中它们之间存在多对一的映射关系，这导致了ADD模型。基于该ADD模型和DHP，提出了具有无损视图合成质量的深度编码，以进一步提高深度编码的压缩性能，同时保持相同的合成视频质量。实验结果表明，所提出的基于DHP的深度编码可以实现20.66%至19.52%的无损编码的多视图高效率视频编码（MV-HEVC）与不同的图片组的平均比特率节省。此外，我们的深度编码的基础上DHP和ADD实现了46.69%，34.12%和28.68%的平均深度比特率减少无损视图合成质量时，渲染精度从整数，半到四分之一像素，分别。我们在3D-HEVC、HEVC帧内编码和JPEG 2000平台上获得了无损深度编码的类似增益。
Mismatches between the precisions of representing the disparity, depth value and rendering position in 3D video systems cause redundancies in depth map representations. In this paper, we propose a highly efficient multiview depth coding scheme based on Depth Histogram Projection (DHP) and Allowable Depth Distortion (ADD) in view synthesis. Firstly, DHP exploits the sparse representation of depth maps generated from stereo matching to reduce the residual error from INTER and INTRA predictions in depth coding. We provide a mathematical foundation for DHP-based lossless depth coding by theoretically analyzing its rate-distortion cost. Then, due to the mismatch between depth value and rendering position, there is a many-to-one mapping relationship between them in view synthesis, which induces the ADD model. Based on this ADD model and DHP, depth coding with lossless view synthesis quality is proposed to further improve the compression performance of depth coding while maintaining the same synthesized video quality. Experimental results reveal that the proposed DHP based depth coding can achieve an average bit rate saving of 20.66% to 19.52% for lossless coding on Multiview High Efficiency Video Coding (MV-HEVC) with different groups of pictures. In addition, our depth coding based on DHP and ADD achieves an average depth bit rate reduction of 46.69%, 34.12% and 28.68% for lossless view synthesis quality when the rendering precision varies from integer, half to quarter pixels, respectively. We obtain similar gains for lossless depth coding on the 3D-HEVC, HEVC Intra coding and JPEG2000 platforms.
登录
查看更多内容
基于合成视频感知质量的高效 3D 深度编码
影响因子：
10.6
作者：
Zhang Yun;Yang Xiaoxiang;Liu Xiangkai;Zhang Yongbing;Jiang Gangyi;Kwong Sam
通讯作者：
Kwong Sam
DOI：
10.1109/icme.2016.7552984
发表时间：
2016-07
期刊：
2016 IEEE International Conference on Multimedia and Expo (ICME)
影响因子：
--
作者：
Shampa Shahriyar;M. Murshed;Mortuza Ali;M. Paul
通讯作者：
Shampa Shahriyar;M. Murshed;Mortuza Ali;M. Paul
影响因子：
3.9
作者：
O. Stankiewicz;K. Wegner;M. Domański
通讯作者：
O. Stankiewicz;K. Wegner;M. Domański
DOI：
10.1109/dcc.2018.00062
发表时间：
2018-03
期刊：
2018 Data Compression Conference
影响因子：
--
作者：
M. Georgiev;A. Gotchev
通讯作者：
M. Georgiev;A. Gotchev
DOI：
10.1109/tcsvt.2019.2897403
发表时间：
2020-03
影响因子：
8.4
作者：
Shampa Shahriyar;M. Murshed;Mortuza Ali;M. Paul
通讯作者：
Shampa Shahriyar;M. Murshed;Mortuza Ali;M. Paul