A Depth-Bin-Based Graphical Model for Fast View Synthesis Distortion Estimation
A Depth-Bin-Based Graphical Model for Fast View Synthesis Distortion Estimation
复制标题
用于快速视图合成失真估计的基于深度箱的图形模型
DOI：
10.1109/tcsvt.2018.2844743
复制
发表时间：
2019
影响因子：
8.4
通讯作者：
Wang Anhong
中科院分区：
文献类型：
--
作者：
Jin Jian;Liang Jie;Zhao Yao;Lin Chunyu;Yao Chao;Wang Anhong
在3-D视频通信中，纹理和深度序列可能会发生传输错误，如丢包。根据基于深度图像的绘制方法，将这些序列用于合成虚拟视图时，会产生视图合成失真。采用一种基于深度值的图形模型(DVGM)来实现准确的丢包式视点综合失真估计(VSDE)。然而，DVGM在深度-值级上模拟复杂的视图合成过程，计算量大，难以在实际中应用。本文提出了一种基于深度面元的图形模型(DBGM)，该模型在深度面元级别对复杂的视景合成过程进行建模，可用于具有一维平行相机配置的快速VSDE。为此，将多个深度值融合到一个深度箱中，并提出了一种面向深度箱的规则来处理翘曲竞争过程。然后，对深度面元的性质进行了分析，并利用深度面元形成了DBGM。最后，开发了一种转换算法，将每个像素的输入深度值概率分布转换为深度面元格式。实验结果表明，在准确率完全相同的情况下，我们提出的方法比DVGM算法快8-32倍，所需内存减少17%-60%。
During 3-D video communication, transmission errors, such as packet loss, could happen to the texture and depth sequences. View synthesis distortion will be generated when these sequences are used to synthesize virtual views according to the depth-image-based rendering method. A depth-value-based graphical model (DVGM) has been employed to achieve the accurate packet-loss-caused view synthesis distortion estimation (VSDE). However, the DVGM models the complicated view synthesis processes at depth-value level, which costs too much computation and is difficult to be applied in practice. In this paper, a depth-bin-based graphical model (DBGM) is developed, in which the complicated view synthesis processes are modeled at depth-bin level so that it can be used for the fast VSDE with 1-D parallel camera configuration. To this end, several depth values are fused into one depth bin, and a depth-bin-oriented rule is developed to handle the warping competition process. Then, the properties of the depth bin are analyzed and utilized to form the DBGM. Finally, a conversion algorithm is developed to convert the per-pixel input depth value probability distribution into the depth-bin format. Experimental results verify that our proposed method is 8– $32\times $ faster and requires 17%–60% less memory than the DVGM, with exactly the same accuracy.