Joint texture-depth pixel inpainting of disocclusion holes in virtual view synthesis
Joint texture-depth pixel inpainting of disocclusion holes in virtual view synthesis
复制标题
DOI：
10.1109/apsipa.2013.6694249
复制
发表时间：
2013-10
期刊：
影响因子：
--
通讯作者：
S. Reel;Gene Cheung;P. Wong;L. Dooley
中科院分区：
文献类型：
--
作者：
S. Reel;Gene Cheung;P. Wong;L. Dooley
传输来自一个或多个参考视图的纹理和深度图使得用户能够自由地选择虚拟视点，从虚拟视点合成图像以经由基于深度图像的渲染（DIBR）进行观察。然而，在每个DIBR合成图像中，仍然存在具有与参考图像中的视图被遮挡的空间区域相对应的缺失像素的去遮挡孔。为了完成这些漏洞，与以前的方案严重依赖（和不切实际）的可用性的高质量的深度图在虚拟视图中的相应的纹理图的修复，在本文中，提出了一种新的联合纹理深度修复（JTDI）算法，同时填补缺失的纹理和深度像素。具体来说，我们首先使用可用的部分深度信息来计算优先级项，以确定下一个目标像素补丁在一个去遮挡洞修复。然后，在通过用于纹理修复的模板匹配识别已知像素区域中的最佳匹配纹理块之后，将对应深度块的方差复制到用于深度修复的目标深度块。实验结果表明，JTDI优于两个以前的修复方案，要么不使用可用的深度信息在修复过程中，或依赖于一个良好的深度图在虚拟视图的良好的修复性能的可用性。
Transmitting texture and depth maps from one or more reference views enables a user to freely choose virtual viewpoints from which to synthesize images for observation via depth-image-based rendering (DIBR). In each DIBR-synthesized image, however, there remain disocclusion holes with missing pixels corresponding to spatial regions occluded from view in the reference images. To complete these holes, unlike previous schemes that rely heavily (and unrealistically) on the availability of a high-quality depth map in the virtual view for inpainting of the corresponding texture map, in this paper a new Joint Texture-Depth Inpainting (JTDI) algorithm is proposed that simultaneously fill in missing texture and depth pixels. Specifically, we first use available partial depth information to compute priority terms to identify the next target pixel patch in a disocclusion hole for inpainting. Then, after identifying the best-matched texture patch in the known pixel region via template matching for texture inpainting, the variance of the corresponding depth patch is copied to the target depth patch for depth inpainting. Experimental results show that JTDI outperforms two previous inpainting schemes that either does not use available depth information during inpainting, or depends on the availability of a good depth map at the virtual view for good inpainting performance.