Metameric Inpainting for Image Warping.
Metameric Inpainting for Image Warping.
复制标题
用于图像变形的同色异谱修复。
DOI：
10.1109/tvcg.2022.3216712
复制
发表时间：
2023
影响因子：
5.2
通讯作者：
Dos Anjos RK
中科院分区：
文献类型：
--
作者：
Dos Anjos RK
图像扭曲，一个图像到另一个的每像素变形，是沉浸式视觉体验（如虚拟现实或增强现实）的重要组成部分。图像扭曲的主要问题是不遮挡，其中输入图像的遮挡（因此未知）部分将被要求组成输出图像。我们介绍了一种新的图像变形方法，同色异谱图像修复-在人类视觉感知的基础上实时填充漏洞的方法。我们的方法估计从他们的邻居的无遮挡区域的图像特征统计。这些统计数据被修复并用于实时合成视觉效果，这些视觉效果对研究参与者来说不太明显，特别是在周边视觉中。我们的方法比标准的结构化图像修复方法提供了速度上的改进，同时比基于颜色的修复（如推拉）提高了真实感。因此，我们的工作为未来的应用铺平了道路，例如基于深度图像的渲染，6-DoF 360渲染和远程渲染流。
Image-warping, a per-pixel deformation of one image into another, is an essential component in immersive visual experiences such as virtual reality or augmented reality. The primary issue with image warping is disocclusions, where occluded (and hence unknown) parts of the input image would be required to compose the output image. We introduce a new image warping method,Metameric image inpainting- an approach for hole-filling in real-time with foundations in human visual perception. Our method estimates image feature statistics of disoccluded regions from their neighbours. These statistics are inpainted and used to synthesise visuals in real-time that are less noticeable to study participants, particularly in peripheral vision. Our method offers speed improvements over the standard structured image inpainting methods while improving realism over colour-based inpainting such as push-pull. Hence, our work paves the way towards future applications such as depth image-based rendering, 6-DoF 360 rendering, and remote render-streaming.