Image and Video Inpainting

该项目涉及图像和视频绘画领域，即以不可检测的形式修改图像的技术。从修复受损的绘画和照片，到移除场景中选定的物体，再到发现遮挡背后的数据，图像修复的目标和应用与艺术本身一样古老，数不胜数。对于无线传输和压缩以及来自相机阵列的图像集成等非常规应用，图像绘制也很重要。该项目的目标是开发一种适用于图像、视频、三维和多视图绘画的工作解决方案，并解决诸如图像和胶片恢复和修改、从相机阵列中恢复图像以及填充3D范围数据中的漏洞等应用。通过其与伪装和填补人类盲点的迷人联系，对涂漆的生物学方面也进行了研究。这个项目的理论和应用涵盖了非常广泛的领域，如图像处理、偏微分方程和流体动力学、数值分析、艺术、计算机图形学、娱乐和生物学。填充问题的解决方法是计算待填充区域周围可用时空信息的平滑延拓。这是通过偏微分方程实现的，它结合了从流体动力学到格式塔平滑边界延续的原理。这些技术与更经典的纹理合成算法的结合也在这个项目中得到了解决和利用。该研究从总体上解决了这个问题，假设了不同的和大的区域被覆盖，并得出了基本的理论方面和实际的工作系统。

This project addresses the area of image and video inpainting, the technique of modifying an image in an undetectable form. The goals and applications of inpainting, which is as ancient as art itself, are numerous, from the restoration of damaged paintings and photographs to the removal of selected objects in a scene and the discovery of data behind occlusions. Image inpainting is also important for less-conventional applications such as wireless transmission and compression and image integration from camera arrays. The goal of this project is to develop a working solution to image, video, three dimensional, and multiple views inpainting and to address applications such as image and film restoration and alteration, image recovery from camera arrays, and filling-in of holes in 3D range data. Biological aspects of inpainting, through its fascinating possible connections with camouflage and the filling-in of the human blind spot, are investigated as well. The theory and applications of this project cover very diverse areas such as image processing, partial differential equations and fluid dynamics, numerical analysis, art, computer graphics, entertainment, and biology.The inpainting problem is addressed as the computation of a smooth continuation of the available spatial andtemporal information surrounding the region to be filled-in. This is achieved via partial differential equations, which incorporate principles ranging from fluid dynamics to Gestalt's smooth boundary continuation. The combination of these techniques with more classical texture synthesis algorithms is also addressed and exploited in this project. The research addresses the problem in its generality, assuming diverse and large regions to be inpainted, and derives both fundamental theoretical aspects and practicalworking systems.