Image and Video Inpainting

图像和视频修复

• 批准号: 0429037
• 负责人: Guillermo Sapiro
• 金额: --
• 依托单位: University of Minnesota-Twin Cities
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-09-15 至 2009-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0429037&HistoricalAwards=false
• 关键词: Image; Video; Inpainting

This project addresses the area of image and video inpainting, the technique of modifying an image in an undetectable form. The goals and applications of inpainting, which is as ancient as art itself, are numerous, from the restoration of damaged paintings and photographs to the removal of selected objects in a scene and the discovery of data behind occlusions. Image inpainting is also important for less-conventional applications such as wireless transmission and compression and image integration from camera arrays. The goal of this project is to develop a working solution to image, video, three dimensional, and multiple views inpainting and to address applications such as image and film restoration and alteration, image recovery from camera arrays, and filling-in of holes in 3D range data. Biological aspects of inpainting, through its fascinating possible connections with camouflage and the filling-in of the human blind spot, are investigated as well. The theory and applications of this project cover very diverse areas such as image processing, partial differential equations and fluid dynamics, numerical analysis, art, computer graphics, entertainment, and biology.The inpainting problem is addressed as the computation of a smooth continuation of the available spatial andtemporal information surrounding the region to be filled-in. This is achieved via partial differential equations, which incorporate principles ranging from fluid dynamics to Gestalt's smooth boundary continuation. The combination of these techniques with more classical texture synthesis algorithms is also addressed and exploited in this project. The research addresses the problem in its generality, assuming diverse and large regions to be inpainted, and derives both fundamental theoretical aspects and practicalworking systems.

该项目解决了图像和视频介绍的区域，即以无法检测的形式修改图像的技术。从恢复受损的绘画和照片到在场景中删除选定的物体以及在闭塞背后发现数据的删除，从恢复受损的绘画和照片到清除所选物体，涂料的目标和应用是许多古老的。图像介绍对于较不常规的应用也很重要，例如无线传输，相机阵列的压缩和图像集成。 该项目的目的是为图像，视频，三维和多个视图开发一个工作解决方案，并解决诸如图像和胶片修复和更改之类的应用程序，相机阵列中的图像恢复以及3D范围数据中的孔填充。通过与伪装和人类盲点的填充的引人入胜的连接，介入的生物学方面也得到了研究。该项目的理论和应用涵盖了非常多样化的领域，例如图像处理，部分微分方程和流体动力学，数值分析，艺术，计算机图形，娱乐和生物学。将介入的问题用于填写的问题，以计算可用的空间和周围地区可用的空间和静态信息。这是通过部分微分方程实现的，该方程结合了从流体动力学到格式塔平稳边界延续的原理。在本项目中，还解决了这些技术与更古典的纹理合成算法的结合。该研究以其普遍性解决了问题，假设要覆盖多样化和大型区域，并衍生了基本的理论方面和实践工作系统。