CGV: Large: Collaborative Research: Analyzing Images Through Time

CGV：大型：协作研究：随时间分析图像

• 批准号: 1110955
• 负责人: Hanspeter Pfister
• 金额: $ 42.37万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-09-01 至 2015-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1110955&HistoricalAwards=false
• 关键词: CGV; Large; Collaborative; Research; Analyzing

This collaborative research project leverages expertise of four research teams (IIS-1111415, Massachusetts Institute of Technology; IIS-1110955, Harvard University; IIS-1111398, Washington University; and IIS-1111534, Cornell University). Understanding time-varying processes and phenomena is fundamental to science and engineering. Due to tremendous progress in digital photography, images and videos (including images from webcams, time- lapse photography captured by scientists, surveillance videos, and Internet photo collections) are becoming an important source of information about our dynamic world. However, techniques for automated understanding and visualization of time-varying processes from images or videos are scarce and underdeveloped, requiring fundamental new models and algorithms for representing changes over time. This research involves creating systems that enable modeling, analysis, and visualization of time-varying processes based on image data. These models and algorithms will form the basis for a new set of tools that can help answer important questions about how our environment is changing, how our cities are evolving, and what significant events are happening around the world.Analyzing images over time poses fundamental new technical challenges. This project focuses on developing and demonstrating end-to-end systems consisting of (1) novel representations necessary to model time-varying image datasets; (2) algorithms for estimating long-range temporal correspondence in image datasets; (3) algorithms for decomposing image datasets into intuitive primitives such as shading, illumination, reflectance, and motion; (4) analysis tools for deriving higher level information from the decomposed representations (e.g., trends, repeated patterns, and unusual events); and (5) tools for visualization of the high-level information and methods for re-synthesis of image data.This work has the potential to have significant impact in a broad range of areas where images are generated over time, e.g., in ecology, astronomy, urban planning, health, and many others. The results of this research will be broadly disseminated by making source code and datasets publicly available via the project web site (https://groups.csail.mit.edu/vision/image_time/) and offering tutorials and organizing workshops at significant conferences. The project provides educational opportunities and offers hands-on collaborative research experience to students at both the undergraduate and graduate levels and the four institutions.

该合作研究项目利用了四个研究团队的专业知识（IIS-1111415，马萨诸塞州理工学院; IIS-1110955，哈佛大学; IIS-1111398，华盛顿大学;和IIS-1111534，康奈尔大学）。理解时变过程和现象是科学和工程的基础。由于数字摄影的巨大进步，图像和视频（包括来自网络摄像头的图像，科学家拍摄的延时摄影，监控视频和互联网照片集）正在成为我们动态世界的重要信息来源。然而，用于从图像或视频中自动理解和可视化时变过程的技术是稀缺和不发达的，需要基本的新模型和算法来表示随时间的变化。这项研究涉及创建系统，使建模，分析和可视化的时变过程的基础上图像数据。这些模型和算法将构成一套新工具的基础，这些工具可以帮助回答有关我们的环境如何变化、我们的城市如何发展以及世界各地正在发生什么重大事件等重要问题。分析图像随时间的变化带来了根本性的新技术挑战。该项目的重点是开发和演示端到端系统，包括：（1）建模时变图像数据集所需的新颖表示;（2）估计图像数据集中长距离时间对应关系的算法;（3）将图像数据集分解为直观图元（如阴影、照明、反射和运动）的算法;（4）用于从分解的表示导出更高级信息的分析工具（例如，趋势、重复模式和不寻常事件）;以及（5）高级别信息可视化工具和图像数据再合成方法。这项工作有可能在随着时间推移生成图像的广泛领域产生重大影响，例如，在生态学、天文学、城市规划、健康和许多其他方面。将通过项目网站（https：//groups.csail.mit.edu/vision/image_time/）公布源代码和数据集，并在重要会议上提供教程和组织讲习班，广泛传播这项研究的结果。该项目为本科生和研究生以及四个机构的学生提供教育机会，并提供实践合作研究经验。