RI: Large: Collaborative Research: Reconstructive recognition: Uniting statistical scene understanding and physics-based visual reasoning

该项目正在为计算机视觉创造一种新的范式，称为“重建识别”，它结合了以前基于机器学习的识别工作的最强元素和以前基于辐射推理的重建工作的最强元素。目标是为机器感知提供新的基础，并为计算机视觉应用的变革性进步提供潜力。该项目寻求新的基于物理的识别方法，以及基于学习的解释场景物理像素值的新方法。议程围绕着四个目标：第一目标是发展广义的重建过程，统一形状、材料、运动和照明的恢复。Aim II侧重于利用这种重建图像表示的监督视觉学习方法。Aim III追求无监督地发现与Aim i的工程模型相似的重构表示。最后，Aim IV引入了定义明确的挑战问题，这些问题聚焦于该领域，并作为对社会具有高潜在影响的计算机视觉应用进展的可测量代理。这个项目有一个重要的更广泛的影响，尤其是计算机视觉教学法的改进，这是由当前不同的识别和重建观点的统一所带来的。更广泛地说，这个项目追求的是未来机器可以看到的关键步骤，一个将给机器人、人机界面、安全和自主导航等带来变化的未来。

This project is creating a novel paradigm for computer vision, termed "reconstructive recognition", that incorporates the strongest elements of previous machine learning-based recognition efforts and the strongest elements of previous reconstruction efforts based on radiometric reasoning. The goal is to provide a new foundation for machine perception, and the potential for a transformative advance in applications of computer vision. The project seeks novel physics-based methods for recognition as well as novel learning-based methods for interpreting pixel values in terms of the physics of a scene. The agenda is structured around four aims: Aim I develops generalized reconstructive processes that unify the recovery of shape, materials, motion and illumination. Aim II focuses on supervised visual learning methods that exploit such reconstructive image representations. Aim III pursues unsupervised discovery of reconstructive representations that converge to be similar to the engineered models of Aim I. Finally, Aim IV introduces well-defined challenge problems that focus the field and serve as measurable proxies for progress in computer vision applications that have high potential impact on society. There is a significant broader impact to this project, not least being the improvement in computer vision pedagogy that ensues from a reunification of the currently divergent recognition and reconstruction views of the field. More broadly, this project pursues critical steps toward a future where machines can see, a future that will bring changes to robotics, human-computer interfaces, security, and autonomous navigation, to name a few.