RI: Small: Functional Scene Representation for Image Understanding

“理解”一幅图像是什么意思？一个流行的答案是简单地命名在图像中看到的物体。在过去的十年中，大多数计算机视觉研究人员都集中在这个“对象命名”问题上。虽然在检测“汽车”和“人”方面已经取得了很大的进步，但这种水平的理解仍然无法回答关于图像的基本问题，比如“场景的几何结构是什么？”“我能在图像中走到哪里？”这个项目的目标是开发一个几何和功能表示我们的视觉世界的场景理解。该项目旨在通过学习场景的物理/视觉表示与智能体在该场景中可以执行的交互空间之间的关系来开发这种功能表示。功能场景表示的关键优势在于，它是主观的，明确地基于任务，并考虑到代理？年代的能力。该项目预计将在图像理解领域取得重大进展，使其更接近机器人研究人员。预计这将导致以下方面的改进：(a) 3D场景理解；(b)识别;(c)人类活动理解，因此可能成为自主系统、监视和个人机器人等应用的关键使能技术。预计该项目还将通过课程开发、学生项目、讲习班和涉及更广泛受众的教程，以及利用流行的在线媒体（如YouTube）和互动网络演示，让幼儿参与进来，为教育做出贡献。

What does it mean to "understand" an image? One popular answer is simply naming the objects seen in the image. During the last decade most computer vision researchers have focused on this "object naming" problem. While there has been great progress in detecting things like "cars" and "people", such a level of understanding still cannot answer even basic questions about an image such as "What is the geometric structure of the scene?" "Where in the image can I walk"? The goal of this project is to develop a geometric and functional representation of our visual world for scene understanding. This project aims to develop this functional representation by learning relationships between the physical/visual representation of the scene and the space of the interactions an agent can perform in that scene. The key advantage of functional scene representation is that it is subjective, explicitly task-based and takes into account the agent?s capabilities. This project is anticipated to result in major advances within the image understanding community, bringing it closer to researchers in robotics. It is anticipated to result in improvements in: (a) 3D Scene Understanding; (b) Recognition; (c) Human Activity Understanding, and hence could be a critical enabling technology for applications such as autonomous systems, surveillance, and personal robotics. This project is also expected to contribute to education through course development, student projects, workshops, and tutorials involving a broader audience as well as using popular online media (e.g., YouTube) and interactive web demos to involve young children.