权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

RI: SMALL: Recognizing objects in images and their properties over time

RI：小：随着时间的推移识别图像中的对象及其属性

基本信息

批准号：
2006820
负责人：
Philipp Kraehenbuehl
金额：
$ 41.95万
依托单位：
University of Texas at Austin
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2020
资助国家：
美国
起止时间：
2020-10-01 至 2023-09-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2006820&HistoricalAwards=false
关键词：
RI SMALL Recognizing objects images

项目摘要

Computer vision lives in the golden age of datasets. All aspects of human vision are systematically mapped and transcribed into an ever-larger pool of labeled data. All with one single goal: teach a vision system, nowadays a deep network, to imitate all aspects of human perception. The current recipe is simple: collect sufficient labeled data, then use supervised machine learning to mimic the supervision. There is just one issue with this approach: Systems trained this way are limited to imitate a single narrow task. In this project, we take a step towards unifying many vision tasks into one single system: A framework that infers all properties of all things through time. If successful, this system can identify objects and all their properties in any new unseen image, and bring the full power of computer vision to the non-expert. Applications include autonomous agents interacting with the world through the manipulation of objects, and assistive technologies for the elderly that observes the world through moving objects and their properties.The project will pursue three research thrusts. 1. Detecting all objects: In object detection, datasets specialize in domains. Driving datasets describe any vehicle type imaginable, indoor datasets focus on common household objects, and pedestrian datasets exclusively focus on humans. How can we train an object detection system that leverages all these sources of data? How can we relate these different data sources to each other? How do we deal with partial annotation in some data sources? 2. Inferring all properties: Object detection forms the basic building block for many aspects of visual reasoning. However, the most interesting tasks start after detection: What is the 2D or 3D pose of an object? Is this object deformable? Could it be a danger to an autonomous vehicle? Again, there are hundreds of tasks and data sources that describe all the properties of objects. How can we learn a detector that infers them all? 3. Recognition through time: Finally, detection should not be isolated in time. How do we reason about objects and properties through time? Can we learn to recognize objects in a temporally coherent manner using current image-based datasets?This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

计算机视觉生活在数据集的黄金时代。人类视觉的所有方面都被系统地映射和转录到一个越来越大的标记数据库中。所有这些都只有一个目标：教一个视觉系统，现在是一个深度网络，模仿人类感知的各个方面。目前的方法很简单：收集足够的标记数据，然后使用监督机器学习来模仿监督。这种方法只有一个问题：以这种方式训练的系统仅限于模仿单一的狭窄任务。在这个项目中，我们朝着将许多视觉任务统一到一个单一系统中迈出了一步：一个通过时间推断所有事物的所有属性的框架。如果成功的话，这个系统可以在任何新的看不见的图像中识别物体及其所有属性，并将计算机视觉的全部功能带给非专家。应用领域包括通过操纵物体与世界互动的自主代理，以及通过移动物体及其属性观察世界的老年人辅助技术。该项目将追求三个研究方向。1.检测所有对象：在对象检测中，数据集专门针对域。驾驶数据集描述了任何可以想象的车辆类型，室内数据集专注于常见的家用物品，行人数据集专注于人类。我们如何训练一个利用所有这些数据源的对象检测系统？我们如何将这些不同的数据源相互联系起来？我们如何处理某些数据源中的部分注释？2.推断所有属性：对象检测构成了视觉推理许多方面的基本构建块。然而，最有趣的任务是在检测之后开始的：物体的2D或3D姿态是什么？这个物体能变形吗？它会对自动驾驶汽车造成危险吗？同样，有数百个任务和数据源描述对象的所有属性。我们如何才能学习一个能推断出所有这些的探测器呢？3.通过时间识别：最后，检测不应在时间上孤立。我们如何通过时间来推理物体和属性？我们能学会使用当前基于图像的数据集以时间相干的方式识别物体吗？该奖项反映了NSF的法定使命，并被认为是值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估的支持。