CI-New: Collaborative Research: Federated Data Set Infrastructure for Recognition Problems in Computer Vision

CI-New：协作研究：计算机视觉识别问题的联合数据集基础设施

• 批准号: 1405883
• 负责人: Julia Hockenmaier
• 金额: $ 30万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-10-01 至 2019-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1405883&HistoricalAwards=false
• 关键词: CI; New; Collaborative; Research; Federated

Broad access to image and video datasets has been responsible for much of the progress in computer vision recognition problems over the last decade. These common benchmarks have played a leading role in transforming recognition research from a black art into an experimental science. Progress, however, has stagnated; although datasets continue to grow, they are developed and annotated in isolation: e.g., a collection of sporting activities, a set of objects in images, etc. These isolated datasets suffer from task and domain-specific bias, and knowledge transfer across them is extremely limited. This project is investigating and establishing a prototype architecture that federates across various recognition problems and modalities, by establishing a common namespace for entities, events and annotations across the datasets. The project is also establishing a web-portal for the prototype federated dataset architecture and linking two existing recognition datasets into the prototype architecture. The resulting federated structure is truly greater than the sum of its parts, and can support new research that was not previously possible for the computer vision community and other related fields.As a first test scenario for this federated architecture, this project is investigating and constructing a new federated dataset of images and video annotated with various forms of associated text. Image and video content annotations span both the spatial and temporal dimensions while textual annotations reflecting depicted content range from complete free-form natural language descriptions, to more targeted phrases and referring expressions, to individual keyword lists. This dataset is being constructed to promote and enhance collaboration efforts between the vision and language communities by providing a new multi-modal annotated dataset with associated research competitions.

在过去十年中，对图像和视频数据集的广泛访问是计算机视觉识别问题取得大部分进展的原因。 这些共同的基准在将识别研究从黑艺术转变为实验科学方面发挥了主导作用。 然而，进展停滞不前;虽然数据集继续增长，但它们是孤立地开发和注释的：例如，这些孤立的数据集受到任务和特定领域的偏见的影响，并且跨它们的知识转移非常有限。 该项目正在研究和建立一个原型架构，通过为数据集上的实体、事件和注释建立一个通用的命名空间，来联合各种识别问题和模式。 该项目还正在为联合数据集原型架构建立一个门户网站，并将两个现有的识别数据集连接到原型架构中。由此产生的联邦结构确实大于其部分的总和，并且可以支持计算机视觉社区和其他相关领域以前不可能的新研究。作为这种联邦架构的第一个测试场景，该项目正在研究和构建一个新的图像和视频联合数据集，并使用各种形式的关联文本进行注释。 图像和视频内容注释跨越空间和时间维度，而反映所描绘内容的文本注释范围从完整的自由形式的自然语言描述到更有针对性的短语和引用表达，再到单独的关键字列表。 该数据集的构建旨在通过提供一个新的多模态注释数据集以及相关的研究竞赛来促进和加强视觉和语言社区之间的合作。