CI-New: Collaborative Research: Federated Data Set Infrastructure for Recognition Problems in Computer Vision

CI-New：协作研究：计算机视觉识别问题的联合数据集基础设施

• 批准号: 1463102
• 负责人: Jason Corso
• 金额: $ 15万
• 依托单位: Regents of the University of Michigan - Ann Arbor
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2014
• 资助国家: 美国
• 起止时间: 2014-10-01 至 2017-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1463102&HistoricalAwards=false
• 关键词: CI; New; Collaborative; Research; Federated

Broad access to image and video datasets has been responsible for much of the progress in computer vision recognition problems over the last decade. These common benchmarks have played a leading role in transforming recognition research from a black art into an experimental science. Progress, however, has stagnated; although datasets continue to grow, they are developed and annotated in isolation: e.g., a collection of sporting activities, a set of objects in images, etc. These isolated datasets suffer from task and domain-specific bias, and knowledge transfer across them is extremely limited. This project is investigating and establishing a prototype architecture that federates across various recognition problems and modalities, by establishing a common namespace for entities, events and annotations across the datasets. The project is also establishing a web-portal for the prototype federated dataset architecture and linking two existing recognition datasets into the prototype architecture. The resulting federated structure is truly greater than the sum of its parts, and can support new research that was not previously possible for the computer vision community and other related fields.As a first test scenario for this federated architecture, this project is investigating and constructing a new federated dataset of images and video annotated with various forms of associated text. Image and video content annotations span both the spatial and temporal dimensions while textual annotations reflecting depicted content range from complete free-form natural language descriptions, to more targeted phrases and referring expressions, to individual keyword lists. This dataset is being constructed to promote and enhance collaboration efforts between the vision and language communities by providing a new multi-modal annotated dataset with associated research competitions.

在过去的十年里，对图像和视频数据集的广泛访问是计算机视觉识别问题取得进展的主要原因。这些常见的基准在将识别研究从一门黑艺术转变为一门实验科学方面发挥了主导作用。然而，进展停滞不前；尽管数据集继续增长，但它们是孤立地开发和注释的：例如，体育活动的集合、图像中的一组对象等。这些孤立的数据集受到特定任务和领域的偏见，跨它们的知识转移极其有限。该项目正在研究和建立一个原型体系结构，通过为跨数据集的实体、事件和注释建立一个通用的命名空间，将各种识别问题和模式联合起来。该项目还在为原型联合数据集体系结构建立一个网络门户，并将两个现有的识别数据集连接到原型体系结构中。作为该联合结构的第一个测试场景，该项目正在调查和构建一个新的联合数据集，该数据集由各种形式的关联文本标注的图像和视频组成。图像和视频内容注释跨越空间和时间维度，而反映所描述内容的文本注释范围从完整的自由形式的自然语言描述到更有针对性的短语和引用表达，再到单独的关键字列表。正在建立这个数据集，通过提供一个新的多模式注释数据集和相关的研究竞赛，促进和加强VISION和语言界之间的合作努力。