SBIR Phase I: Automatically Generating Domain Specific Structured Ontologies for Video

SBIR 第一阶段：自动生成视频领域特定的结构化本体

• 批准号: 1647799
• 负责人: Joe Ellis
• 金额: $ 22.5万
• 依托单位: Vidrovr Inc.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-12-15 至 2018-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1647799&HistoricalAwards=false
• 关键词: SBIR; Phase; Automatically; Generating; Domain

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase 1 project is to make video searchable and discoverable in a cost-effective manner by automating video annotation tasks that are currently done manually. Video is being created at an increasingly high rate, and media companies are becoming overwhelmed by the sheer amount of video in their libraries. Companies have resorted to paying people to manually watch their videos and "tag" them with relevant descriptions so that the content becomes searchable and therefore useable. In this project the company will build an inference engine that can leverage the data and structure within video to discover specific multimodal concepts significant to the particular domain and automatically train and refine classifiers to apply unique and meaningful data describing the video. Leveraging this metadata, companies can index and search their videos more efficiently, enabling them to generate tailored video clips to meet specific goals, and ultimately publish video at a much larger scale. The company believes the unique domain-specific video metadata generated by its system will have an overwhelming effect on the ability of companies to disseminate informative videos, and improve their use of video online.This Small Business Innovation Research (SBIR) Phase 1 project proposes to develop an inference engine that combines the modalities of information in video to automatically discover and train multimodal classifiers for important concepts within specific domains. Current approaches to video understanding seek to develop general visual classification models; these approaches focus on leveraging labeled data to train supervised learning algorithms in order to describe the video. These approaches fail in specific verticals, because the information output is not granular enough to provide value within the context of the specific domain, and the cost for manual annotation is high. The approach proposed in this project takes into account the multimodal information associated with a group of related videos to automatically learn classifiers for concepts that are important in this video domain, without expensive manual annotation. The approach leverages the correlations between the different modalities in video and existing domain-specific structure to intelligently accomplish this task. The company expects this research to lead to the discovery of many new domain-specific video concept classifiers that do not exist in current visual ontologies, and a reusable approach for training visual classifiers that can be applied across many domains.

这个小型企业创新研究（SBIR）第1阶段项目的更广泛的影响/商业潜力是通过自动化目前手动完成的视频注释任务，以具有成本效益的方式使视频可搜索和可扩展。视频正在以越来越高的速度创建，媒体公司正在被其库中的大量视频所淹没。 公司已经采取了付费的方式，让人们手动观看他们的视频，并用相关的描述来“标记”它们，这样内容就可以被搜索到，从而可以使用。 在这个项目中，该公司将构建一个推理引擎，可以利用视频中的数据和结构来发现对特定领域有意义的特定多模态概念，并自动训练和改进分类器，以应用描述视频的独特和有意义的数据。 利用这些元数据，公司可以更有效地索引和搜索他们的视频，使他们能够生成量身定制的视频剪辑，以满足特定的目标，并最终以更大的规模发布视频。 该公司相信，其系统生成的独特的特定领域视频元数据将对公司传播信息视频的能力产生压倒性的影响，并改善他们对在线视频的使用。这项小型企业创新研究（SBIR）第一阶段项目提出开发一个推理引擎，结合视频中的信息模态，自动发现和训练视频中重要概念的多模态分类器。具体领域。 目前的视频理解方法寻求开发通用的视觉分类模型;这些方法专注于利用标记数据来训练监督学习算法，以便描述视频。这些方法在特定的垂直领域失败了，因为信息输出的粒度不足以在特定领域的上下文中提供价值，并且手动注释的成本很高。该项目中提出的方法考虑到与一组相关视频相关联的多模态信息，以自动学习在该视频域中重要的概念的分类器，而无需昂贵的手动注释。该方法利用视频中不同模态与现有特定领域结构之间的相关性来智能地完成此任务。 该公司预计，这项研究将导致发现许多新的特定于领域的视频概念分类器，这些分类器在当前的视觉本体中不存在，以及一种可重用的方法来训练可应用于许多领域的视觉分类器。