RI: Small: Collaborative Research: Ontology based Perceptual Organization of Audio-Video Events using Pattern Theory
RI: Small: Collaborative Research: Ontology based Perceptual Organization of Audio-Video Events using Pattern Theory
批准号:
1217515
负责人:
Anuj Srivastava
金额:
$24.76万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2012
资助国家:
美国
项目状态:
已结题
起止时间:
2012-09-01 至 2016-08-31
中文摘要
在观察到的场景中感兴趣的事件自然会通过多种感知模式表现出来--视觉、听觉、嗅觉等。自然系统(如人类)对音频-视频信号的显著感知也表明了跨模式推断的优越性。因此,通过使用联合、跨模式统计推断来提高自动化系统的性能似乎是很自然的。然而,检测、组织和理解现实世界场景中的线索和事件是一项困难的任务。这个项目寻求开发一个模式理论框架来实现这些目标。主要的研究内容是:(1)发展表示视听事件及其时空关系的数学量;(2)使用特定领域的本体来施加语义结构并结合先验知识;(3)利用马尔可夫链蒙特卡罗抽样的高效适应性来推导贝叶斯推理算法。模式理论的使用允许弥合原始信号和高级依赖于领域的语义之间的差距,并有助于发现可能代表相同底层事件的大组视听事件。这项工作结合了计算机视觉中的知觉组织、听觉信号的计算分析、模式理论和本体结构的先前发展的想法。本文提出的方法适用于许多部署音视频传感器的场景,包括视频的音频标注问题、电话会议中的说话人跟踪问题、远程监控中的多目标分离问题。更广泛的影响活动包括开发教学模块、对学生进行创新和创业培训,以及向社区宣传调查结果。
英文摘要
It is natural that events of interest in observed scenes manifest themselves across multiple sensing modalities - vision, hearing, smell, etc. The remarkable perceptions of audio-video signals by natural systems, such as humans, also points to superiority of inferences drawn across modalities. It, therefore, seems natural to enhance performance of automated systems by using joint, cross-modal statistical inferences. However, the detection, organization, and understanding of cues and events in real-world scenarios are difficult tasks. This project seeks to develop a pattern-theoretic framework for achieving these goals. The main research items are: (1) development of mathematical quantities to represent audio and visual events and their spatiotemporal relations, (2) use domain-specific ontologies to impose semantic structure and to incorporate prior knowledge, and (3) derive algorithms for Bayesian inferences using efficient adaptations of Markov Chain Monte Carlo sampling. The use of pattern theory allows bridging of gaps between raw signals and high-level, domain-dependent semantics, and helps discovers large groups of audio-visual events likely to represent the same underlying event. This effort combines ideas from perceptual organization in computer vision, computational analysis of auditory signals, pattern theory, and prior developments in ontological structures. The methods developed here are applicable to many scenarios that deploy audio and video sensors, including problems of audio annotations of videos, speaker tracking in teleconferencing, and separation of multiple objects in remote surveillance. Broader impact activities involve the development of teaching modules, innovation and entrepreneurial training of the students, and communication of the findings to the community.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
CDS&E: Geometrical Regression Models Involving Complex Shape Variables
-
批准号:1953087
-
项目类别:Continuing Grant
-
资助金额:$30.0万
-
财政年份:2020
-
负责人:Anuj Srivastava
-
依托单位:
Collaborative Research: RI:Medium: Understanding Events from Streaming Video - Joint Deep and Graph Representations, Commonsense Priors, and Predictive Learning
-
批准号:1955154
-
项目类别:Continuing Grant
-
资助金额:$29.92万
-
财政年份:2020
-
负责人:Anuj Srivastava
-
依托单位:
Workshop on Applications-Driven Geometric Functional Data Analysis
-
批准号:1710802
-
项目类别:Standard Grant
-
资助金额:$2.0万
-
财政年份:2017
-
负责人:Anuj Srivastava
-
依托单位:
CIF: Small: Collaborative Research: Geometrical and Statistical Modeling of Space-Time symmetries for Human Action Analysis and Retraining
-
批准号:1617397
-
项目类别:Standard Grant
-
资助金额:$21.69万
-
财政年份:2016
-
负责人:Anuj Srivastava
-
依托单位:
CDS&E: Computational Riemannian Approaches for Statistical Analysis and Modeling of Complex Structures
-
批准号:1621787
-
项目类别:Continuing Grant
-
资助金额:$15.0万
-
财政年份:2016
-
负责人:Anuj Srivastava
-
依托单位:
CIF: Small: Collaborative Research: Geometry-aware and data-adaptive signal processing for resource constrained activity analysis
-
批准号:1319658
-
项目类别:Standard Grant
-
资助金额:$17.5万
-
财政年份:2013
-
负责人:Anuj Srivastava
-
依托单位:
A New Paradigm in Joint Registration, Analysis and Modeling of Function Data
-
批准号:1208959
-
项目类别:Standard Grant
-
资助金额:$25.0万
-
财政年份:2012
-
负责人:Anuj Srivastava
-
依托单位:
MCS: Research on Detection and Classification of 2D and 3D Shapes in Cluttered Point Clouds
-
批准号:0915003
-
项目类别:Standard Grant
-
资助金额:$40.0万
-
财政年份:2009
-
负责人:Anuj Srivastava
-
依托单位:
FRG: Development of Geometrical and Statistical Models for Automated Object Recognition
-
批准号:0101429
-
项目类别:Continuing Grant
-
资助金额:$52.2万
-
财政年份:2001
-
负责人:Anuj Srivastava
-
依托单位:
国内基金
海外基金
登录
查看更多内容
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:
-
依托单位:
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:10.0万元
-
批准年份:2022
-
负责人:张祥忠
-
依托单位:
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
-
批准号:32000033
-
项目类别:青年科学基金项目
-
资助金额:24.0万元
-
批准年份:2020
-
负责人:林平
-
依托单位:
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
-
批准号:31972324
-
项目类别:面上项目
-
资助金额:58.0万元
-
批准年份:2019
-
负责人:高学文
-
依托单位:
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
-
批准号:81900988
-
项目类别:青年科学基金项目
-
资助金额:21.0万元
-
批准年份:2019
-
负责人:毛梦莹
-
依托单位:
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
-
批准号:31870821
-
项目类别:面上项目
-
资助金额:56.0万元
-
批准年份:2018
-
负责人:陈江宁
-
依托单位:
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
-
批准号:31802058
-
项目类别:青年科学基金项目
-
资助金额:26.0万元
-
批准年份:2018
-
负责人:麻慧
-
依托单位:
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
-
批准号:31772128
-
项目类别:面上项目
-
资助金额:60.0万元
-
批准年份:2017
-
负责人:吴建国
-
依托单位:
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
-
批准号:81704176
-
项目类别:青年科学基金项目
-
资助金额:20.0万元
-
批准年份:2017
-
负责人:赵继梦
-
依托单位:
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
-
批准号:91640114
-
项目类别:重大研究计划
-
资助金额:85.0万元
-
批准年份:2016
-
负责人:何祖华
-
依托单位: