RI: Medium: Integrated Analysis and Synthesis for Data Mining in a Video Network

加州大学河滨分校（University of California-Riverside）获得了一项拨款，用于开发一种新的研究范式，在该范式中，将合成分析和合成分析集成在一个闭环学习框架中，用于开发强大的、可扩展的系统，用于摄像机网络中的视频挖掘。这种范式允许从有限的领域到大规模部署的原则性转换。该合作项目汇集了三家机构（加州大学洛杉矶分校、加州大学洛杉矶分校和纽约州立大学sb分校），从多个视频流中汇总和解释信息，发现人类行为模式，并在现实的虚拟和现实场景（如视频监控、交通监控和老年人护理）中对其进行评估。该项目引入了四个新颖元素。首先，它开发了视频贝叶斯网络的增量建模和缩放方法，并将分析和综合结合在一起。其次，采用基于博弈论的多种策略和多目标优化框架对有源摄像机进行协同分布式在线控制。第三，它在层次贝叶斯和马尔可夫随机场以及统计张量模型的框架中使用多个表示来学习活动的长期模型。最后，介绍了基于动态系统理论的视频网络无缝跟踪与识别新模型。该项目将理论和算法的贡献与原型的开发相结合，该原型集成了视频摄像机网络和虚拟视觉模拟器，该模拟器包含复杂的人工生命模型。随着时间的推移，它建立了越来越复杂的人类、车辆、环境、照明、纹理、形状和运动模型。集成分析和综合的软件工具得到了广泛的传播。

The University of California-Riverside is awarded a grant to develop a new research para-digm in which both analysis-by-synthesis and synthesis-by-analysis are integrated in a closed-loop learning framework for developing robust, scalable systems for video mining in network of cameras. This paradigm allows a principled transition from limited domains to large-scale de-ployment. The collaborative project brings together three institutions (UCR, UCLA, and SUNY-SB) for aggregating and interpreting information and discovering patterns of human behavior from multiple video streams and evaluating them in realistic virtual and real-life scenarios such as video surveillance, traffic monitoring, and elderly care.The project introduces four novel elements. First, it develops methods for incremental model-ing and scaling of Bayesian nets for videos and glues together the analysis and synthesis. Sec-ond, it employs multiple strategies based on game theory and a multi-objective optimization framework for cooperative and distributed on-line control of active cameras. Third, it uses multi-ple representations in a framework of hierarchical Bayesian and Markov random fields and sta-tistical tensor models for learning long-term models of activities. Finally, it involves new models based on dynamical systems theory for seamless tracking and recognition in a video network. The project blends the theoretical and algorithmic contributions with the development of a prototype that integrates a network of video cameras with a virtual vision simulator which incorporates sophisticated artificial life models of humans. It builds increasingly sophisticated models of humans, vehicles, context, illumination, texture, shape, and motion over time. The software tools integrating the analysis and synthesis are widely disseminated.