CAREER: Advanced Statistical Modeling Approaches for Structured Video Representation and Research Oriented Multidisciplinary Education

本研究旨在通过先进的统计建模方法开发一个全面的结构化视频表示。研究的目标是提高视觉数据的可解释性和可操作性，从而实现有效的视觉通信和创新的多媒体应用。该方法由四个主要研究部分组成：(1)采用先进的统计聚类方法对帧和目标视频进行联合分割；(2)面向对象的结构化视频表示，它集成了扩展hmm，能够捕获空间和时间上的重要结构；(3)在视觉传达中的应用；(4)在MPEG-7多媒体标准中的应用。本研究解决了视觉信息处理的基本问题，在多媒体、数字图书馆、安全监控、娱乐、生物医学成像、人机界面等领域有着广泛的应用。此外，所提出的研究对行业标准（MPEG-7）有重要贡献。该项目的成果将通过科学论文、软件、在线演示和原型视频数据库进行传播，可从该项目的网站http://www.vcipl.okstate.edu.The访问。教育组成部分包括开发独特的多学科成像科学与技术计划（MISTP）。MISTP将为学生，特别是少数民族和女性学生提供实用的，“动手”的研究和实验技能，帮助他们在多元文化，跨学科的研究和工作环境中取得成功。MISTP将影响多个科学和工程学科的各个层次的学生。教育内容的传播将以网络形式和更传统的方式进行。项目说明和教育材料将在专业会议上分发，并向公众开放。

This research aims to develop a comprehensive structured video representation via advanced statistical modeling approaches. The goal of research is to enhance interpretability and manipulability of visual data, leading to effective visual communications and innovative multimedia applications. The approach consists of four major research components: (1) joint frame and object video segmentation that applies advanced statistical clustering methods; (2) object-oriented structured video representation that integrates extended HMMs and is able to capture important structures in space and time; (3) the application in visual communications; (4) the application in the MPEG-7 Multimedia standard. This research addresses fundamental issues in visual information processing, with widespread applications in diverse areas, including multimedia, digital library, security surveillance, entertainment, biomedical imaging, and human-computer interface, etc. Moreover, the proposed research has significant contribution to industry standards (MPEG-7). The results of the project will be disseminated by scientific papers, software, online demos, and prototype video databases, which can be accessed from the project's website http://www.vcipl.okstate.edu.The education al component includes the development of a unique Multidisciplinary Imaging Science & Technology Program (MISTP). The MISTP will provide students, particularly, minority and women students, with practical, ``hands-on'', research and experimental skills to help them succeed in a culturally diverse, cross-disciplinary research and work environment. The MISTP will impact students at all levels in multiple Science and Engineering disciplines. Dissemination of educational components will be implemented in a web-based format and by more traditional means. Program descriptions and educational materials will be distributed in professional conferences and made publicly available.