CAREER: Advanced Statistical Modeling Approaches for Structured Video Representation and Research Oriented Multidisciplinary Education

本研究旨在通过先进的统计建模方法开发一个全面的结构化视频表示。研究的目标是提高视觉数据的可解释性和可操作性，从而实现有效的视觉通信和创新的多媒体应用。该方法包括四个主要的研究部分：（1）联合帧和对象视频分割，采用先进的统计聚类方法;（2）面向对象的结构化视频表示，集成了扩展的HALSTOM，能够捕捉重要的空间和时间结构;（3）在视觉通信中的应用;（4）在MPEG-7多媒体标准中的应用。这项研究解决了视觉信息处理中的基本问题，在多媒体、数字图书馆、安全监控、娱乐、生物医学成像和人机界面等不同领域有着广泛的应用。此外，拟议的研究对行业标准（MPEG-7）有重大贡献。该项目的成果将通过科学论文、软件、在线演示和原型视频数据库进行传播，这些数据库可以从该项目的网站http://www.vcipl.okstate.edu.The访问。MISTP将为学生，特别是少数民族学生和女学生提供实用的、"动手“的研究和实验技能，以帮助他们在文化多样性、跨学科的研究和工作环境中取得成功。MISTP将影响多个科学和工程学科的各级学生。教育内容的传播将以网络形式和较传统的方式进行。方案说明和教育材料将在专业会议上分发，并向公众提供。

This research aims to develop a comprehensive structured video representation via advanced statistical modeling approaches. The goal of research is to enhance interpretability and manipulability of visual data, leading to effective visual communications and innovative multimedia applications. The approach consists of four major research components: (1) joint frame and object video segmentation that applies advanced statistical clustering methods; (2) object-oriented structured video representation that integrates extended HMMs and is able to capture important structures in space and time; (3) the application in visual communications; (4) the application in the MPEG-7 Multimedia standard. This research addresses fundamental issues in visual information processing, with widespread applications in diverse areas, including multimedia, digital library, security surveillance, entertainment, biomedical imaging, and human-computer interface, etc. Moreover, the proposed research has significant contribution to industry standards (MPEG-7). The results of the project will be disseminated by scientific papers, software, online demos, and prototype video databases, which can be accessed from the project's website http://www.vcipl.okstate.edu.The education al component includes the development of a unique Multidisciplinary Imaging Science & Technology Program (MISTP). The MISTP will provide students, particularly, minority and women students, with practical, ``hands-on'', research and experimental skills to help them succeed in a culturally diverse, cross-disciplinary research and work environment. The MISTP will impact students at all levels in multiple Science and Engineering disciplines. Dissemination of educational components will be implemented in a web-based format and by more traditional means. Program descriptions and educational materials will be distributed in professional conferences and made publicly available.