Human Activity Scripts and Queries for Video Databases

该项目将侧重于开发分析和检索视频数据库中的人类活动的方法，这些方法也可以促进高度压缩存储的有效手段。为此，提出了一种新的人类活动表示方法。这样的表示被称为动作脚本，它包括完全描述身体所有主要部分的3D运动的人类动作的详细序列。动作脚本可以扩展到描述多人的动作，也可以成为高效总结、检索和识别视频数据库中复杂人类活动的创新手段。该方案的另一个目标是开发创新的查询工具，便于高效地定义和检索视频数据库中的单人/多人活动。提出的方法是基于PI最近开发的一种创新方法的扩展，该方法用于通过索引和排序识别人类活动(RisQ)。RisQ只需要很少的视频样本，即使在部分遮挡和速度变化的条件下也能提供快速而稳健的识别。建议进一步扩展RisQ方法，以生成和识别个人和群体的行动脚本。这是一个完全未开发的领域，可能会在视频数据库的分析和管理方面做出重大的科学贡献。

This project will focus on developing methods for analysis and retrieval of human activities in video databases that also can facilitate efficient means for highly compressed storage. For this purpose, it is proposed to develop a novel representation method for human activities. Such a representation is termed as action script and it includes a detailed sequence of human actions that fully describe the 3D motions of all the major body parts. Action scripts can be extended to describe actions of multiple persons as well and could also become an innovative means for highly efficient summarization, retrieval and recognition of complex human activities in video databases.Another objective of this proposal is to develop innovative querying tools that facilitate efficient definition and retrieval of single/multi person activities in video databases. The approach proposed is founded on an extension of an innovative method, recently developed by the PI, forRecognition of human activity by Indexing and Sequencing (RISq). The RISq requires only few video samples and provides fast and robust recognition even in conditions of partial occlusion and varying speeds. It is proposed to further extend the RISq method for the proposed generation and recognition of action scripts of individuals and groups. This is an entirely unexplored domain that could lead to significant scientific contributions in analysis and management of video databases.