权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Construction of On-line Multimodal Dictionary for Automatic Human Behavior Understanding

人类行为自动理解在线多模态词典的构建

基本信息

批准号：
08458073
负责人：
OHTA Yuichi
金额：
$ 4.1万
依托单位：
University of Tsukuba
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
1996
资助国家：
日本
起止时间：
1996 至 1997
项目状态：
已结题

项目摘要

We investigated description for various aspects on human behaviors, and accumulated actual data in a machine readable format. This research contains, 1)a study for the human behavior description and accumulation in various situations, and development of a prototype database, 2)human motion observation by multiple moving cameras, 3)view sclection and editing from the views by multiple cameras.On the first topic, we gathered various records : body movements measured by a magnetic motion capture system, videos from multiple cameras aiming at important portions for understanding human motions, audio, speech transcripts, and human movements interprctation by human. They are related to each other by their occurrence time. We can examine, by referring the data, how the different modalities are cooperatively and complementarily used in real situations. This cxamination over different situations is essential for understanding human behaviors, since they are heavily dependent on their contexts and personal charactcristics.On the second topic, we developed a human behavior tracking system with multple cameras. Multiple moving cameras at different. positions aim at important portions on a human body and something around the body, such as face, hands, or objects on a desk. This record help us to investigate not only how humans moved but also how those important portions are seen in actual communications and what information they carry.On the third topic, we investigated a new method to choose the timing, focused point for observing and recording the human behaviors by using the data taken by the above system. This recarch aims at generation of comprehensible report or summary of presentations or lectures by selecting the cameras and frames by using human motion understanding.

我们研究了人类行为各个方面的描述，并以机器可读的格式积累了实际数据。这项研究包括，1）对各种情况下的人类行为描述和积累的研究，以及原型数据库的开发，2）通过多个移动摄像机观察人体运动，3）从多个摄像机的视图中进行视图选择和编辑。在第一个主题中，我们收集了各种记录：通过磁力运动捕捉系统测量的身体运动，来自多个摄像机的针对理解人体运动的重要部分的视频，音频，语音记录和人类行为。人类的动作解释。它们通过发生时间彼此相关。我们可以通过参考数据来检验不同模式在实际情况下如何协同互补地使用。这种对不同情况的检查对于理解人类行为至关重要，因为它们在很大程度上取决于他们的环境和个人特征。在第二个主题上，我们开发了一个带有多个摄像头的人类行为跟踪系统。多个移动摄像机在不同的位置。姿势针对人体的重要部位以及身体周围的物体，例如脸部、手部或桌子上的物体。这个记录不仅帮助我们研究人类如何移动，还帮助我们研究这些重要部分在实际通信中如何被看到以及它们携带什么信息。在第三个主题上，我们研究了一种新方法，利用上述系统获取的数据来选择观察和记录人类行为的时间、焦点。本研究旨在通过使用人体运动理解来选择摄像机和框架，生成易于理解的报告或演示或讲座摘要。