Real-time High Precision Multi-media Integration System Using Distributed Multi-sensor Network

采用分布式多传感器网络的实时高精度多媒体集成系统

• 批准号: 14380167
• 负责人: TANIGUCHI Rin-ichiro
• 金额: $ 9.47万
• 依托单位: KYUSHU UNIVERSITY
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-14380167/
• 关键词: Sensor network; Parallel-distributed processing; Real-time processing; Confidence driven architecture; Quality and real-time feature; Multi-view image analysis; Computer vision; 分散処理; ビジョンシステム

The aim of this project is to provide a system to provide users "arbitrary views" of the real-world information depending on the users' demands.To achieve this goal, we have to observe the real world precisely through a lot of sensors and to integrate the sensed data into a meaningful information coincide with the user's request. In this project, we have established a framework of real-time acquisition and integration of information from multiple sensors, especially multiple cameras. The major achievements of this project are summarized as follows.1.Integration of images acquired by multiple camerasWe have established a software framework to integrate, in real-time, images acquired by multiple cameras on a parallel-distributed computers, PC cluster. To achieve the real-time issue, we have also developed a mechanism to make the processing time constant based on variable-resolution strategy, in which the resolution of 3D space is changed depending on the geometrical complexity of an obse … More rved object.2.Real-time execution control of vision systemThere is a trade-off between required confidence and required computational resources of vision processings. For example, when we require precise result, the longer processing time is required. In practical applications, especially real-time ones, we have to make this difficult trade-off depending on the required accuracy and the available resources. Here, we have established a real-time execution control mechanism, called Confidence Driven mechanism, which controls the trade-off dynamically, depending on the user's required confidence, based on prediction of data and accuracies of implemented algorithms.3.Construction of prototypical systems and evaluationBased on the previous results, we have implemented prototypical applications : real-time vision-based human motion capturing and real-time free view-point video on a PC cluster, which has 9 IEEE cameras and 20 or more PCs. The experimental results show the effectiveness of our software framework of real-time vision processing. Less

这个项目的目的是提供一个系统，根据用户的需求为用户提供真实世界信息的“任意视图”。为了实现这一目标，我们必须通过大量的传感器来精确地观察现实世界，并将感知到的数据整合成符合用户要求的有意义的信息。在这个项目中，我们建立了一个实时采集和集成多个传感器，特别是多个摄像头信息的框架。本项目的主要成果总结如下：多摄像机采集图像的集成我们建立了一个软件框架，在并行分布式计算机PC集群上实时集成多摄像机采集的图像。为了实现实时问题，我们还开发了一种基于变分辨率策略的处理时间常数机制，其中三维空间的分辨率根据物体的几何复杂性而变化。视觉系统的实时执行控制在视觉处理所需的置信度和所需的计算资源之间存在权衡。例如，当我们需要精确的结果时，需要更长的处理时间。在实际应用中，特别是实时应用中，我们必须根据所需的准确性和可用资源做出这种困难的权衡。在此，我们建立了一种实时执行控制机制，称为置信度驱动机制，该机制基于对数据的预测和实现算法的准确性，根据用户所需的置信度动态控制权衡。原型系统的构建和评估基于先前的结果，我们在一个PC集群上实现了原型应用：基于实时视觉的人体运动捕捉和实时自由视点视频，该集群有9个IEEE摄像机和20台或更多的PC。实验结果表明了所设计的实时视觉处理软件框架的有效性。少

项目成果

3次元ビデオ映像のオンライン生成

在线生成 3D 视频素材

• 发表时间: 2004
• 期刊: 画像の認識・理解シンポジウム(MIRU2004) 2
• 作者: Keigo Takahashi;Takuya Nishimoto;Shigeki Sagayama;上田 恵 他
• 通讯作者: 上田 恵 他

吉本廣雅, 有田大作, 谷口倫一郎: "実時間ビジョンシステムのための信頼度駆動メモリ"情報処理学会論文誌. 44・10. 2428-2436 (2003)

Hiromasa Yoshimoto、Daisaku Arita、Rinichiro Taniguchi：“实时视觉系统的可靠性驱动存储器”日本信息处理学会会刊 44・10（2003 年）。

吉本廣雅, 有田大作, 谷口倫一郎: "実時間分散画像処理システムのための信頼度駆動アーキテクチャ"「ハイパフォーマンスコンピューティングとアーキテクチャの評価」に関する北海道ワークショップ(HOKKE-2004). (発表予定). (2003)

Hiromasa Yoshimoto、Daisaku Arita、Rinichiro Taniguchi：“实时分布式图像处理系统的可靠性驱动架构”北海道“高性能计算和架构评估”研讨会（HOKKE-2004）（计划演示）。

Real-time human motion sensing based on vision-based inverse kinematics for interactive applications

• DOI: 10.1109/icpr.2004.1334531
• 发表时间: 2004-08
• 期刊: Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004.
• 作者: N. Date;H. Yoshimoto;Daisaku Arita;R. Taniguchi

Vision-based real-time motion capture system using multiple cameras

• DOI: 10.1109/mfi-2003.2003.1232665
• 发表时间: 2003-09
• 期刊: Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003.
• 作者: H. Yoshimoto;N. Date;S. Yonemoto