Three-dimensional Modeling of Dynamic Environments Employing Mobile Stereo Vision

采用移动立体视觉的动态环境三维建模

• 批准号: 14580450
• 负责人: ISHIKAWA Seiji
• 金额: $ 1.6万
• 依托单位: Kyushu Institute Of Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2003
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-14580450/
• 关键词: Motion capturing; Camera calibration; Three-dimensional recovery; Stereoscopic cameras; Stereoscopic vision; Factorization; カメラキャリブレーション; ステレオカメラ; ステレオ; 因子分解; 復元; モデル化; モバイル; モバイルカメラ

Three-dimensional modeling of human motions is important, since it has many application fields such as rehabilitation, sports, video game production, etc. In order to perform three-dimensional modeling, the motion concerned normally needs to be acted in a large studio equipped with a number of settled cameras This excludes various motions (motions observed outdoors, for example) from being modeled, however. There hasn't been an established modeling. technique that can model those motions which are acted in various places including outdoor environments.In this situation, the present research aims at achieving the followings :(1)To develop a three-dimensional shape/motion recovery technique based on more than two mobile cameras that capture images while moving.(2)To develop a technique for three-dimensional modeling of a remote dynamic environment where people have various actions by sending the images using an image transfer apparatus.We have developed a technique for modeling a three-dimensional object based on image capture by mobile cameras. In the first place, we habe established a method of camera calibration using two-dimensional static feature points extracted on the obtained video images. Then we have developed a method of computing three-dimensional positions of the points on an object concerned in order to model shape/motion of the object.In the neat step, employing the above technique, we have developed a system for modeling a remote dynamic environment whose images are captured by mobile cameras and sent by image transfer apparatus. Performed experiments gave satisfactory results.

人体运动的三维建模是重要的，因为它有许多应用领域，如康复，体育，视频游戏制作等。为了执行三维建模，有关的运动通常需要在配备有许多固定摄像机的大型工作室中进行，但是，这排除了各种运动（例如，在户外观察到的运动）。还没有一个既定的模型。在这种情况下，本研究旨在实现以下目标：（1）开发基于两个以上移动的摄像机的三维形状/运动恢复技术，该摄像机在移动时捕获图像。(2)To开发了通过使用图像传送设备发送图像来对人们进行各种动作的远程动态环境进行三维建模的技术。我们开发了基于移动的相机的图像捕获来对三维对象进行建模的技术。首先，我们建立了一种基于二维静态特征点的摄像机标定方法。然后，我们已经开发了一种方法，计算三维位置的点上的对象，以便模型的形状/运动的对象。在整洁的步骤中，采用上述技术，我们已经开发了一个系统，用于建模的远程动态环境的图像被捕获的移动的相机和发送的图像传输设备。进行的实验给出了令人满意的结果。

项目成果

Tan, J.K., Ishikawa, S.: "A remote motion capture system based on mobile cameras"Proceedings of IAPR Workshop on Machine Vision Applications. 205-208 (2002)

Tan, J.K., Ishikawa, S.：“基于移动相机的远程动作捕捉系统”IAPR 机器视觉应用研讨会论文集。

Tabusa, T., Tan, J.K., Ishikawa, S.: "Recovering 3-D wide range human motions employing mobile cameras"Proceedings of SICE Annual Conference. 1502-1503 (2002)

Tabusa, T.、Tan, J.K.、Ishikawa, S.：“利用移动摄像头恢复 3D 大范围人体运动”SICE 年会论文集。

Tabusa, Tan, Ishikawa, Hirokawa: "Recovering wide range human motions by a mobile cameras system"Proc.of IMAGE2003. 4 (2004)

Tabusa、Tan、Ishikawa、Hirokawa：“通过移动摄像头系统恢复大范围的人体运动”Proc.of IMAGE2003。

Tan, J.K., Uchinoumi, M., Ishikawa, S.: "On recovering shape of non-rigid objects employing a remote motion capture system"Proceedings of SICE Annual Conference. 1308-1313 (2002)

Tan, J.K.、Uchinoumi, M.、Ishikawa, S.：“利用远程动作捕捉系统恢复非刚性物体的形状”SICE 年会论文集。

Tan, Yamaguchi, Ishikawa: "Shape recovery of non-rigid objects by multiple mobile cameras"電子情報通信学会技術研究報告. MBE2003-142. 85-90 (2004)

Tan、Yamaguchi、Ishikawa：“通过多个移动相机恢复非刚性物体的形状”MBE2003-142 (2004)。