Research about Realtime Obstruct Eliminating System by using Multi Cameras

多摄像机实时清障系统研究

• 批准号: 15200008
• 负责人: HIROSE Michitaka
• 金额: $ 32.7万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2003
• 资助国家: 日本
• 起止时间: 2003 至 2005
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-15200008/
• 关键词: Obstacle Elimination; Multi Cameras; Realtime Processing; Novel View Synthesis; Spatial Information; 実時間障害物除去; 障害物透視映像; 障害物透視手法; 自然特徴点抽出; 特徴点クラスタリング; 障害物除去映像; 画像処理; 画像伝送; コンピュータビジョン; ユピキタス; ユビキタス

In this study, we proposed new approach to generate novel view from which obstacles are removed by using multiple cameras. To be utilized in public environment like city, the approach should have the flexibility and scalability against the alignment of cameras. By observing the obstacle-eliminated images from any point of view, user can understand an exactly ongoing event well.Thus, we proposed projective transformation based algorism to generate images in real time. By clustering feature points of input images and subdividing images depend on the clustered points, our algorism can be applied to scene in which obstacles are located in front of complex objects. Afterward, by morphing images based on the subdivided images, our approach can generate images from any viewpoint between cameras.In this work, we implemented a prototype capturing system based on the approach. The system consists of management PC and many cameras and node PCs. To maintain the performance of the system, the cameras should not be manage by one PC, and therefore we use node PCs which are connected to each camera individually. All node PCs are connected with the management PC (Pentium 4 XEON 2.8GHz) through a gigabit network (1000BASE-TX).By using this prototype system, we evaluated the performance and flexibility of the proposed method for real-time obstacle elimination. In case of several cameras, frame rate of obstacle-eliminated image is 7-10 [fps] and delay time is 160-200 [msec]. And in any patterns of camera alignments, we can eliminate obstacle from images. Also we can see the scene from any viewpoint between the camera positions while eliminating obstacles.These results show that the proposed method can eliminate obstacle from the scene in real-time by using randomly aligned cameras. In the future, by applying the method to security cameras equipped in public environment, we can easily understand the spatial information of the scene in any time in any places.

在这项研究中，我们提出了一种新的方法来生成新的视图，从该视图中的障碍物被删除，通过使用多个摄像机。为了在城市等公共环境中使用，该方法应该具有针对摄像机对准的灵活性和可扩展性。通过从任意角度观察障碍物消除后的图像，用户可以更好地理解正在发生的事件，因此，我们提出了基于投影变换的图像生成算法来实现图像的真实的实时生成。通过对输入图像的特征点进行聚类，并根据聚类点对图像进行细分，该算法可以应用于复杂物体前方有障碍物的场景。然后，通过在细分图像的基础上对图像进行变形，我们的方法可以在摄像机之间生成任意视点的图像。该系统由管理PC机和多台摄像机及节点PC机组成。为了保持系统的性能，摄像机不应该由一台PC管理，因此我们使用单独连接到每个摄像机的节点PC。通过千兆网络（1000 BASE-TX）将所有节点PC机与管理PC机（Pentium 4 XEON 2.8GHz）相连，利用该原型系统，对所提出的实时障碍物排除方法的性能和灵活性进行了评估。在多个摄像机的情况下，障碍物消除图像的帧速率为7-10 [fps]，延迟时间为160-200 [msec]。在任意的摄像机对准模式下，我们都可以从图像中消除障碍物。实验结果表明，该方法能够利用随机排列的摄像机实时地从场景中消除障碍物，并且在消除障碍物的过程中，可以从任意摄像机位置之间的任意视点看到场景。将来，通过将该方法应用于公共环境中配备的安全摄像机，我们可以轻松地了解任何时间任何地点的场景的空间信息。

项目成果

多視点カメラによる監視システムの状況把握効率向上

利用多视角摄像机提高监控系统态势感知效率

• 发表时间: 2005
• 期刊: 映像情報メディア学会誌 59・6
• 作者: 村松孝治;小林一郎;谷川智洋;山下淳;広田光一;廣瀬通孝
• 通讯作者: 廣瀬通孝

Improving the Situation Assessment Efficiency of Monitoring Systems Using Multiple Cameras

提高多摄像头监控系统的态势评估效率

• 发表时间: 2005
• 期刊: Proceedings of the Virtual Reality Society of Japan, the 10th Annual Conference
• 作者: Koji Muramatsu;Shota Sasahara;Tomohiro Tanikawa;Koichi Hirota;Michitaka Hirose
• 通讯作者: Michitaka Hirose

Projected Reality - Enhancing Projected Augmentations by Dynamically Choosing the Best Among Several Projection Systems

投影现实 - 通过动态选择多个投影系统中的最佳方案来增强投影增强效果

• 发表时间: 2006
• 期刊: Proceedings IEEE Virtual Reality 2006
• 作者: Jochen Ehnes;Michitaka Hirose
• 通讯作者: Michitaka Hirose

Real WorldVideoAvatar : Real-time and Real-size Transmission and Presentation of Human Figure

Real WorldVideoAvatar ：实时、真尺寸的人物形象传输和呈现

• 发表时间: 2005
• 期刊: Proc. of 15th International Conference on Artificial Reality and Telexistence (ICAT 2005)
• 作者: Tomohiro Tanikawa;Yasuhiro Suzuki;Koichi Hirota;Michitaka Hirose
• 通讯作者: Michitaka Hirose

Projected Appliications - Taking application from the desktop onto real world objects

投影应用程序 - 将应用程序从桌面应用到现实世界的对象上

• 发表时间: 2005
• 期刊: 11th International Conference on Human-Computer Interaction(HCI) (CDROM(Paper No.1966))
• 作者: Jochen Ehnes;Koichi Hirota;Michitaka Hirose
• 通讯作者: Michitaka Hirose