3D-Surface Reconstruction

3D 表面重建

• 批准号: 200549338
• 负责人: Professor Dr. Daniel Cremers
• 金额: --
• 依托单位: Lehrstuhl für Photogrammetrie
• 依托单位国家: 德国
• 项目类别: Research Units
• 财政年份: 2011
• 资助国家: 德国
• 起止时间: 2010-12-31 至 2018-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/200549338?language=en
• 关键词: 3D; Surface; Reconstruction

The focus of P5 is the estimation of dense and high-resolution 3D reconstruction from the available image data. To this end, we pursue a two-stage strategy:(1) Based on the onboard stereo camera, we aim at computing a crude semi-dense visual SLAM (depth maps, geometry and camera motion). It is computed at video frame rate on the quadrotor and takes into account the statistical uncertainty of 3D locations and image information.(2) On the ground station, we improve the semi-dense 3D reconstruction toward a high-resolution dense 3D reconstruction by also taking into account the high-resolution images from the main sensor. More specifically we plan to generate dense depth maps which are then fused to a dense 3D model. This step will also take into account 3D point clouds from bundle adjustment and 3D point clouds from the laser scanner. In this second phase of the project, we will emphasize robustness to perturbations through reflections, homogeneous surfaces and over-exposure.A central advantage of this two-stage strategy is that we will have a rudimentary self-localization and semi-dense 3D reconstruction of the scene computed onboard in a manner that does not depend on the communication with the ground station.The resulting semi-dense 3D reconstruction can for example be used for an adaptive viewpoint planning: During the flight, the system can immediately identify for which locations it has not obtained sufficient visual information yet. This information can in turn be used to adapt the flight trajectory so as to assure an optimal exploration of unknown territory.

P5的重点是从现有的图像数据中估计密集和高分辨率的三维重建。为此，我们采取了两个阶段的策略：(1)基于车载立体摄像头，我们的目标是计算粗糙的半密集视觉SLAM（深度图，几何和相机运动）。它是在四旋翼上以视频帧速率计算的，并考虑了三维位置和图像信息的统计不确定性。(2)在地面站，我们将半密集三维重建改进为高分辨率密集三维重建，同时考虑到主传感器的高分辨率图像。更具体地说，我们计划生成密集的深度图，然后融合到密集的3D模型。这一步还将考虑从束调整和激光扫描仪的3D点云。在项目的第二阶段，我们将强调通过反射、均匀表面和过度曝光对扰动的鲁棒性。这种两阶段策略的一个核心优势是，我们将以不依赖于与地面站通信的方式，对机载计算的场景进行基本的自我定位和半密集3D重建。由此产生的半密集3D重建可以用于自适应视点规划：在飞行过程中，系统可以立即识别哪些位置尚未获得足够的视觉信息。这些信息反过来可以用来调整飞行轨迹，以确保对未知领域的最佳探索。

项目成果

Real-time trajectory replanning for MAVs using uniform B-splines and a 3D circular buffer

• DOI: 10.1109/iros.2017.8202160
• 发表时间: 2017-03
• 期刊: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
• 作者: V. Usenko;L. Stumberg;A. Pangercic;D. Cremers