Automatic 3D-reconstruction of buildings using highly resolving video sequences

在过去的一段时间里，我们成功地开发了一个原型系统，利用地面图像数据为城市三维地理信息系统生成建筑模型。这个全自动系统的一个特点是输入和输出数据的高度冗余。到目前为止，这片土地只开发了一部分。因此，我们希望利用密集空间匹配和稀疏时间跟踪相结合的技术来提高相机长位移的自运动恢复和重建质量。几个自动选择的代表性点将存储在八叉树数据结构中，并用作3D场景的控制网格。这些点允许系统确定姿态估计、目标重建和误差最小化的最佳三角测量条件。此外，我们希望扩展现有的系统，为每个3D点提供质量度量。弱测量的部分可以在视频序列中以较好的精度再现。这些相同的部分由上述代表性点检测，并通过选择适当的权重来提高全局精度。重建的fa？Ade包含闭塞物体如汽车、树木和街道照明的间隙。由于我们有大量的冗余数据，我们可以自动填补漏洞。关键的任务是分离被遮挡的部分，并从其他重建中整合点云。此外，必须使用运动分割来检测非刚性对象，以防止不一致。最后，我们希望在现有的GIS数据库中整合多个不同尺度的重建。

In the last period we successfully developed a prototype system to generate building models for an urban 3D GIS using terrestrial image data. One attribute of this fully automated system is its high redundancy of input and output data. This property has only been partially exploited so far. Therefore, we want to improve the egomotion recovery for extended camera excursions and the reconstruction quality using the integrated techniques of dense spatial matching and sparse temporal tracking. Several automatically selected representative points will be stored in an octree data structure and used as a control grid for the 3D scene. These points allow the system to determine optimal triangulation conditions for pose estimation, object reconstruction and error minimization. Furthermore, we want to extend our existing system with a quality measure for every 3D point. Weakly measured parts can reappear during the video sequence with better accuracy. These identical parts are detected by the representative points described above and enhance the global accuracy by selection of appropriate weights. The reconstructed fa?ade contains gaps from occluding objects like cars, trees and street lighting. Due to our large amount of redundant data we can fill up holes automatically. The critical task is to separate occluded parts and integrate point clouds from other reconstructions. Additionally, non-rigid objects must be detected using motion segmentation to prevent inconsistencies. Finally, we want to integrate several reconstructions with varying scales in an existing GIS database.