Automatic 3D-reconstruction of buildings using highly resolving video sequences

我们提出了一个全自动的原型系统来完善城市三维地理信息系统的建筑物模型使用地面影像数据。数字视频序列对于这种目前未被充分利用的摄影测量应用具有很高的潜力。射影几何提供了一种有效的数学框架，可以从具有不同参数的部分标定相机中获取几何精确信息。目前，它正在与目标重建方法相结合，以提高其自动化性能。主要的新奇之处是空间和时间图像匹配的密集集成，就像WeIL作为几何和反射信息一样。摄影测量模型部分地从三焦相机系统的相邻图像重建，部分地从视频序列的前面和后面的图像重建。观察到的建筑物由平面、多面体和自由形成的表面组成。我们使用曲面装配的通用模型和特定的场景约束来提取、对齐和分类多边形基元。此外，知识驱动的对象提取用于支持图像定向，并可能用于替换控制信息。这种方法是为记录的数字视频的离线处理而设计的，因为处理手持无标记视频流的计算要求超出了今天的实时系统的能力。我们希望开发一个数学同质的框架，它包括摄影测量模型生成、时间跟踪和反射率分析，以及目标提取和分类。这种从几个三焦视图生成的系统模型给了数字视频系统充分的潜力。

We propose a fully automated prototype system to refine building models of an urban 3D GIS using terrestrial image data. Digital video sequences contain a high potential for such photogrammetric applications which is presently not fully used. Projective geometry provides an effective mathematical framework to obtain geometrically precise information from partially calibrated cameras with varying parameters. Presently, it is being combined with object reconstruction methods improving its performance in automation. The main novelty is an intensive Integration of spatial and temporal image matching as weil as geometric and reflectance information. The photogrammetric model is partially reconstructed from the neighboring images of a trifocal camera system, partially from the preceding and following images of the video sequence. The observed buildings consist of planes, polyhedrons and freely formed surfaces. We use generic models of surface assemblies together with particular scene constraints to extract, align and classify the polygonal primitives. Additionally, the knowledge-driven object extraction is used to support the Image orientation and probably to replace control information. The approach is designed for off-line processing of recorded digital video, because the computational requirements to deal with hand-held markerless video streams exceed the capabilities of today real-time systems. We want to develop a mathematically homogeneous framework which incorporates photogrammetric model generation, temporal tracking, and reflectance analysis as weil as object extraction and classification. Such systematic model generation from several trifocal views gives a digital video system its full potential.