Enrichment and multi-purpose visualization of building models with emphasis on thermal infrared data

该提案涉及3D建筑模型的丰富和可视化方面。它服务于四个主要目标：（1）将地理参考信息与3D建筑物几何形状相结合，（2）基于与来自3D建筑物模型的背景信息相结合的图像分析，从热红外数据中提取和解释不可见特征，（3）利用从不可见特征导出的信息来丰富和更新3D建筑物模型，以及（4）可视化语义属性，该语义属性描述强调时间相关的热信息的丰富的3D建筑物模型的各种表面元素。所涉及的任务将由地图学系和摄影测量与遥感系共同完成。在第一个供资期间开展的工作集中于获取、分析热数据并将其与现有三维模型相结合。一方面，从红外图像和图像序列中生成表面纹理;另一方面，为三维场景仿真和地理信息数据集成准备了必要的数据库基础设施。第二个资助期的工作将集中于地理标志数据的整合、照明模型与图像记录时间的同步、从表面纹理提取特征、可视化和交互式查询。该方案的创新之处体现在三个方面：（1）提出了一种迭代策略，通过结合处理来自可见光和非可见光区域的最新传感器数据并重用现有的地理信息来丰富三维建筑模型的热信息。(2)3D数据建模标准适于允许热信息与3D建筑几何形状的集成。(3)它开发的可视化技术超越了建筑外观的图像叠加或照片级真实感渲染。查询技术的目的是使丰富的3D建筑模型在不同的粒度级别为用户访问。

The proposal addresses the aspects of enrichment and visualization of 3D building models. It serves four principal goals: (1) to integrate geo-referenced information with 3D building geometries, (2) to extract and interpret non-visible features from thermal infrared data based on image analysis coupled with context information from 3D building models, (3) to enrich as well as update the 3D building models with the information derived from non-visible features, and (4) to visualize semantic attributes describing various surface elements of enriched 3D building models with emphasis on time-dependent thermal information. The involved tasks will be jointly accomplished by the Department of Cartography and the Department of Photogrammetry and Remote Sensing. The conducted work during the first funding period was concentrated on the acquisition, analysis and integration of thermal data with existing 3D models. On the one hand, surface textures were generated from infrared images and image sequences. On the other hand, the necessary database infrastructure was prepared for 3D scene simulation and GI data integration. The work for the second funding period will be concentrated on GI data integration, synchronization of illumination model with image recording times, extraction of features from surface textures, visualization and interactive queries. The novelties of this proposal are reflected in three aspects: (1) It develops an iterative strategy to enrich 3D building models with thermal information by combined processing of up-to-date sensor data from visible and non-visible domain and reusing the existing geoinformation. (2) 3D data modeling standards are adapted to allow the integration of thermal information with 3D building geometries. (3) It develops visualization techniques that go beyond the image draping or photorealistic rendering of building appearance. Query techniques are designed to make the enriched 3D building models at different granularity levels accessible for the user.