Generating and Maintaining Multi-Level 3D City Models Using Advanced Multi-Modal Image Processing

使用高级多模态图像处理生成和维护多层次 3D 城市模型

• 批准号: RGPIN-2020-04698
• 负责人: Jabari, Shabnam
• 金额: $ 1.89万
• 依托单位: University of New Brunswick
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=754682
• 关键词: Generating; Maintaining; Multi; Level; 3D

3D city models that present urban objects and structures, such as buildings, in a three-dimensional geometry are being increasingly used for a wide range of applications, including smart cities, urban planning, disaster management and security. 3D city models are generated in different Levels of Detail (LoD); for example, LoD1 only contains a rough block representation of buildings while LoD3 contains the delicate architectural structures as well as the location of the windows and doors within buildings. The LoD=3 models deal with the exterior of buildings and urban objects, while LoD4 focuses on building interiors. Different applications require different levels of detail. Thus, it is necessary to have multi-level representations of 3D city models to accommodate various requirements. Although 3D city models are vital in different Geomatics and Urban Management applications, producing the models with high LoDs (=2) is still costly and labor-intensive - thus, the development rate of such models for cities is prolonged. Consequently, only a few cities in the world have limited multi-level 3D city models (mainly up to LoD2). Furthermore, maintaining 3D city models is currently very challenging, hence in many applications, instead of updating, 3D city models are regenerated after a certain period. The long term objective of my research program is to develop breakthrough methods to automatically generate and maintain standards-compliant multi-level 3D city models, using a photogrammetric basis combined by learning methods in image processing. The short term objectives of this research program are to develop automatic methods to (1) generate 3D city models, (2) detect changes in the existing models and (3) update the models to maintain the LoD=3 city models (focusing on building exteriors). My grad students and I will combine modern learning techniques, i.e. machine learning and deep learning, and basic photogrammetric concepts to further develop what we have achieved up to date in terms of change detection and sensor modeling to pursue the short goals of this research program. For this purpose, we will use images taken from different angles (e.g. oblique and nadir), different platforms (e.g. terrestrial and airborne) and various sensors (e.g. multispectral, LiDAR) that are referred to as multi-modal images. To pursue the short term objectives, I am going to hire and train 9 HQP in total (2 PhD, 2 MSc, 5 BSc) in the field of Remote Sensing, Photogrammetry and GIS working at the Department of Geodesy and Geomatics Engineering, University of New Brunswick. This initiative will place Canada within the group of leading countries in this field, enabling Canadians to benefit from the opportunities provided by 3D city models in different applications such as disaster management and smart cities.

3D城市模型以三维几何形式呈现城市对象和结构，如建筑物，正越来越多地被用于广泛的应用，包括智能城市、城市规划、灾害管理和安全。3D城市模型以不同的细节级别(LOD)生成；例如，LoD1仅包含建筑物的粗略块表示，而LoD3包含精细的建筑结构以及建筑物内窗和门的位置。LOD=3模型处理建筑物和城市对象的外部，而LOD4模型侧重于建筑物内部。不同的应用程序需要不同的细节级别。因此，有必要对3D城市模型进行多层次的表示，以适应各种需求。虽然3D城市模型在不同的Geomatics和城市管理应用中是至关重要的，但制作具有高LOD(=2)的模型仍然是昂贵和劳动密集型的-因此，这类模型的开发速度被延长了。因此，世界上只有少数城市拥有有限的多层次3D城市模型(主要是LoD2)。此外，目前维护3D城市模型非常具有挑战性，因此在许多应用中，3D城市模型在一段时间后重新生成，而不是更新。我的研究计划的长期目标是开发突破性的方法，利用摄影测量学基础和图像处理中的学习方法相结合，自动生成和维护符合标准的多级别3D城市模型。该研究计划的短期目标是开发自动方法来(1)生成3D城市模型，(2)检测现有模型中的变化，以及(3)更新模型以维护LOD=3城市模型(重点是建筑外部)。我和我的研究生们将结合现代学习技术，即机器学习和深度学习，以及基本的摄影测量学概念，进一步发展我们在变化检测和传感器建模方面的最新成就，以实现本研究计划的短期目标。为此，我们将使用从不同角度(例如倾斜和最低点)、不同平台(例如陆地和机载)和各种传感器(例如多光谱、激光雷达)拍摄的图像，这些图像被称为多模式图像。为了追求短期目标，我将招聘和培训在新不伦瑞克大学大地测量和地球工程系工作的遥感、摄影测量和地理信息系统领域的总共9名HQP(2名博士、2名硕士、5名学士)。这一倡议将使加拿大跻身该领域的领先国家之列，使加拿大人能够受益于3D城市模型在灾害管理和智慧城市等不同应用中提供的机会。