Smart deep learning by incorporating remote sensing domain knowledge in vegetation characterization

将遥感领域知识融入植被表征中的智能深度学习

• 批准号: RGPIN-2021-03624
• 负责人: Hu, Baoxin
• 金额: $ 2.19万
• 依托单位: York University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=751029
• 关键词: Smart; deep; learning; incorporating; remote

The goal of this research program is to develop innovative methods to exploit the synergy between Earth observation and artificial intelligence (specifically deep learning). It is motivated by the demand for advancing science and innovation in the inventory and assessment of vegetation canopies. This is driven by technological developments in observing the Earth's surface from space, satellites or aircraft (remote sensing), and enabled by the development of deep learning. The past several years have witnessed a massive growth of deep learning in remote sensing. Even though some progress has been made, deep learning research in remote sensing is still in its infancy. It has mainly focused on applying and fine-tuning existing networks, and deep learning approaches are currently only data-driven and without any explicitly expressed existing knowledge in the domain. It is not necessary to learn what we have already known. To fully realize the potential generated by deep learning in revolutionizing remotely sensed data analysis, research is needed for in-depth integration between deep learning and remote sensing. To date, deep learning has been used to classify broad categories of land cover, but rarely for characterizing forest canopies and identifying tree species, which is important but challenging in Earth observation. The objective of this research program is to develop innovative approaches to integrate remote sensing domain knowledge and deep learning to address challenges in three related areas: 1) individual tree crown delineation, 2) individual tree species classification, and 3) the retrieval of biophysical parameters of vegetation canopies. Moreover, we will develop algorithms by exploiting the use of traditional machine learning methods and prior knowledge to solve the issues related to limited training data, the incorporation of the prior knowledge in the design the deep learning network and in the learning process, and the effective utilization of multi-source remotely sensed data. As the outcome of this research program we will ensure that Canada remains at the forefront of the artificial intelligence revolution by bridging the gap between deep learning and remote sensing. The research results will deepen our understanding of deep learning in advancing scientific and industrial applications. By providing efficient and effective ways to keep track of the species, functional status and productivity of forests, from proposed research we will help Canada be a better steward of its greatest natural resource. The practical applications are significant and wide ranging, from wildlife habitat mapping, to biofuel production, to forest fire prevention. Finally, over the next five years, HQP including 4 PhD, 4 MSc and 4 undergraduate students, will be trained to gain advanced skills to excel in either academia or industry, using their expertise to enhance Canada's brain trust in artificial intelligence and geospatial technologies.

这项研究计划的目标是开发创新方法，利用地球观测和人工智能（特别是深度学习）之间的协同作用。它的动机是对推进科学和创新的需求，在调查和评估植被冠层。这得益于从太空、卫星或飞机（遥感）观测地球表面的技术发展，并得益于深度学习的发展。在过去的几年里，深度学习在遥感领域取得了巨大的发展。尽管已经取得了一些进展，但遥感领域的深度学习研究仍处于起步阶段。它主要专注于应用和微调现有的网络，深度学习方法目前只是数据驱动的，没有任何明确表达的领域内的现有知识。我们已经知道的东西没有必要去学。为了充分发挥深度学习在遥感数据分析革命中的潜力，需要对深度学习与遥感的深度融合进行研究。迄今为止，深度学习已被用于分类广泛的土地覆盖类别，但很少用于表征森林冠层和识别树种，这在地球观测中很重要但具有挑战性。本研究计划的目标是开发创新方法，将遥感领域知识与深度学习相结合，以解决三个相关领域的挑战：1)单个树冠圈定，2)单个树种分类，以及3)植被冠层生物物理参数的检索。此外，我们将利用传统的机器学习方法和先验知识来开发算法，以解决与有限的训练数据有关的问题，将先验知识纳入深度学习网络的设计和学习过程中，以及有效利用多源遥感数据。作为这个研究项目的成果，我们将通过弥合深度学习和遥感之间的差距，确保加拿大保持在人工智能革命的前沿。研究成果将加深我们对深度学习在推进科学和工业应用方面的理解。通过提供高效和有效的方法，从拟议的研究中跟踪森林的物种、功能状况和生产力，我们将帮助加拿大更好地管理其最大的自然资源。实际应用范围广泛，从野生动物栖息地测绘到生物燃料生产，再到森林防火。最后，在未来五年内，HQP将包括4名博士，4名硕士和4名本科生，他们将接受培训，获得在学术界或工业界脱颖而出的高级技能，利用他们的专业知识增强加拿大在人工智能和地理空间技术方面的智囊团。