Collaborative Research: Knowledge Guided Machine Learning: A Framework for Accelerating Scientific Discovery

协作研究：知识引导机器学习：加速科学发现的框架

• 批准号: 1934668
• 负责人: Imme Ebert-Uphoff
• 金额: $ 39.97万
• 依托单位: Colorado State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-09-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1934668&HistoricalAwards=false
• 关键词: Collaborative; Research; Knowledge; Guided; Machine

The success of machine learning (ML) in many applications where large-scale data is available has led to a growing anticipation of similar accomplishments in scientific disciplines. The use of data science is particularly promising in scientific problems involving processes that are not completely understood. However, a purely data-driven approach to modeling a physical process can be problematic. For example, it can create a complex model that is neither generalizable beyond the data on which it was trained nor physically interpretable. This problem becomes worse when there is not enough training data, which is quite common in science and engineering domains. A machine learning model that is grounded by explainable theories stands a better chance at safeguarding against learning spurious patterns from the data that lead to non-generalizable performance. This is especially important when dealing with problems that are critical and associated with high risks (e.g., extreme weather or collapse of an ecosystem). Hence, neither an ML-only nor a scientific knowledge-only approach can be considered sufficient for knowledge discovery in complex scientific and engineering applications. This project is developing novel techniques to explore the continuum between knowledge-based and ML models, where both scientific knowledge and data are integrated synergistically. Such integrated methods have the potential for accelerating discovery in a range of scientific and engineering disciplines. This project will train interdisciplinary scientists who are well versed in such methods and will disseminate results of the project via peer-reviewed publications, open-source software, and a series of workshops to engage the broader scientific community.This project aims to develop a framework that uses the unique capability of data science models to automatically learn patterns and models from data, without ignoring the treasure of accumulated scientific knowledge. Specifically, the project builds the foundations of knowledge-guided machine learning (KGML) by exploring several ways of bringing scientific knowledge and machine learning models together using pilot applications from four domains: aquatic ecodynamics, climate and weather, hydrology, and translational biology. These pilot applications were selected because they are at tipping points where knowledge-guided machine learning can have a transformative effect. KGML has the potential for providing scientists and engineers with new insights into their domains of interest and will require the development of innovative new machine learning approaches and architectures that can incorporate scientific principles. Scientific knowledge, KGML methods, and software developed in this project could potentially be extended to a wide range of scientific applications where mechanistic (also known as process-based) models are used.This project is part of the National Science Foundation's Harnessing the Data Revolution (HDR) Big Idea activity.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

机器学习（ML）在许多可获得大规模数据的应用中的成功，导致人们越来越期待在科学学科中取得类似的成就。数据科学的使用在涉及尚未完全理解的过程的科学问题中特别有前途。然而，一个纯粹的数据驱动的方法来建模一个物理过程可能是有问题的。例如，它可以创建一个复杂的模型，该模型既不能在训练数据之外推广，也不能在物理上解释。当没有足够的训练数据时，这个问题变得更糟，这在科学和工程领域中非常常见。 基于可解释理论的机器学习模型更有可能防止从导致不可推广性能的数据中学习虚假模式。当处理关键且与高风险相关的问题时（例如，极端天气或生态系统崩溃）。 因此，在复杂的科学和工程应用中，无论是ML方法还是科学知识方法都不能被认为足以进行知识发现。该项目正在开发新技术，以探索基于知识的模型和ML模型之间的连续性，其中科学知识和数据协同集成。这种综合方法有可能在一系列科学和工程学科中加速发现。该项目将培养精通这些方法的跨学科科学家，并将通过同行评审的出版物、开源软件和一系列研讨会传播项目成果，以吸引更广泛的科学界参与。该项目旨在开发一个框架，利用数据科学模型的独特能力，从数据中自动学习模式和模型，而不忽视积累的科学知识的宝藏。具体而言，该项目通过探索将科学知识和机器学习模型结合在一起的几种方法，建立了知识引导机器学习（KGML）的基础，这些方法使用来自四个领域的试点应用程序：水生生态动力学，气候和天气，水文学和转化生物学。之所以选择这些试点应用程序，是因为它们正处于知识引导的机器学习可以产生变革性影响的临界点。 KGML有潜力为科学家和工程师提供对他们感兴趣领域的新见解，并将需要开发创新的新机器学习方法和架构，以融入科学原理。科学知识，KGML方法，在这个项目中开发的软件可能会扩展到广泛的科学应用，该项目是美国国家科学基金会利用数据革命（HDR）项目的一部分大创意活动。该奖项反映了NSF的法定使命，并通过使用基金会的知识产权进行评估，被认为值得支持。优点和更广泛的影响审查标准。

项目成果

Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variability

• DOI: 10.1029/2019ms002002
• 发表时间: 2019-12
• 期刊: Journal of Advances in Modeling Earth Systems
• 影响因子: 6.8
• 作者: B. Toms;E. Barnes;I. Ebert‐Uphoff

Indicator Patterns of Forced Change Learned by an Artificial Neural Network

• DOI: 10.1029/2020ms002195
• 发表时间: 2020-09-01
• 期刊: JOURNAL OF ADVANCES IN MODELING EARTH SYSTEMS
• 影响因子: 6.8
• 作者: Barnes, Elizabeth A.;Toms, Benjamin;Anderson, David
• 通讯作者: Anderson, David

Carefully Choose the Baseline: Lessons Learned from Applying XAI Attribution Methods for Regression Tasks in Geoscience

仔细选择基准：将 XAI 归因方法应用于地球科学回归任务的经验教训

• DOI: 10.1175/aies-d-22-0058.1
• 发表时间: 2023
• 期刊: Artificial Intelligence for the Earth Systems
• 作者: Mamalakis, Antonios;Barnes, Elizabeth A.;Ebert-Uphoff, Imme
• 通讯作者: Ebert-Uphoff, Imme

A Primer on Topological Data Analysis to Support Image Analysis Tasks in Environmental Science

支持环境科学中图像分析任务的拓扑数据分析入门

• DOI: 10.1175/aies-d-22-0039.1
• 发表时间: 2023
• 期刊: Artificial Intelligence for the Earth Systems
• 作者: Ver Hoef, Lander;Adams, Henry;King, Emily J.;Ebert-Uphoff, Imme
• 通讯作者: Ebert-Uphoff, Imme

Evaluation, Tuning, and Interpretation of Neural Networks for Working with Images in Meteorological Applications

• DOI: 10.1175/bams-d-20-0097.1
• 发表时间: 2020-12-01
• 期刊: BULLETIN OF THE AMERICAN METEOROLOGICAL SOCIETY
• 影响因子: 8
• 作者: Ebert-Uphoff, Imme;Hilburn, Kyle
• 通讯作者: Hilburn, Kyle