CAREER: Unifying Scientific Knowledge with Machine Learning for Forward, Inverse, and Hybrid Modeling of Scientific Systems

职业：将科学知识与机器学习相结合，对科学系统进行正向、逆向和混合建模

• 批准号: 2239328
• 负责人: Anuj Karpatne
• 金额: $ 59.57万
• 依托单位: Virginia Polytechnic Institute and State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-07-01 至 2028-06-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2239328&HistoricalAwards=false
• 关键词: CAREER; Unifying; Scientific; Knowledge; Machine

One of the fundamental goals in science is to build mathematical models of scientific systems that can explain the nature of the physical world by predicting the system's behavior. Current standards of science-based models, rooted in scientific theories and equations, suffer from several shortcomings in modeling complex real-world systems. At the core of these shortcomings is their theoretical scientific nature that restricts them from making effective use of data that is not well-described theoretically. Consequently, machine learning methods, that can automatically extract patterns and relationships from data, are increasingly being viewed as promising alternatives to science-based models. However, black-box machine learning models, that solely rely on information contained in data and are agnostic to scientific theories, have met with limited success in scientific problems. Instead, there is a growing realization to unify scientific knowledge with machine learning in the emerging field of knowledge-guided machine learning. This project aims to make novel advances in knowledge-guided machine learning in the context of three driving use-cases: fluid dynamics, aerosol modeling, and lake modeling. A central goal of this project is to prepare the next generation of workforce in science and engineering comprising of a diverse cadre of students who can easily cross disciplinary boundaries between machine learning and scientific fields. This project will also have direct impacts to science and society through the three real-world use-cases and through collaborations with industry partners. The long-term vision of this project is to establish knowledge-guided machine learning as a full-fledged research and education discipline for the advancement of science. This project aims to make novel advances in three primary research tasks of knowledge-guided machine learning: forward modeling with scientific equations and data, inverse modeling for inferring parameters in science-based models, and hybrid-science-machine learning modeling to remove imperfections in science-based models. This project will contribute transformative innovations in knowledge-guided machine learning for incorporating a wide variety of scientific knowledge in machine learning frameworks, from partial differential equations in fluid dynamics to numerical models in aerosol modeling and phenomenological rules in lake modeling. In the task of forward modeling, this project will develop a new class of algorithms in science-guided curriculum learning to exploit the interplay between data-driven and scientific supervision while training deep learning models. This project will also develop novel science-guided resampling strategies for generating scientifically consistent predictions during inference. In the task of inverse modeling, this project will lead to novel formulations of knowledge-guided inverse modeling, where scientific supervision (in terms of knowledge of the forward model) is used to guide the training of machine learning-based inverse models. In the task of hybrid modeling, this project will result in a new class of residual correcting neural networks for augmenting systematic biases or residuals in science-based outputs, and methods to jointly infer parameters of science-based models while correcting for residuals in their outputs. Beyond the three use-cases, the methodologies developed in this project can potentially impact a number of scientific disciplines where scientific knowledge and models are routinely used.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

科学的基本目标之一是建立科学系统的数学模型，通过预测系统的行为来解释物理世界的本质。当前基于科学的模型标准，植根于科学理论和方程，在建模复杂的现实世界系统时存在一些缺点。这些缺点的核心是它们的理论科学性，这限制了它们有效利用理论上没有很好描述的数据。因此，可以从数据中自动提取模式和关系的机器学习方法越来越被视为基于科学的模型的有前途的替代方案。然而，黑盒机器学习模型，仅仅依赖于数据中包含的信息，对科学理论是不可知的，在科学问题上取得了有限的成功。相反，在知识引导的机器学习这一新兴领域，人们越来越意识到将科学知识与机器学习相结合。该项目旨在在三个驱动用例的背景下，在知识引导的机器学习方面取得新的进展：流体动力学，气溶胶建模和湖泊建模。该项目的一个核心目标是培养下一代科学和工程人才，由多样化的学生组成，他们可以轻松跨越机器学习和科学领域之间的学科界限。该项目还将通过三个真实世界的用例以及与行业合作伙伴的合作对科学和社会产生直接影响。该项目的长期愿景是将知识引导的机器学习建立为促进科学进步的成熟的研究和教育学科。该项目旨在在知识引导的机器学习的三个主要研究任务中取得新的进展：使用科学方程和数据进行正向建模，用于推断基于科学的模型中的参数的逆向建模，以及混合科学机器学习建模以消除基于科学的模型中的缺陷。该项目将在知识引导的机器学习方面做出变革性的创新，将各种科学知识纳入机器学习框架，从流体动力学中的偏微分方程到气溶胶建模中的数值模型和湖泊建模中的现象学规则。在前向建模任务中，该项目将在科学指导的课程学习中开发一类新的算法，以利用数据驱动和科学监督之间的相互作用，同时训练深度学习模型。该项目还将开发新的科学指导的推理策略，用于在推理过程中生成科学一致的预测。在逆向建模任务中，该项目将导致知识引导的逆向建模的新公式，其中科学监督（就正向模型的知识而言）用于指导基于机器学习的逆向模型的训练。在混合建模任务中，该项目将产生一类新的残差校正神经网络，用于增强基于科学的输出中的系统偏差或残差，以及在校正其输出中的残差时联合推断基于科学的模型参数的方法。除了这三个用例之外，该项目中开发的方法可能会影响一些科学知识和模型经常使用的科学学科。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估来支持。