EAGER: Collaborative Research: III: Exploring Physics Guided Machine Learning for Accelerating Sensing and Physical Sciences

EAGER：协作研究：III：探索物理引导机器学习以加速传感和物理科学

• 批准号: 2026704
• 负责人: Anish Arora
• 金额: $ 5.02万
• 依托单位: Ohio State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-05-01 至 2021-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2026704&HistoricalAwards=false
• 关键词: EAGER; Collaborative; Research; III; Exploring

As machine learning (ML) continues to revolutionize the commercial space including vision, speech, andtext recognition, there is great anticipation in the scientific community to unlock the power of ML foraccelerating scientific discovery. However, black-box ML models, which rely solely on training data andignore existing scientific knowledge have met with limited success in scientific problems, particularlywhen labeled data is limited, sometimes even leading to spectacular failures. This is because the blackbox ML models are susceptible to learning spurious relationships that do not generalize well outside thedata they are trained for. The emerging paradigm of physics-guided machine learning (PGML), whichleverages the unique ability of ML algorithms to automatically extract patterns and models from data withguidance of the knowledge accumulated in physics (or scientific theories), aims to address the challengesfaced by black box ML in scientific applications. Significant exploratory efforts are needed to formulate and assess sound PGML approaches for particular scientific problems.For data science, PGML has the potential to transform ML beyond black-box applications by enablingsolutions that generalize well even on unseen input-output distributions that are different from thoseencountered during training, by anchoring ML methods with the scientific body of knowledge. PGML makes a distinctdeparture from the conventional view that physics-based models and ML models are developed inisolation but seldom mixed together. The proposed project is fundamentally different from existing bodyof research that attempts to combine ML and domain sciences, e.g., by making use of domain-specificknowledge in ML algorithms in simplistic ways, or making use of data in the physics-based modelingprocess albeit without allowing data to change the functional forms of existing physics-based models. The tight interplay between data science and the domains of physics and sensing in the project lends itselfnaturally to diverse education activities that complement the research tasks outlined by our team. Over theduration of this one-year project, the team will develop an integrative course at the graduate level on "MLmeets Physics", which explores topical, emerging themes in this interdisciplinary area. Offerings of thecourse will draw upon course modules shared between the four universities, such as shared guest videosand case studies. The physics department at BU has a well-developed "Physics Outreach Project" thatannually performs science exhibitions for elementary schools in Binghamton metropolitan area, for whichthe team will create a new exhibition about neural networks and ML. In follow-on work, similar outreachevents will be replicated at schools (Robinson Middle School in Lowell and Metro STEM Middle Schoolin Columbus). The PIs are committed to increasing the diversity of involvement at various levels of thetraining ecosystem impacted by this project, and have planned various coordinated broader impactactivities for inclusion of female and underrepresented minority students as well as faculty.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

随着机器学习（ML）继续彻底改变包括视觉、语音和文本识别在内的商业领域，科学界对释放ML的力量以加速科学发现充满了期待。然而，仅仅依赖于训练数据和更多现有科学知识的黑盒ML模型在科学问题上取得的成功有限，特别是当标记数据有限时，有时甚至导致惊人的失败。这是因为黑盒机器学习模型很容易学习虚假的关系，这些关系在它们训练的数据之外不能很好地推广。物理引导机器学习（PGML）的新兴范式，利用ML算法的独特能力，在物理学（或科学理论）积累的知识的指导下，从数据中自动提取模式和模型，旨在解决黑盒ML在科学应用中面临的挑战。对于数据科学来说，PGML有可能通过将ML方法与科学知识体系相结合，使ML方法能够很好地推广到与训练过程中遇到的输入-输出分布不同的未知输入-输出分布，从而将ML方法转变为超越黑盒应用的解决方案。PGML与传统观点截然不同，传统观点认为基于物理的模型和ML模型是孤立开发的，但很少混合在一起。拟议的项目从根本上不同于现有的试图将ML和领域科学结合起来的研究机构，例如，通过以简单的方式在ML算法中利用特定领域的知识，或者在基于物理的建模过程中利用数据，尽管不允许数据改变现有基于物理的模型的功能形式。数据科学与项目中的物理和传感领域之间的紧密相互作用自然地有助于各种教育活动，以补充我们团队概述的研究任务。在这个为期一年的项目期间，该团队将开发一个研究生水平的综合课程“ML符合物理学”，探讨这一跨学科领域的热门新兴主题。课程的提供将利用四所大学之间共享的课程模块，例如共享的客座视频和案例研究。BU的物理系有一个完善的“物理外展项目”，每年为宾厄姆顿大都会区的小学举办科学展览，该团队将为此创建一个关于神经网络和ML的新展览。在后续工作中，将在学校（洛厄尔的罗宾逊中学和哥伦布的Metro STEM中学）复制类似的外联活动。PI致力于增加受该项目影响的培训生态系统各级参与的多样性，并计划了各种协调的更广泛的影响活动，以纳入女性和代表性不足的少数民族学生以及教师。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估来支持。

项目成果

Specialized Embedding Approximation for Edge Intelligence: A Case Study in Urban Sound Classification

• DOI: 10.1109/icassp39728.2021.9414287
• 发表时间: 2021-06
• 期刊: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
• 作者: Sangeeta Srivastava;Dhrubojyoti Roy;M. Cartwright;J. Bello;A. Arora