SHF: Medium: Language Support for Sound and Efficient Programmable Inference

SHF：中：对健全且高效的可编程推理的语言支持

• 批准号: 2311983
• 负责人: Jan Hoffmann
• 金额: $ 90万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-10-01 至 2027-09-30
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2311983&HistoricalAwards=false
• 关键词: SHF; Medium; Language; Support; Sound

The goal of this project is to make powerful Bayesian models and inference algorithms more usable, accessible, and reliable in challenging data science problems. Bayesian inference provides a principled approach to learning probabilistic models by combining prior modeling assumptions with observed data. It enables state-of-the-art results in problems from diverse areas including biostatistics, robotics, computational physics, quantitative finance, cognitive science, and machine learning. Advantages of Bayesian inference include the ability to incorporate prior domain-specific knowledge, to quantify uncertainty about parameters and predictions, and to generalize well to novel data. A key challenge, however, is correctly implementing and diagnosing Bayesian inference algorithms, especially those that target sophisticated probabilistic models. The project's novelty is to address this challenge by developing rigorous programming-language techniques that make sound and effective Bayesian inference more easily applicable. The project's impact is to boost the development and exploration of more flexible Bayesian methods among researchers and help domain experts more reliably leverage these technologies for real-world problems.The research plan of the project builds on probabilistic programming languages (PPLs) such as Stan, Gen, and Pyro, which provide interfaces that cleanly separate model development from the specification of the corresponding inference algorithm. To make Bayesian learning feasible for more flexible models and larger data sets, several PPLs have enabled users to write custom probabilistic inference algorithms through "programmable inference" interfaces that automate many complex computations needed to develop effective inference algorithms. However, it is easily possible for users to accidentally write incorrect inference programs in such a way that breaks convergence and leads to unsound results. Even worse, such mistakes often go unnoticed. The research in this project aims to alleviate the fundamental tension between soundness and flexibility of programmable inference by (1) applying new programming-language techniques such as static analysis and type systems to verify whether a user-written inference program satisfies theoretical conditions for soundness; and (2) developing new dynamic statistical program analyses to empirically assess the quality of approximate posterior samples produced from the sound inference program. In this way, the system ensures that approximate inference algorithms are not only soundly implemented but are also effective for a given problem in practice. The practicality of the developed techniques is validated through evaluations on challenging data science problems. Moreover, the research results are integrated in the graduate and undergraduate education at Carnegie Mellon University.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目的目标是使强大的贝叶斯模型和推理算法在具有挑战性的数据科学问题中更加可用，可访问和可靠。贝叶斯推理提供了一种通过将先验建模假设与观测数据相结合来学习概率模型的原则性方法。它能够在不同领域的问题中实现最先进的结果，包括生物统计学，机器人技术，计算物理学，定量金融，认知科学和机器学习。贝叶斯推理的优点包括能够结合先前的特定领域知识，量化参数和预测的不确定性，以及很好地推广到新的数据。然而，一个关键的挑战是正确地实现和诊断贝叶斯推理算法，特别是那些针对复杂概率模型的算法。该项目的新奇在于通过开发严格的编程语言技术来应对这一挑战，这些技术使合理有效的贝叶斯推理更容易应用。该项目的影响是促进研究人员开发和探索更灵活的贝叶斯方法，并帮助领域专家更可靠地利用这些技术来解决现实世界的问题。该项目的研究计划建立在Stan，Gen和Pyro等概率编程语言（PPL）的基础上，这些语言提供了将模型开发与相应推理算法规范清晰分离的接口。为了使贝叶斯学习适用于更灵活的模型和更大的数据集，一些PPL已经使用户能够通过“可编程推理”接口编写自定义概率推理算法，这些接口自动化了开发有效推理算法所需的许多复杂计算。然而，用户很容易意外地编写不正确的推理程序，从而破坏收敛并导致不合理的结果。更糟糕的是，这样的错误往往被忽视。本计画的研究目的在于缓和可程式推论的可靠性与弹性之间的紧张关系，其方法为：（1）应用新的程式语言技术，例如静态分析与型别系统，来验证使用者所撰写的推论程式是否符合可靠性的理论条件;以及（2）开发新的动态统计程序分析，以经验评估从声音推断产生的近似后验样本的质量程序.通过这种方式，该系统确保近似推理算法不仅能够正确实现，而且在实践中对于给定的问题也是有效的。通过对具有挑战性的数据科学问题的评估，验证了所开发技术的实用性。此外，该研究成果还被纳入卡内基梅隆大学的研究生和本科生教育。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。