SHF: Medium: Reasoning about Multiplicity in the Machine Learning Pipeline

机器学习被部署在不同的领域(例如，金融、教育、招聘)，并假设模型结果是准确和权威的。但在现实中，部署的具体模型只是众多选择中的一个：之前的研究表明，多样性--多个同样好的模型的存在--出现在机器学习管道的许多阶段。形式上对多重性的推理是具有挑战性的，因为人们必须考虑大量(可能是无限的)模型集。因此，现有技术目前只能对某些形式的基于模型的多样性进行推理，而且通常只能通过经验保证。这个项目的新颖性是一套增加机器学习管道审计能力的方法。这些技术由框架和正式技术组成，用于了解数据集创建和建模过程中的多样性如何影响部署的最终学习模型。该项目的影响在机器学习模型的决策直接影响人类的领域尤为突出-理解多样性对于开发公平和健壮的机器学习模型至关重要。研究人员参与组织外展计划，让来自代表性不足背景的高中生和本科生接触计算机科学和机器学习主题。这个项目调查了整个机器学习管道中不同模型体系结构的多样性，包括训练数据、模型预测和模型解释。这项研究整合了形式方法和稳健的机器学习技术，以提供技术来帮助回答机器学习结果是否可靠，或者它们是否只是一个多样性的产物的问题。例如，研究人员研究算法，以证明(确定性或概率，取决于模型架构)模型的预测在各种多样性来源下是否稳健。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Machine learning is deployed across various domains (e.g., finance, education, hiring) with the assumption that model outcomes are accurate and authoritative. But in reality, the specific model that is deployed is just one option of many: previous work has shown that multiplicity – the existence of multiple equally good models – arises at many stages of the machine learning pipeline. Formally reasoning about multiplicity is challenging due to the large (potentially infinite) set of models one has to take into account. As such, existing techniques are currently only able to reason about certain forms of model-based multiplicity, and generally only with empirical guarantees. This project’s novelties are a set of approaches that increase the auditability of machine learning pipelines. These techniques consist of frameworks and formal techniques to understand how multiplicity in the dataset creation and modeling processes impacts the final learned model that is deployed. The project’s impacts are especially prominent in domains where the decisions of machine learned models directly affect humans --- understanding multiplicity is vital for developing machine learning models that are fair and robust. The investigators are involved with organizing outreach programs to expose high schoolers and undergraduates from underrepresented backgrounds to computer science and topics in machine learning.This project investigates multiplicity for diverse model architectures across the whole machine learning pipeline including training data, model predictions, and model explanations. The research integrates formal methods and robust machine learning techniques to provide techniques to help answer the question of whether machine learning outcomes are reliable, or whether they are just an artifact of multiplicity. For instance, the investigators study algorithms to certify (deterministically or probabilistically, depending on the model architecture) whether a model’s prediction is robust under various sources of multiplicity.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.