SHF: Medium: Reasoning about Multiplicity in the Machine Learning Pipeline

机器学习被部署在各个领域（例如，金融、教育、招聘），并假设模型结果是准确和权威的。但实际上，部署的特定模型只是许多选项中的一个：以前的工作表明，多重性-存在多个同样好的模型-出现在机器学习管道的许多阶段。形式上对多重性的推理是具有挑战性的，因为人们必须考虑大量（可能是无限的）模型。因此，现有的技术目前只能对某些形式的基于模型的多重性进行推理，并且通常只有经验保证。该项目的创新之处是一组提高机器学习管道可扩展性的方法。这些技术包括框架和形式化技术，以了解数据集创建和建模过程中的多样性如何影响部署的最终学习模型。 该项目的影响在机器学习模型的决策直接影响人类的领域尤为突出-理解多样性对于开发公平和强大的机器学习模型至关重要。研究人员参与组织外展计划，让来自代表性不足背景的高中生和本科生接触计算机科学和机器学习主题。该项目研究了整个机器学习管道中不同模型架构的多样性，包括训练数据，模型预测和模型解释。该研究整合了正式的方法和强大的机器学习技术，以提供技术来帮助回答机器学习结果是否可靠的问题，或者它们是否只是多重性的产物。例如，研究人员研究算法，以证明（确定性地或概率地，取决于模型架构）模型的预测是否在各种多样性来源下是稳健的。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Machine learning is deployed across various domains (e.g., finance, education, hiring) with the assumption that model outcomes are accurate and authoritative. But in reality, the specific model that is deployed is just one option of many: previous work has shown that multiplicity – the existence of multiple equally good models – arises at many stages of the machine learning pipeline. Formally reasoning about multiplicity is challenging due to the large (potentially infinite) set of models one has to take into account. As such, existing techniques are currently only able to reason about certain forms of model-based multiplicity, and generally only with empirical guarantees. This project’s novelties are a set of approaches that increase the auditability of machine learning pipelines. These techniques consist of frameworks and formal techniques to understand how multiplicity in the dataset creation and modeling processes impacts the final learned model that is deployed. The project’s impacts are especially prominent in domains where the decisions of machine learned models directly affect humans --- understanding multiplicity is vital for developing machine learning models that are fair and robust. The investigators are involved with organizing outreach programs to expose high schoolers and undergraduates from underrepresented backgrounds to computer science and topics in machine learning.This project investigates multiplicity for diverse model architectures across the whole machine learning pipeline including training data, model predictions, and model explanations. The research integrates formal methods and robust machine learning techniques to provide techniques to help answer the question of whether machine learning outcomes are reliable, or whether they are just an artifact of multiplicity. For instance, the investigators study algorithms to certify (deterministically or probabilistically, depending on the model architecture) whether a model’s prediction is robust under various sources of multiplicity.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.