EAGER:AI-DCL:Capture, Explain and Negotiate the Inherent Trade-offs in Machine Learning Algorithms

基于机器学习的决策算法的一个突出问题是不同系统标准之间的内在权衡。越来越多的文献展示了公平与准确性之间的权衡，以及不同公平概念之间的权衡。通过提高公平性，整体准确性可能会下降。此外，不同的公平概念彼此不兼容：完善的结果表明，共同的统计公平概念往往是相互排斥的。准确理解这种权衡对于利益相关者和从业者正确使用这些机器学习方法至关重要。这个项目的重点是采用跨学科的方法来研究、解释和解决基于机器学习的决策中不同系统标准之间的内在权衡。研究人员将开发方法来捕获机器学习算法中不同系统标准之间的权衡。他们将开发可视化和交互界面，向涉众解释模型之间的权衡。最后，项目团队将探索社会和技术创新，让涉众在不同的系统标准之间导航和协商基本的权衡。该项目将部分通过MOOC课程传播新知识。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

An outstanding issue with machine learning based decision-making algorithms is the inherent trade-offs between different system criteria. There is an emerging body of literature demonstrating trade-offs between fairness and accuracy, and between different fairness notions. By improving fairness, overall accuracy might decrease. Furthermore, different fairness notions are not compatible with each other: well-established results show that common statistical fairness notions are often mutually exclusive. Accurate understanding of such trade-offs is critical for stakeholders and practitioners to appropriately use these machine learning methods. The focus of this project is to take an interdisciplinary approach to study, explain, and address the inherent trade-offs between different system criteria in machine learning-based decision-making.The researchers will develop methods to capture trade-offs between different system criteria in machine learning algorithms. They will develop visualizations and interactive interfaces to explain the trade-offs between the models to the stakeholders. Finally, the project team will explore social and technical innovations that let stakeholders navigate and negotiate the fundamental trade-offs between different system criteria. The project will disseminate the new knowledge in part through a MOOC offering.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.