FAI: Toward Fair Decision Making and Resource Allocation with Application to AI-Assisted Graduate Admission and Degree Completion

FAI：通过应用于人工智能辅助研究生入学和学位完成来实现公平决策和资源分配

• 批准号: 2147276
• 负责人: Furong Huang
• 金额: $ 62.5万
• 依托单位: University of Maryland, College Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-02-15 至 2025-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2147276&HistoricalAwards=false
• 关键词: FAI; Toward; Fair; Decision; Making

Machine learning systems have become prominent in many applications in everyday life, such as healthcare, finance, hiring, and education. These systems are intended to improve upon human decision-making by finding patterns in massive amounts of data, beyond what can be intuited by humans. However, it has been demonstrated that these systems learn and propagate similar biases present in human decision-making. This project aims to develop general theory and techniques on fairness in AI, with applications to improving retention and graduation rates of under-represented groups in STEM graduate programs. Recent research has shown that simply focusing on admission rates is not sufficient to improve graduation rates. This project is envisioned to go beyond designing "fair classifiers" such as fair graduate admission that satisfy a static fairness notion in a single moment in time, and designs AI systems that make decisions over a period of time with the goal of ensuring overall long-term fair outcomes at the completion of a process. The use of data-driven AI solutions can allow the detection of patterns missed by humans, to empower targeted intervention and fair resource allocation over the course of an extended period of time. The research from this project will contribute to reducing bias in the admissions process and improving completion rates in graduate programs as well as fair decision-making in general applications of machine learning.This project will focus on machine learning algorithms for resource allocation, which can be used at various points throughout a process such as in education. The team will propose new notions of fairness and show the applicability of those notions to settings in which limited resources, such as acceptance to the program, faculty mentoring, professional development, and paid assistantships or fellowships, are allocated to students fairly. The proposed research will also go beyond fairness in task-specific supervised learning settings and investigate fairness in unsupervised learning that guarantees to learn fair representations or generative models for multiple downstream tasks. The team will address the practical problems that arise due to uncongenial data in real-world sequential decision-making systems, including distribution shifts between training and test, imbalanced data, and missing sensitive attributes. This proposal contains a comprehensive plan to incorporate its research into education at high school, undergraduate, and graduate levels, as well as plans for within- and cross-disciplinary dissemination of research results, outreach, and other synergistic activities.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

机器学习系统在日常生活中的许多应用中已经变得突出，例如医疗保健，金融，招聘和教育。这些系统旨在通过在大量数据中发现模式来改善人类的决策，而这些模式超出了人类的直觉。然而，已经证明，这些系统学习和传播人类决策中存在的类似偏见。该项目旨在开发关于人工智能公平性的一般理论和技术，并应用于提高STEM研究生课程中代表性不足群体的保留率和毕业率。最近的研究表明，仅仅关注录取率不足以提高毕业率。该项目的设想是超越设计“公平分类器”，例如在单一时刻满足静态公平概念的公平研究生入学，并设计在一段时间内做出决策的人工智能系统，目标是确保在完成过程时的整体长期公平结果。使用数据驱动的人工智能解决方案可以检测人类错过的模式，从而在很长一段时间内进行有针对性的干预和公平的资源分配。 该项目的研究将有助于减少招生过程中的偏见，提高研究生课程的完成率，以及机器学习一般应用中的公平决策。该项目将专注于用于资源分配的机器学习算法，该算法可用于整个过程的各个点，例如教育。该团队将提出新的公平概念，并显示这些概念的适用性，在有限的资源，如接受程序，教师指导，专业发展，并支付助学金或奖学金，公平地分配给学生的设置。拟议的研究还将超越特定任务监督学习环境中的公平性，并研究无监督学习中的公平性，以保证为多个下游任务学习公平的表示或生成模型。该团队将解决由于现实世界中的顺序决策系统中的不一致数据而产生的实际问题，包括训练和测试之间的分布变化，不平衡的数据和缺失的敏感属性。该提案包含了一个将其研究纳入高中、本科和研究生教育的全面计划，以及研究成果的学科内和跨学科传播、外展和其他协同活动的计划。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Rethinking Adversarial Policies: A Generalized Attack Formulation and Provable Defense in RL

• 发表时间: 2023-05
• 作者: Xiangyu Liu;Souradip Chakraborty;Yanchao Sun;Furong Huang

Secure Sampling with Sublinear Communication

使用次线性通信进行安全采样

• 发表时间: 2022
• 期刊: Springer
• 作者: Choi, Seung Geol;Dachman-Soled, Dana;Gordon, S. Dov;Liu, Linsheng;Yerukhimovich, Arkady
• 通讯作者: Yerukhimovich, Arkady

Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbations

• DOI: 10.48550/arxiv.2307.12062
• 发表时间: 2023
• 期刊: ArXiv
• 作者: Yongyuan Liang;Yanchao Sun;Ruijie Zheng;Xiangyu Liu;T. Sandholm;Furong Huang;S. McAleer

Exploring and Exploiting Decision Boundary Dynamics for Adversarial Robustness

• DOI: 10.48550/arxiv.2302.03015
• 发表时间: 2023-02
• 期刊: ArXiv
• 作者: Yuancheng Xu;Yanchao Sun;Micah Goldblum;T. Goldstein;Furong Huang

Large-Scale Distributed Learning via Private On-Device LSH

通过私有设备上 LSH 进行大规模分布式学习

• 发表时间: 2023
• 期刊: The Thirty-seventh Annual Conference on Neural Information Processing Systems
• 作者: Rabbani, T.;Bornstein, M.;Huang, F.
• 通讯作者: Huang, F.