CAREER: Robust Policy Learning for Safe and Reliable Algorithmic Decision Making from Observational Data in Sensitive Applications
CAREER: Robust Policy Learning for Safe and Reliable Algorithmic Decision Making from Observational Data in Sensitive Applications
批准号:
1846210
负责人:
Nathan Kallus
金额:
$50.0万
依托单位:
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2019
资助国家:
美国
项目状态:
未结题
起止时间:
2019-06-01 至 2025-05-31
中文摘要
机器学习的一些最有影响力的应用不仅仅是预测,而是在正确的时间针对正确的目标采取正确的行动。与预测不同,行动是有后果的,因此,在寻求采取正确行动时,人们必须寻求理解其因果效应。本项目主要研究从敏感应用中的观测数据中提取最大化因果效应的个性化决策规则的问题。在医学和公民学等领域已经变得丰富的观测数据缺乏实验操作,因此孤立的因果效应被复杂的选择过程所掩盖,这种现象称为混淆,并且这些数据也是混乱的,嘈杂的,有偏见的,并且经常丢失。尽管有丰富的观测数据的承诺,目前的方法无法处理它所带来的独特挑战,并可能导致不可靠,不安全和不公平的决策不适合敏感的应用程序。该项目的目标是创建一个由严格的理论和强大的方法组成的综合框架,以解决这一差距,并使经过观测数据培训的可信决策系统成为可能。研究和教育计划是通过学生咨询和课程开发结合起来的,包括有针对性的外展工作,以扩大代表性不足的群体的参与。第一个是在存在未观察到的混杂因素的情况下,为算法决策制定开发方法和理论。鉴于现有的方法依赖于各种无法验证的假设,以确保因果效应的点识别,该项目将开发强大的学习方法,产生具有安全证书和/或改进的政策,由理论保证支持,不依赖于确切的识别。第二个目标是为政策学习制定稳健和最佳加权的方法和理论,以解决稳定性、有限重叠、事件发生时间数据以及噪声和缺失观测等问题。第三是研究从观测数据训练的决策策略的算法公平性。该项目将开发公平性的特征,其中差异指标无法从数据中识别,无论是由于有偏见的选择还是缺失的属性和标签,以及可以审计和执行此类设置中的公平性的方法。通过这些努力,该项目将推进机器学习、因果推理和优化交叉领域的知识,并拓宽其与新问题领域的整合范围。该奖项反映了NSF的法定使命,并通过使用基金会的智力价值和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
Some of the most impactful applications of machine learning are not just about prediction but are rather about taking the right action directed at the right target at the right time. Actions, unlike predictions, have consequences and so, in seeking to take the right action, one must seek to understand its causal effect. This project deals with the problem of extracting causal-effect-maximizing personalized decision rules from observational data in sensitive applications. Observational data, which have become plentiful in domains such as medicine and civics, lack experimental manipulation so that isolated causal effects are obscured by complex selection processes, a phenomenon known as confounding, and such data are also otherwise messy, noisy, biased, and often missing. Despite the promise of rich and plentiful observational data, current approaches cannot handle the unique challenges it poses and can lead to unreliable, unsafe, and unfair decision making unfit for sensitive applications. The goal of this project is to create a comprehensive framework of rigorous theory and robust methodology to address this gap and enable trustworthy decision-making systems trained on observational data. The research and education plans are integrated through student advising and curriculum development and include targeted outreach efforts to broaden participation of underrepresented groups.The research will proceed along three primary directions. The first is to develop methods and theory for algorithmic decision making in the presence of unobserved confounders. Whereas existing approaches tenuously rely on various unverifiable assumptions that ensure point-identification of causal effects, the project will develop robust learning methods that produce policies with certificates of safety and/or improvement backed by theoretical guarantees that do not rely on exact identification. The second is to develop methods and theory for robust and optimal weighting for policy learning to address issues of stability, limited overlap, time-to-event data, and noisy and missing observations. The third is to investigate algorithmic fairness of decision policies trained from observational data. The project will develop characterizations of fairness in settings where disparity metrics cannot be point-identified from data, whether due to biased selection or missing attributes and labels, as well as methods that can audit and enforce fairness in such settings. Through these thrusts, the project will both advance knowledge at the intersection of machine learning, causal inference, and optimization as well as broaden the scope of their integration with new problem domains.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(34)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
Data Pooling in Stochastic Optimization
随机优化中的数据池
DOI:
10.1287/mnsc.2020.3933
发表时间:
2021
期刊:
Management Science
影响因子:
5.4
作者:
[Gupta, Vishal, Kallus, Nathan]
通讯作者:
Kallus, Nathan
The Fairness of Risk Scores Beyond Classification: Bipartite Ranking and the XAUC Metric
超越分类的风险评分的公平性:二分排名和 XAUC 指标
DOI:
--
发表时间:
2019
期刊:
Advances in neural information processing systems
影响因子:
--
作者:
[Kallus, Nathan, Zhou, Angela]
通讯作者:
Zhou, Angela
DOI:
--
发表时间:
2020
期刊:
Advances in neural information processing systems
影响因子:
--
作者:
[Kallus, Nathan, Zhou, Angela]
通讯作者:
Zhou, Angela
DOI:
--
发表时间:
2018-02
期刊:
影响因子:
--
作者:
[Nathan Kallus]
通讯作者:
Nathan Kallus
Control Variates for Slate Off-Policy Evaluation
Slate 离策略评估的控制变量
DOI:
--
发表时间:
2021
期刊:
Advances in neural information processing systems
影响因子:
--
作者:
[Vlassis, Nikos, Chandrashekar, Ashok, Amat, Fernando, Kallus, Nathan]
通讯作者:
Kallus, Nathan
共 32 条
FAI: Auditing and Ensuring Fairness in Hard-to-Identify Settings
-
批准号:1939704
-
项目类别:Standard Grant
-
资助金额:$38.18万
-
财政年份:2020
-
负责人:Nathan Kallus
-
依托单位:
CRII: RI: New Methods for Learning to Personalize from Observational Data with Applications to Precision Medicine and Policymaking
-
批准号:1656996
-
项目类别:Standard Grant
-
资助金额:$17.5万
-
财政年份:2017
-
负责人:Nathan Kallus
-
依托单位:
国内基金
海外基金
登录
查看更多内容
供应链管理中的稳健型(Robust)策略分析和稳健型优化(Robust Optimization )方法研究
-
批准号:70601028
-
项目类别:青年科学基金项目
-
资助金额:7.0万元
-
批准年份:2006
-
负责人:王明征
-
依托单位:
心理紧张和应力影响下Robust语音识别方法研究
-
批准号:60085001
-
项目类别:专项基金项目
-
资助金额:14.0万元
-
批准年份:2000
-
负责人:韩纪庆
-
依托单位:
ROBUST语音识别方法的研究
-
批准号:69075008
-
项目类别:面上项目
-
资助金额:3.5万元
-
批准年份:1990
-
负责人:高雨青
-
依托单位:
改进型ROBUST序贯检测技术
-
批准号:68671030
-
项目类别:面上项目
-
资助金额:2.0万元
-
批准年份:1986
-
负责人:刘有恒
-
依托单位: