CAREER: Generative Models for Targeted Domain Interpretability with Applications to Healthcare

职业：目标领域可解释性的生成模型及其在医疗保健领域的应用

• 批准号: 1750358
• 负责人: Finale Doshi-Velez
• 金额: $ 54.8万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-02-15 至 2025-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1750358&HistoricalAwards=false
• 关键词: CAREER; Generative; Models; Targeted; Domain

The imminent deployment of AI and machine learning in poorly-characterized settings such as autonomous driving, personalized news feeds, and treatment recommendation systems has created an urgent need for machine learning systems that explain their decisions. Interpretability helps human experts ascertain whether machine learning systems, trained on technical objective functions, have sensible outputs despite unmodeled unknowns. For example, a clinical decision support system will never know all of a patient's history, nor may it know which of many side effects a specific patient is willing to tolerate. An important challenge, then, is how to design machine learning systems that both predict well and provide explanation. Within this broad challenge, this work develops techniques for domain-targeted interpretability, finding summaries of high-dimensional data that are relevant for making decisions. The proposed work focuses on healthcare applications, where interpretable models are essential to safety. However, the project aims to produce foundational learning algorithms applicable to a range of scientific and social domains. The developed methods will be tested on real problems in personalizing treatment recommendations and prognoses for sepsis, depression, and autism spectrum disorder. Thus, the successful completion of the work will impact both interpretable machine learning and clinical science. All software developed in the course of the project will be freely shared. The educational component of the proposed work will educate early elementary students about the impact of statistics in medicine and educate policy-makers and legal scholars on how a right to explanation might be regulated in the context of machine learning, such as clinical decision support systems. PI Doshi-Velez also engages high school students, undergraduates, women, and researchers from underserved areas in her lab.The proposed work addresses a specific challenge common in scientific settings: domain-targeted interpretability. In many scientific domains, unsupervised generative models are used by domain experts to understand patterns in the data, but as the dimensionality of data grow, the most salient patterns in the data may not be relevant for the specific investigation. For example, a psychiatrist may find the strongest signals in the data from his patient cohort come from diabetes and heart disease, which may not be relevant for choosing therapies for depression. The proposed work leverages synergies in explaining domain-relevant patterns in the data and performing well on domain-relevant tasks to achieve domain-targeted interpretability. It defines a task-constrained approach to domain-targeted interpretability and develops essential inference techniques, develops extensions to sequential decision making, and defines extensions to improve downstream task performance while retaining interpretabilty. While there is a large body of work on making unsupervised learning models also useful for downstream tasks, none of these approaches truly manage the trade-offs between providing an interpretation of data and task performance. The proposed work addresses these shortcomings to make domain-targeted interpretability and task performance synergistic goals, and proposes a number of innovations to solve the proposed objective. Innovations include combining an existing rich literature on inference traditional unsupervised models with modern inference techniques and directly searching for dimensions or patterns relevant to the downstream task.

人工智能和机器学习即将在自动驾驶、个性化新闻推送和治疗推荐系统等特征不佳的环境中部署，这就迫切需要机器学习系统来解释他们的决策。可解释性帮助人类专家确定在技术目标函数上训练的机器学习系统是否具有合理的输出，尽管存在未建模的未知数。例如，临床决策支持系统永远不会知道患者的所有病史，也不可能知道特定患者愿意忍受许多副作用中的哪一个。因此，一个重要的挑战是如何设计既能很好地预测又能提供解释的机器学习系统。 在这个广泛的挑战中，这项工作开发了针对领域的可解释性技术，找到了与决策相关的高维数据的摘要。 拟议的工作重点是医疗保健应用，其中可解释的模型对安全至关重要。 然而，该项目旨在产生适用于一系列科学和社会领域的基础学习算法。 开发的方法将在个性化治疗建议和败血症，抑郁症和自闭症谱系障碍的诊断中的真实的问题上进行测试。因此，这项工作的成功完成将影响可解释的机器学习和临床科学。 在项目过程中开发的所有软件都将免费共享。 拟议工作的教育部分将教育早期小学生统计在医学中的影响，并教育政策制定者和法律的学者如何在机器学习的背景下规范解释权，如临床决策支持系统。PI Doshi-Velez还吸引了高中生，本科生，女性和来自她实验室服务不足地区的研究人员。拟议的工作解决了科学环境中常见的一个特定挑战：针对领域的可解释性。在许多科学领域，领域专家使用无监督生成模型来理解数据中的模式，但随着数据维度的增长，数据中最突出的模式可能与特定调查无关。例如，精神科医生可能会发现他的患者队列数据中最强的信号来自糖尿病和心脏病，这可能与选择抑郁症治疗方法无关。 拟议的工作利用协同效应来解释数据中与领域相关的模式，并在与领域相关的任务上表现良好，以实现针对领域的可解释性。它定义了一个任务约束的方法，以领域为目标的可解释性和开发必要的推理技术，开发扩展顺序决策，并定义扩展，以提高下游任务的性能，同时保留可解释性。 虽然有大量的工作使无监督学习模型对下游任务也有用，但这些方法都没有真正管理提供数据解释和任务性能之间的权衡。所提出的工作解决了这些缺点，使领域为目标的可解释性和任务性能的协同目标，并提出了一些创新，以解决所提出的目标。创新包括将现有的关于推理的丰富文献传统无监督模型与现代推理技术相结合，并直接搜索与下游任务相关的维度或模式。

项目成果

Signature Activation: A Sparse Signal View for Holistic Saliency

• DOI: 10.48550/arxiv.2309.11443
• 发表时间: 2023-09
• 期刊: ArXiv
• 作者: José Roberto Tello-Ayala;A. Fahed;Weiwei Pan;E. Pomerantsev;P. Ellinor;A. Philippakis;F. Doshi-Velez

Soft prompting might be a bug, not a feature

软提示可能是一个错误，而不是一个功能

• 发表时间: 2023
• 期刊: International Conference on Machine Learning
• 作者: Bailey, Luke;Ahdritz, Gustaf;Kleiman, Anat;Swaroop, Siddharth;Doshi-Velez, Finale;Pan, Weiwei
• 通讯作者: Pan, Weiwei

A Joint Learning Approach for Semi-supervised Neural Topic Modeling

半监督神经主题建模的联合学习方法

• DOI: 10.18653/v1/2022.spnlp-1.5
• 发表时间: 2022
• 期刊: Proceedings of the Sixth Workshop on Structured Prediction for NLP
• 作者: Chiu, Jeffrey;Mittal, Rajat;Tumma, Neehal;Sharma, Abhishek;Doshi-Velez, Finale
• 通讯作者: Doshi-Velez, Finale

Online model selection by learning how compositional kernels evolve

通过学习组合核如何演化进行在线模型选择

• 发表时间: 2023
• 期刊: Transactions on machine learning research
• 作者: Shin, Eura;Klasnja, Predrag;Murphy, Susan;Doshi-Velez, Finale
• 通讯作者: Doshi-Velez, Finale

Implications of Gaussian process kernel mismatch for out-of-distribution data

高斯过程核不匹配对分布外数据的影响

• 发表时间: 2023
• 期刊: International Conference on Machine Learning
• 作者: Coker, Beau;Doshi-Velez, Finale
• 通讯作者: Doshi-Velez, Finale