FAI: Towards Adaptive and Interactive Post Hoc Explanations

解释机器学习（ML）模型受到越来越多的关注，因为它们被用于社会关键任务，从医疗保健到招聘，再到刑事司法。对于决策者和决策主体等相关方来说，理解模型为什么会做出特定的预测是至关重要的。这个提议认为解释代表了一个交流过程。为了提高解释的有效性，解释应该根据被解释的主题（兴趣子组）和目标受众（用户档案）具有适应性和互动性，目标受众的知识和偏好可能在不断发展。因此，本提案旨在开发机器学习模型的自适应和交互式解释，这将使人们更好地理解为他们做出的决定和关于他们的决定。这项建议有三个重点领域。首先，该提案将开发一个新的正式框架，用于生成自适应解释，该解释可以自定义以解释兴趣子组和用户概况。其次，通过动态地整合用户输入，该建议将促进解释作为一个交互式交流过程。最后，本文将改进现有的自动评估指标，如充分性和全面性，并开发新的自动评估指标，特别是对于尚未得到充分研究的全球解释。该团队将把这些计算方法嵌入到现实世界的系统中。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Explaining machine learning (ML) models have received increasing interest because of their adoption in societally-critical tasks, ranging from health care, to hiring, to criminal justice. It is crucial for the relevant parties, such as decision makers and decision subjects, to understand why a model makes a particular prediction. This proposal argues that explanations represent a communication process. In order to improve the effectiveness of explanations, explanations should be adaptive and interactive based on the subject being explained (subgroups of interest) as well as the target audience (user profiles), whose knowledge and preferences may be evolving. Therefore, this proposal aims to develop adaptive and interactive explanations of machine learning models, which will allow people to better understand the decisions being made for and about them. This proposal has three key areas of focus. First, this proposal will develop a novel formal framework for generating adaptive explanations which can be customized to account for subgroups of interest and user profiles. Second, this proposal will facilitate the explanations as an interactive communication process by dynamically incorporating user inputs. Finally, this proposal will improve existing automatic evaluation metrics such as sufficiency and comprehensiveness, and develop novel ones, especially for the understudied global explanations. The team will embed these computational approaches in real-world systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.