FAI: Towards Adaptive and Interactive Post Hoc Explanations

解释机器学习(ML)模型受到越来越多的关注，因为它们被应用于从医疗保健到招聘再到刑事司法的社会关键任务。对于决策者和决策主体等相关各方来说，理解模型做出特定预测的原因至关重要。这一提议认为，解释代表着一个沟通过程。为了提高解释的有效性，解释应根据被解释的主题(感兴趣的子组)以及目标受众(用户概况)进行适应性和互动性，因为目标受众的知识和偏好可能正在演变。因此，这项建议旨在开发机器学习模型的适应性和交互式解释，这将使人们更好地理解为他们做出的决策和关于他们的决策。这项提案有三个关键的重点领域。首先，这项提议将开发一个新的正式框架，用于生成可定制的适应性解释，以考虑到感兴趣的子组和用户概况。其次，这一提议将通过动态纳入用户输入，促进将解释作为一种互动的交流过程。最后，该建议将改进现有的自动评估指标，如充分性和全面性，并开发新的评估指标，特别是针对未被充分研究的全球解释。该团队将把这些计算方法嵌入到真实世界的系统中。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Explaining machine learning (ML) models have received increasing interest because of their adoption in societally-critical tasks, ranging from health care, to hiring, to criminal justice. It is crucial for the relevant parties, such as decision makers and decision subjects, to understand why a model makes a particular prediction. This proposal argues that explanations represent a communication process. In order to improve the effectiveness of explanations, explanations should be adaptive and interactive based on the subject being explained (subgroups of interest) as well as the target audience (user profiles), whose knowledge and preferences may be evolving. Therefore, this proposal aims to develop adaptive and interactive explanations of machine learning models, which will allow people to better understand the decisions being made for and about them. This proposal has three key areas of focus. First, this proposal will develop a novel formal framework for generating adaptive explanations which can be customized to account for subgroups of interest and user profiles. Second, this proposal will facilitate the explanations as an interactive communication process by dynamically incorporating user inputs. Finally, this proposal will improve existing automatic evaluation metrics such as sufficiency and comprehensiveness, and develop novel ones, especially for the understudied global explanations. The team will embed these computational approaches in real-world systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.