Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.

Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.
复制标题

DOI:
10.1038/s42256-019-0048-x
复制
发表时间:
2019-05
影响因子:
23.8
通讯作者:
Rudin, Cynthia
Rudin, Cynthia
中科院分区:
计算机科学1区
文献类型:
--
作者:
Rudin, Cynthia

文献摘要

参考文献

被引文献

相似文献

黑箱机器学习模型目前被用于整个社会的高风险决策,在医疗保健、刑事司法和其他领域引发了问题。人们希望创建解释这些黑盒模型的方法能够缓解其中的一些问题,但是试图解释黑盒模型,而不是首先创建可解释的模型,可能会使不良实践永世存在,并可能对社会造成灾难性的危害。有一条前进的道路,那就是设计具有内在可解释性的模型。本文阐明了解释黑箱和使用固有可解释模型之间的鸿沟,概述了在高风险决策中应避免使用可解释黑箱的几个关键原因,确定了可解释机器学习面临的挑战,并提供了可解释模型可能取代刑事司法、医疗保健和计算机视觉中的黑箱模型的几个示例应用。
Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to explain black box models, rather than creating models that are interpretable in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward – it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.
DOI: 10.1177/0963721409359277
发表时间: 2010-02-01
影响因子: 7.2
作者:
Cowan N
通讯作者: Cowan N
DOI: 10.1023/a:1022631118932
发表时间: 1993-04-01
期刊: MACHINE LEARNING
影响因子: 7.5
作者:
HOLTE, RC
通讯作者: HOLTE, RC
DOI: 10.1609/aimag.v38i3.2741
发表时间: 2017-09-01
期刊: AI MAGAZINE
影响因子: 0.9
作者:
Goodman, Bryce;Flaxman, Seth
通讯作者: Flaxman, Seth
DOI: 10.1007/s10994-012-5295-6
发表时间: 2012-09-01
期刊: MACHINE LEARNING
影响因子: 7.5
作者:
Chang, Allison;Rudin, Cynthia;Chou, Gloria
通讯作者: Chou, Gloria
DOI: 10.1214/088342306000000060
发表时间: 2006-02-01
影响因子: 5.7
作者:
Hand, David J.
通讯作者: Hand, David J.