Addressing Regulatory Requirements on Explanations for Automated Decisions with Provenance-A Case Study

Addressing Regulatory Requirements on Explanations for Automated Decisions with Provenance-A Case Study
复制标题

满足对具有来源的自动决策解释的监管要求 - 案例研究

DOI:
10.1145/3436897
复制
发表时间:
2021
期刊:
Research and Practice
影响因子:
--
通讯作者:
Huynh T
Huynh T
中科院分区:
--
文献类型:
--
作者:
Huynh T

文献摘要

相似文献

基于人工智能的自动化决策越来越多地被用作向公众部署的新服务的一部分。这种构建服务的方法具有显著的潜在优势,例如降低执行速度、提高准确性、降低成本以及适应各种情况的能力。然而,人们也提出了同样重要的担忧,这些担忧现在已经被充分记录下来,比如对隐私、公平、偏见和道德的担忧。在消费者方面,通常情况下,这些服务的用户对可能影响他们生活的决定没有或不充分的解释。在本文中,我们报告了开发一种社会技术方法的经验,该方法以自动化的方式根据审计跟踪或来源为此类决策构建解释。这项工作是与英国信息专员办公室合作进行的。特别是,我们已经实现了一个自动化的贷款决策场景,将其决策管道仪器化以记录来源,根据其受众和监管目的对相关解释进行分类,构建了一个解释生成原型,并将整个系统部署在一个在线演示中。
AI-based automated decisions are increasingly used as part of new services being deployed to the general public. This approach to building services presents significant potential benefits, such as the reduced speed of execution, increased accuracy, lower cost, and ability to adapt to a wide variety of situations. However, equally significant concerns have been raised and are now well documented such as concerns about privacy, fairness, bias, and ethics. On the consumer side, more often than not, the users of those services are provided with no or inadequate explanations for decisions that may impact their lives. In this article, we report the experience of developing a socio-technical approach to constructing explanations for such decisions from their audit trails, or provenance, in an automated manner. The work has been carried out in collaboration with the UK Information Commissioner’s Office. In particular, we have implemented an automated Loan Decision scenario, instrumented its decision pipeline to record provenance, categorized relevant explanations according to their audience and their regulatory purposes, built an explanation-generation prototype, and deployed the whole system in an online demonstrator.