Mind the gaps: Assuring the safety of autonomous systems from an engineering, ethical, and legal perspective

Mind the gaps: Assuring the safety of autonomous systems from an engineering, ethical, and legal perspective
复制标题

DOI:
10.1016/j.artint.2019.103201
复制
发表时间:
2020-02-01
影响因子:
14.4
通讯作者:
Porter, Zoe
Porter, Zoe
中科院分区:
计算机科学2区
文献类型:
--
作者:
Burton, Simon;Habli, Ibrahim;Porter, Zoe

文献摘要

被引文献

相似文献

本文汇集了多学科的角度从系统工程,伦理,和法律阐明了一个共同的语言,其中的原因关于多方面的问题,确保自主系统的安全。本文的重点是在开发过程中出现的“差距”:语义差距,即不存在完整的预期功能规范的正常条件;责任差距,即不存在让人类行为者对伤害承担道德责任的正常条件;以及责任缺口,即不存在向受害人提供赔偿的正常条件。通过对这些“差距”进行分类,我们可以更精确地揭示自主系统的不确定性和风险的关键来源。这可以为更详细的安全保证模型的发展提供信息,并有助于更有效的风险控制。(C) 2019 Elsevier B.V.版权所有
This paper brings together a multi-disciplinary perspective from systems engineering, ethics, and law to articulate a common language in which to reason about the multifaceted problem of assuring the safety of autonomous systems. The paper's focus is on the "gaps" that arise across the development process: the semantic gap, where normal conditions for a complete specification of intended functionality are not present; the responsibility gap, where normal conditions for holding human actors morally responsible for harm are not present; and the liability gap, where normal conditions for securing compensation to victims of harm are not present. By categorising these "gaps" we can expose with greater precision key sources of uncertainty and risk with autonomous systems. This can inform the development of more detailed models of safety assurance and contribute to more effective risk control. (C) 2019 Elsevier B.V. All rights reserved.