On Proactive, Transparent, and Verifiable Ethical Reasoning for Robots
On Proactive, Transparent, and Verifiable Ethical Reasoning for Robots
复制标题
DOI：
10.1109/jproc.2019.2898267
复制
发表时间：
2019-03-01
影响因子：
20.6
通讯作者：
Winfield, Alan F.
中科院分区：
文献类型：
--
作者：
Bremner, Paul;Dennis, Louise A.;Winfield, Alan F.
先前有关道德机器推理的工作很大程度上是理论上的，并且在实施此类系统的情况下，一般来说，只是初步的原理证明。在这里，我们解决了此类系统的理想属性问题，以提高其现实世界的效用，以及如何实现具有这些属性的控制器。我们建议，具有道德批判性的机器推理应该是主动的、透明的和可验证的。我们描述了一种架构，其中道德推理由单独的层处理，增强了典型的分层控制架构，以道德方式调节机器人的行为。它利用基于模拟的内部模型，并支持主动、透明和可验证的道德推理。为此，道德层的推理组件使用我们基于 Python 的信念欲望意图 (BDI) 实现。 BDI 的声明性逻辑结构通过记录推理周期和形式化验证方法来促进透明度。为了证明我们方法的原理，我们使用案例研究实现来实验演示其操作。重要的是，它是第一个道德机器推理得到正式验证的机器人控制器。
Previous work on ethical machine reasoning has largely been theoretical, and where such systems have been implemented, it has, in general, been only initial proofs of principle. Here, we address the question of desirable attributes for such systems to improve their real world utility, and how controllers with these attributes might be implemented. We propose that ethically critical machine reasoning should be proactive, transparent, and verifiable. We describe an architecture where the ethical reasoning is handled by a separate layer, augmenting a typical layered control architecture, ethically moderating the robot actions. It makes use of a simulation-based internal model and supports proactive, transparent, and verifiable ethical reasoning. To do so, the reasoning component of the ethical layer uses our Python-based belief desire intention (BDI) implementation. The declarative logic structure of BDI facilitates both transparency, through logging of the reasoning cycle, and formal verification methods. To prove the principles of our approach, we use a case study implementation to experimentally demonstrate its operation. Importantly, it is the first such robot controller where the ethical machine reasoning has been formally verified.