Human involvement in autonomous decision-making systems. Lessons learned from three case studies in aviation, social care and road vehicles
Human involvement in autonomous decision-making systems. Lessons learned from three case studies in aviation, social care and road vehicles
复制标题
DOI：
10.3389/fpos.2023.1238461
复制
发表时间：
2023-12
影响因子：
--
通讯作者：
P. Salvini;Tyler Reinmund;Benjamin Hardin;Keri Grieman;C. Ten Holter;Aaron Johnson;Lars Kunze;Alan Winfield;M. Jirotka
中科院分区：
文献类型：
--
作者：
P. Salvini;Tyler Reinmund;Benjamin Hardin;Keri Grieman;C. Ten Holter;Aaron Johnson;Lars Kunze;Alan Winfield;M. Jirotka
本文借鉴了三个案例研究，探讨了使用自主决策系统（ADMS）所涉及的一些挑战和紧张局势。特别是，该文件强调：（i）围绕决策“场所”变化的挑战，以及对利益相关者的相关后果;（ii）监管对利益相关者的潜在影响，如《通用数据保护条例》（GDPR）;（iii）利益相关者群体对“决策”问题带来的不同价值观; ㈣使用自动化系统和缺乏对可能后果的评估，可能会破坏或削弱原先存在的利益攸关方和决策当局的复杂网络;（v）为非技术使用者而设的管理管理系统，如何会导致规避系统的预定用途的界缐。我们通过三个领域的案例研究来说明这些挑战：成人社会护理，航空和车辆驾驶员监控系统。本文最后提出了在部署行政管理系统方面的实践和政策建议。
This paper draws on three case studies to examine some of the challenges and tensions involved in the use of Autonomous Decision-Making Systems (ADMS). In particular, the paper highlights: (i) challenges around the shifting “locale” of the decision, and the associated consequences for stakeholders; (ii) potential implications for stakeholders from regulation such as the General Data Protection Regulation (GDPR); (iii) the different values that stakeholder groups bring to the “decision” question; (iv) how complex pre-existing webs of stakeholders and decision-making authorities may be disrupted or disempowered by the use of an automated system and the lack of evaluation of possible consequences; (v) how ADMS for non-technical users can lead to circumvention of the boundaries of intended system use. We illustrate these challenges through case studies in three domains: adult social care, aviation, and vehicle driver monitoring systems. The paper closes with recommendations for both practice and policy in the deployment of ADMS.