Drivers’ Understanding of Artificial Intelligence in Automated Driving Systems: A Study of a Malicious Stop Sign
Drivers’ Understanding of Artificial Intelligence in Automated Driving Systems: A Study of a Malicious Stop Sign
复制标题
DOI：
10.1177/15553434221117001
复制
发表时间：
2022-09
影响因子：
2
通讯作者：
Katherine R. Garcia;S. Mishler;Y. Xiao;Congjiao Wang;B. Hu;J. Still;Jing Chen
中科院分区：
文献类型：
--
作者：
Katherine R. Garcia;S. Mishler;Y. Xiao;Congjiao Wang;B. Hu;J. Still;Jing Chen
与当今人们使用的许多其他系统一样，自动驾驶系统（ADS）依赖于成功的人工智能（AI）来实现安全的道路操作。在自动驾驶系统中，人工智能完成的一项重要功能是检测车辆道路标志的计算机视觉技术。然而，人工智能并不总是可靠的，有时需要人类的智慧来完成一项任务。人类要与人工智能合作，理解人类对人工智能的感知是至关重要的。在本研究中，我们调查了在停车标志受损的驾驶环境中，人类驾驶员如何感知人工智能的能力，以及与人工智能相关的知识、经验和信任如何发挥作用。我们发现，对人工智能了解更多的参与者更倾向于信任人工智能，而那些报告人工智能经验更多的人对人工智能的理解也更深入。参与者正确地推断出，人工智能更难以识别恶意操纵的停车标志。然而，参与者仍然高估了人工智能识别恶意停车标志的能力。我们的研究结果表明，公众对特定的人工智能系统还没有足够准确的理解，这导致他们在某些情况下过度信任人工智能。
Automated Driving Systems (ADS), like many other systems people use today, depend on successful Artificial Intelligence (AI) for safe roadway operations. In ADS, an essential function completed by AI is the computer vision techniques for detecting roadway signs by vehicles. The AI, though, is not always reliable and sometimes requires the human’s intelligence to complete a task. For the human to collaborate with the AI, it is critical to understand the human’s perception of AI. In the present study, we investigated how human drivers perceive the AI’s capabilities in a driving context where a stop sign is compromised and how knowledge, experience, and trust related to AI play a role. We found that participants with more knowledge of AI tended to trust AI more, and those who reported more experience with AI had a greater understanding of AI. Participants correctly deduced that a maliciously manipulated stop sign would be more difficult for AI to identify. Nevertheless, participants still overestimated the AI’s ability to recognize the malicious stop sign. Our findings suggest that the public do not yet have a sufficiently accurate understanding of specific AI systems, which leads them to over-trust the AI in certain conditions.