Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making
Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making
复制标题
DOI：
10.1145/3479552
复制
发表时间：
2021-01
影响因子：
--
通讯作者：
Han Liu;Vivian Lai;Chenhao Tan
中科院分区：
文献类型：
--
作者：
Han Liu;Vivian Lai;Chenhao Tan
尽管人工智能有望在社会关键领域改善人类决策，但人类人工智能团队如何在具有挑战性的预测任务（也称为互补性能）中可靠地超越单独的人工智能和单独的人类，仍然是一个悬而未决的问题。我们探索两个方向来了解实现互补绩效方面的差距。首先，我们认为典型的实验设置限制了人类人工智能团队的潜力。为了解决由于分布转移而导致分布外人工智能性能低于分布内人工智能性能的问题，我们设计了不同分布类型的实验，并研究了分布内和分布外示例的人类表现。其次，我们开发新颖的界面来支持交互式解释，以便人类可以积极参与人工智能的协助。通过针对三项任务的虚拟试点研究和大规模随机实验，我们证明了分布内和分布外之间的明显差异，并观察到交互式解释的混合结果：虽然交互式解释改善了人类对人工智能辅助有用性的感知，但它们可能会强化人类偏见并导致性能改善有限。总的来说，我们的工作指出了利用人工智能辅助提高人类绩效的关键挑战和未来方向。
Although AI holds promise for improving human decision making in societally critical domains, it remains an open question how human-AI teams can reliably outperform AI alone and human alone in challenging prediction tasks (also known as complementary performance). We explore two directions to understand the gaps in achieving complementary performance. First, we argue that the typical experimental setup limits the potential of human-AI teams. To account for lower AI performance out-of-distribution than in-distribution because of distribution shift, we design experiments with different distribution types and investigate human performance for both in-distribution and out-of-distribution examples. Second, we develop novel interfaces to support interactive explanations so that humans can actively engage with AI assistance. Using virtual pilot studies and large-scale randomized experiments across three tasks, we demonstrate a clear difference between in-distribution and out-of-distribution, and observe mixed results for interactive explanations: while interactive explanations improve human perception of AI assistance's usefulness, they may reinforce human biases and lead to limited performance improvement. Overall, our work points out critical challenges and future directions towards enhancing human performance with AI assistance.