A Systematic Cross-Corpus Analysis of Human Reactions to Robot Conversational Failures
A Systematic Cross-Corpus Analysis of Human Reactions to Robot Conversational Failures
复制标题
人类对机器人对话失败的反应的系统跨语料库分析
DOI：
10.1145/3462244.3479887
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
M. Soleymani
中科院分区：
文献类型：
--
作者：
Dimosthenis Kontogiorgos;Minh Tran;Joakim Gustafson;M. Soleymani
在本文中，我们分析了多模态的行为反应，机器人故障在不同的任务。两个多模态数据集进行检查，其中人类与引导任务机器人在面向任务的对话。在这两个数据集中，机器人模拟了通常在人机交互中观察到的会话中断和错误沟通的失败。我们仔细研究了人类对这些失败的反应，观察面部和声学特征。我们的分析确定了重要的行为特征，自动检测这种故障的相互作用。我们还研究了人类对不同类型的机器人故障的反应，如果故障发生在早期或晚期的相互作用引起的反应的变化。我们的研究结果表明，在对机器人故障的反应中，有几种非语言行为是一贯存在的，例如，凝视和言语韵律，而语言特征似乎是任务依赖的。我们将讨论这些发现如何推广到其他任务，以及自主机器人如何识别在与人类互动中检测故障并从故障中恢复的机会。
In this paper, we analyze multimodal behavioral responses to robot failures across different tasks. Two multimodal datasets are examined in which humans interact with guided-task robots in task-oriented dialogues. In both datasets, the robots simulated failures of conversational breakdown and miscommunication typically observed in human-robot interactions. We closely examine human reactions to these failures looking at facial and acoustic features. Our analyses identify the significant behavioral features for automatic detection of such failures in interaction. We also examine human responses to different types of robot failures and if failures occurred early or late in the interaction cause variation in the responses. Our findings indicate that several nonverbal behaviors are consistently present in responses to robots’ failures, e.g., gaze and speech prosody, whereas, linguistic features appear to be task-dependent. We discuss how these findings may generalize to other tasks, and how autonomous robots may identify opportunities to detect and recover from failures in interactions with humans.