Mixed Reality Deictic Gesture for Multi-Modal Robot Communication
Mixed Reality Deictic Gesture for Multi-Modal Robot Communication
复制标题
DOI：
10.1109/hri.2019.8673275
复制
发表时间：
2019-03
期刊：
影响因子：
--
通讯作者：
T. Williams;Matthew Bussing;Sebastian Cabrol;Elizabeth Boyle;N. Tran
中科院分区：
文献类型：
--
作者：
T. Williams;Matthew Bussing;Sebastian Cabrol;Elizabeth Boyle;N. Tran
在之前的工作中，研究人员多次证明机器人使用指示手势可以实现有效且自然的人机交互。然而，诸如增强现实头戴式显示器之类的新技术使混合现实成为可能的环境成为可能，并且在这种环境中，物理手势只是许多不同类型的混合现实指示手势中的一类。在本文中，我们首次对混合现实指示手势超越物理手势的有效性进行了实验探索。具体来说，我们研究了人类对模拟显示异心手势的视频的感知，其中机器人在用户的视野中围绕其目标。我们的结果表明，无论是在客观准确性还是主观感知方面，这都是一种有效的沟通策略，尤其是与复杂的自然语言参考配对时。
In previous work, researchers have repeatedly demonstrated that robots' use of deictic gestures enables effective and natural human-robot interaction. However, new technologies such as augmented reality head mounted displays enable environments in which mixed-reality becomes possible, and in such environments, physical gestures become but one category among many different types of mixed reality deictic gestures. In this paper, we present the first experimental exploration of the effectiveness of mixed reality deictic gestures beyond physical gestures. Specifically, we investigate human perception of videos simulating the display of allocentric gestures, in which robots circle their targets in users' fields of view. Our results suggest that this is an effective communication strategy, both in terms of objective accuracy and subjective perception, especially when paired with complex natural language references.