Crossing Reality: Comparing Physical and Virtual Robot Deixis
Crossing Reality: Comparing Physical and Virtual Robot Deixis
复制标题
穿越现实：比较物理和虚拟机器人指示语
DOI：
10.1145/3568162.3576972
复制
发表时间：
2023
期刊：
影响因子：
--
通讯作者：
Williams, Tom
中科院分区：
文献类型：
--
作者：
Han, Zhao;Zhu, Yifei;Phan, Albert;Garza, Fernando Sandoval;Castro, Amia;Williams, Tom
增强现实（AR）技术为人机交互提供了一种令人兴奋的新媒介，为隐式和显式人机通信提供了新的机会。例如，这些技术使物理受限的机器人能够执行非语言交互模式，例如指示手势，尽管缺乏这样做所需的物理形态。然而，大量的HRI研究已经证明了物理实施的真实的益处（与例如，屏幕上的虚拟机器人），这表明虚拟机器人部件的AR增强可能面临挑战。在这项工作中，我们提出了经验证据比较使用虚拟（AR）和物理手臂来执行指示手势，识别虚拟或物理对象。我们的主观和客观的结果表明，混合现实指示手势在克服这些潜在的限制，他们的成功使用，无论手势和所指之间的物理差异的成功。这些结果有助于激励混合现实机器人系统的进一步部署，并为混合现实技术在HRI环境中的作用提供了细致入微的见解。
Augmented Reality (AR) technologies present an exciting new medium for human-robot interactions, enabling new opportunities for both implicit and explicit human-robot communication. For example, these technologies enable physically-limited robots to execute non-verbal interaction patterns such as deictic gestures despite lacking the physical morphology necessary to do so. However, a wealth of HRI research has demonstrated real benefits to physical embodiment (compared to, e.g., virtual robots on screens), suggesting AR augmentation of virtual robot parts could face challenges. In this work, we present empirical evidence comparing the use of virtual (AR) and physical arms to perform deictic gestures that identify virtual or physical referents. Our subjective and objective results demonstrate the success of mixed reality deictic gestures in overcoming these potential limitations, and their successful use regardless of differences in physicality between gesture and referent. These results help to motivate the further deployment of mixed reality robotic systems and provide nuanced insight into the role of mixed-reality technologies in HRI contexts.