System for augmented human-robot interaction through mixed reality and robot training by non-experts in customer service environments

System for augmented human-robot interaction through mixed reality and robot training by non-experts in customer service environments
复制标题

DOI:
10.1080/01691864.2019.1694068
复制
发表时间:
2019-11-28
期刊:
影响因子:
2
通讯作者:
Taniguchi, T.
Taniguchi, T.
中科院分区:
计算机科学4区
文献类型:
--
作者:
El Hafi, L.;Isobe, S.;Taniguchi, T.

文献摘要

被引文献

相似文献

事实证明,在家庭或零售环境中的一般服务任务期间的人类机器人互动已被证明具有挑战性,部分是因为(1)机器人缺乏基于上下文的认知,并且(2)人类无法直观机器人的感知状态,因为。为了解决这两个问题,我们提出了一个完整的机器人系统,该系统在2018年世界机器人峰会的未来便利店挑战的客户互动任务中获得了最高的评估得分,该挑战实现了几种关键技术:(1)层次的空间空间通用机器人任务计划的概念形成以及(2)混合现实接口,使用户能够直观地可视化机器人感知的当前状态并自然与之相互作用。竞争期间获得的结果表明,该系统允许非专家运营商和最终用户在客户服务环境中实现人类机器人的交互。此外,我们描述了一个详细的方案,包括员工操作和客户互动,该方案是服务机器人的一组要求和开发路线图。本文描述的系统集成和任务方案应该有助于面临客户互动挑战的小组,并寻找成功部署的基础以建立。
Human-robot interaction during general service tasks in home or retail environment has been proven challenging, partly because (1) robots lack high-level context-based cognition and (2) humans cannot intuit the perception state of robots as they can for other humans. To solve these two problems, we present a complete robot system that has been given the highest evaluation score at the Customer Interaction Task of the Future Convenience Store Challenge at the World Robot Summit 2018, which implements several key technologies: (1) a hierarchical spatial concepts formation for general robot task planning and (2) a mixed reality interface to enable users to intuitively visualize the current state of the robot perception and naturally interact with it. The results obtained during the competition indicate that the proposed system allows both non-expert operators and end users to achieve human-robot interactions in customer service environments. Furthermore, we describe a detailed scenario including employee operation and customer interaction which serves as a set of requirements for service robots and a road map for development. The system integration and task scenario described in this paper should be helpful for groups facing customer interaction challenges and looking for a successfully deployed base to build on.