System for augmented human-robot interaction through mixed reality and robot training by non-experts in customer service environments
System for augmented human-robot interaction through mixed reality and robot training by non-experts in customer service environments
复制标题
DOI:
10.1080/01691864.2019.1694068
复制
发表时间:
2019-11-28
影响因子:
2
通讯作者:
Taniguchi, T.
中科院分区:
文献类型:
--
作者:
El Hafi, L.;Isobe, S.;Taniguchi, T.
Human-robot interaction during general service tasks in home or retail environment has been proven challenging, partly because (1) robots lack high-level context-based cognition and (2) humans cannot intuit the perception state of robots as they can for other humans. To solve these two problems, we present a complete robot system that has been given the highest evaluation score at the Customer Interaction Task of the Future Convenience Store Challenge at the World Robot Summit 2018, which implements several key technologies: (1) a hierarchical spatial concepts formation for general robot task planning and (2) a mixed reality interface to enable users to intuitively visualize the current state of the robot perception and naturally interact with it. The results obtained during the competition indicate that the proposed system allows both non-expert operators and end users to achieve human-robot interactions in customer service environments. Furthermore, we describe a detailed scenario including employee operation and customer interaction which serves as a set of requirements for service robots and a road map for development. The system integration and task scenario described in this paper should be helpful for groups facing customer interaction challenges and looking for a successfully deployed base to build on.