Human Interaction Smart Subsystem-Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors
Human Interaction Smart Subsystem-Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors
复制标题
DOI：
10.3390/s20082376
复制
发表时间：
2020-04-01
期刊：
影响因子：
3.9
通讯作者：
Kawala-Sterniuk, Aleksandra
中科院分区：
文献类型：
--
作者：
Podpora, Michal;Gardecki, Arkadiusz;Kawala-Sterniuk, Aleksandra
本文提出了一个更详细的概念，人机交互系统的体系结构。所提出的架构和其他的主要区别之一是关于机器人的对话者的信息采集的方法。为了在实际交互发生之前获取尽可能多的信息，设计并实现了一个连接到智能基础设施的自定义物联网传感器子系统，以支持对话者识别和获取初始交互参数。开发的机器人系统的人工智能交互框架（包括具有传感器和执行器的人形Pepper，额外的本地，远程和云计算服务）正在通过使用定制的外部子系统进行扩展，以获得额外的知识：基于设备的人类识别，视觉识别和基于音频的对话者定位子系统。本文对这些子系统进行了深入的介绍和评价，提出了将它们集成到机器人交互系统中的好处。本文还对其中的一个外部子系统--蓝牙身份识别智能子系统进行了较为详细的分析。这个想法，用例和原型，智能基础设施系统元素的集成和原型实施是在Weangle公司的一个小前台作为一个体面的测试床应用领域进行的。
This paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot's interlocutor. In order to obtain as much information as possible before the actual interaction took place, a custom Internet-of-Things-based sensor subsystems connected to Smart Infrastructure was designed and implemented, in order to support the interlocutor identification and acquisition of initial interaction parameters. The Artificial Intelligence interaction framework of the developed robotic system (including humanoid Pepper with its sensors and actuators, additional local, remote and cloud computing services) is being extended with the use of custom external subsystems for additional knowledge acquisition: device-based human identification, visual identification and audio-based interlocutor localization subsystems. These subsystems were deeply introduced and evaluated in this paper, presenting the benefits of integrating them into the robotic interaction system. In this paper a more detailed analysis of one of the external subsystems-Bluetooth Human Identification Smart Subsystem-was also included. The idea, use case, and a prototype, integration of elements of Smart Infrastructure systems and the prototype implementation were performed in a small front office of the Weegree company as a decent test-bed application area.