A Multimodal User Interface for an Assistive Robotic Shopping Cart
A Multimodal User Interface for an Assistive Robotic Shopping Cart
复制标题
辅助机器人购物车的多模式用户界面
DOI：
10.3390/electronics9122093
复制
发表时间：
2020
期刊：
影响因子：
2.9
通讯作者：
A. Karpov
中科院分区：
文献类型：
--
作者：
D. Ryumin;I. Kagirov;A. Axyonov;N. Pavlyuk;A. Saveliev;I. Kipyatkova;M. Železný;I. Mporas;A. Karpov
本文介绍了辅助移动的信息机器人样机的研究与开发。所提出的原型的主要特点是语音和手势为基础的接口与俄罗斯语音和手语识别和合成技术和高度的机器人自主性。AMIR原型的目标是用作杂货店和/或超市购物的机器人推车。在本文所涵盖的主要议题是介绍的接口（三种模式），单手手势识别系统（基于收集的数据库的俄罗斯手语元素），以及机器人平台的技术说明（架构，导航算法）。多模态界面的使用，即语音和手势模态，使人机交互自然和直观，以及手语识别允许听力受损的人使用这种机器人推车。AMIR原型具有良好的前景，真实的使用超市，由于其辅助功能和多模式的用户界面。
This paper presents the research and development of the prototype of the assistive mobile information robot (AMIR). The main features of the presented prototype are voice and gesture-based interfaces with Russian speech and sign language recognition and synthesis techniques and a high degree of robot autonomy. AMIR prototype’s aim is to be used as a robotic cart for shopping in grocery stores and/or supermarkets. Among the main topics covered in this paper are the presentation of the interface (three modalities), the single-handed gesture recognition system (based on a collected database of Russian sign language elements), as well as the technical description of the robotic platform (architecture, navigation algorithm). The use of multimodal interfaces, namely the speech and gesture modalities, make human-robot interaction natural and intuitive, as well as sign language recognition allows hearing-impaired people to use this robotic cart. AMIR prototype has promising perspectives for real usage in supermarkets, both due to its assistive capabilities and its multimodal user interface.
DOI：
10.1109/iros.2006.282457
发表时间：
2006-10
期刊：
2006 IEEE/RSJ International Conference on Intelligent Robots and Systems
影响因子：
--
作者：
T. Tomizawa;A. Ohya;S. Yuta
通讯作者：
T. Tomizawa;A. Ohya;S. Yuta