A multimodal language to communicate with life-supporting robots through a touch screen and a speech interface
A multimodal language to communicate with life-supporting robots through a touch screen and a speech interface
复制标题
一种通过触摸屏和语音界面与生命支持机器人进行交流的多模式语言
DOI：
10.1007/s10015-011-0924-x
复制
发表时间：
2011
影响因子：
0.9
通讯作者：
木 林 龍 一
中科院分区：
文献类型：
--
作者：
岡 哲資;松 本 大 賢;木 林 龍 一
本文提出了一种多模式语言，通过触摸屏和语音界面与生命支持机器人进行通信。该语言是为未经训练的用户设计的，他们在日常生活中需要经济高效的机器人的支持。在这种语言中，用户可以以交互方式结合口头和指向消息，以便向机器人传达他们的意图。口头信息包括描述意图的动词和名词短语。当用户的手指触摸相机图像、包含机器人身体的图片或手边触摸屏上的按钮时，会发出指向消息，这些消息传达了环境中的位置、方向、机器人的身体部位、提示、对查询的答复或帮助机器人的其他信息。这项工作展示了该语言的哲学和结构。
This article proposes a multimodal language to communicate with life-supporting robots through a touch screen and a speech interface. The language is designed for untrained users who need support in their daily lives from cost-effective robots. In this language, the users can combine spoken and pointing messages in an interactive manner in order to convey their intentions to the robots. Spoken messages include verb and noun phrases which describe intentions. Pointing messages are given when the user’s finger touches a camera image, a picture containing a robot body, or a button on a touch screen at hand which convey a location in their environment, a direction, a body part of the robot, a cue, a reply to a query, or other information to help the robot. This work presents the philosophy and structure of the language.