Iconic Gestures for Robot Avatars, Recognition and Integration with Speech.
Iconic Gestures for Robot Avatars, Recognition and Integration with Speech.
复制标题
DOI：
10.3389/fpsyg.2016.00183
复制
发表时间：
2016
影响因子：
3.8
通讯作者：
Leonards U
中科院分区：
文献类型：
--
作者：
Bremner P;Leonards U
共言手势是人类交流的重要组成部分，可以提高信息传递的效率和功效。远程实现这种多模式通信的一种可能方法是使用远程操作的人形机器人化身。此前，此类化身已被证明可以增强社交存在感和操作者的显着性。我们为 NAO 机器人平台提供了一种基于运动跟踪的远程操作系统，该系统允许直接传输操作员产生的语音和手势。为了评估该系统传输多模式通信的能力，我们进行了一项用户研究，调查机器人产生的标志性手势是否易于理解并与语音集成。使用参与者内部实验设计，将机器人执行的手势结果与人类演员执行的手势结果直接进行比较。我们证明，远程操作机器人发出的标志性手势在单独呈现时和由人类发出时几乎都能被参与者理解。更重要的是，我们表明，当作为多模式通信的一部分呈现时，手势与语音的集成对于人类和机器人的表现同样有效。
Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances.