Multi-person conversation via multi-modal interface - a robot who communicate with multi-user -
Multi-person conversation via multi-modal interface - a robot who communicate with multi-user -
复制标题
通过多模态界面进行多人对话 - 与多用户通信的机器人 -
DOI：
10.21437/eurospeech.1999-387
复制
发表时间：
1999
期刊：
影响因子：
11.2
通讯作者：
Tetsunori Kobayashi
中科院分区：
文献类型：
--
作者：
Y. Matsusaka;Tsuyoshi Tojo;S. Kubota;K. Furukawa;Daisuke Tamiya;Keisuke Hayata;Yuichiro Nakano;Tetsunori Kobayashi
本文描述了一个利用多通道界面与多人对话的机器人。多人对话包括许多传统的Oneto-One对话中没有考虑的新问题：例如信息流问题(识别谁在说话以及他在对谁说话/呼吁系统在对谁说话)、空间信息共享问题和话轮持有者估计问题(估计谁是下一个说话人)。我们利用多模式接口解决了这些问题：人脸方向识别、手势识别、声音方向识别、语音识别和手势表达。这些功能的系统结合，实现了人性化的多人通话系统。
This paper describes a robot who converses with multi-person using his multi-modal interface. The multi-person conversation includes many new problems, which are not cared in the conventional oneto-one conversation: such as information flow problems (recognizing who is speaking and to whom he is speaking / appealing to whom the system is speaking), space information sharing problem and turn holder estimation problem (estimating who is the next speaker). We solved these problems by utilizing multi-modal interface: face direction recognition, gesture recognition, sound direction recognition, speech recognition and gestural expression. The systematic combination of these functions realized human friendly multi-person conversation system.