Attentive listening system with backchanneling, response generation and flexible turn-taking
Attentive listening system with backchanneling, response generation and flexible turn-taking
复制标题
具有反向通道、响应生成和灵活轮流功能的专心聆听系统
DOI：
--
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Tatsuya Kawahara
中科院分区：
文献类型：
--
作者：
Divesh Lala;Pierrick Milhorat;K. Inoue;Masanari Ishida;K. Takanashi;Tatsuya Kawahara
专注倾听系统的设计是为了让人们，特别是老年人，保持沟通能力和心理健康。本文讨论了一个专注的倾听系统的关键组成部分，以鼓励用户顺利地交谈。首先，我们引入了对话语端点的连续预测和反向通道的生成，而不是在话语端点检测后生成反向通道。这提高了对反向渠道的主观评价。其次，我们提出了一种有效的语句响应机制，该机制可以检测焦点词并以问题或部分重复的形式进行响应。这可以应用于任何语句。此外，设计了一种灵活的换向机制，当换向开关有歧义时，可以使用回道或填料。这些技术被集成到一个人形机器人中，以进行专注的倾听。我们在一个试点实验中测试了该系统的可行性，并表明它可以在会话中产生连贯的对话。
Attentive listening systems are designed to let people, especially senior people, keep talking to maintain communication ability and mental health. This paper addresses key components of an attentive listening system which encourages users to talk smoothly. First, we introduce continuous prediction of end-of-utterances and generation of backchannels, rather than generating backchannels after end-point detection of utterances. This improves subjective evaluations of backchannels. Second, we propose an effective statement response mechanism which detects focus words and responds in the form of a question or partial repeat. This can be applied to any statement. Moreover, a flexible turn-taking mechanism is designed which uses backchannels or fillers when the turn-switch is ambiguous. These techniques are integrated into a humanoid robot to conduct attentive listening. We test the feasibility of the system in a pilot experiment and show that it can produce coherent dialogues during conversation.