Emotional Storytelling Using Virtual and Robotic Agents
Emotional Storytelling Using Virtual and Robotic Agents
复制标题
DOI：
10.1142/s0219843618500068
复制
发表时间：
2018-06-01
影响因子：
1.5
通讯作者：
Mavridis, Nikolaos
中科院分区：
文献类型：
--
作者：
Costa, Sandra;Brunete, Alberto;Mavridis, Nikolaos
为了创建有效的讲故事代理三个基本问题必须回答：第一，是一个物理体现代理更可取的虚拟代理或语音只有叙述？第二，人类的声音比合成的声音有优势吗？第三，故事中不同人物的情感轨迹应该如何与讲故事者在讲故事时的面部表情相关联，以及这与听众脸上的明显情绪如何相关？两项特别设计的研究结果表明，与虚拟实施例相比，物理体现的机器人对听者产生更多的注意力，人类的声音比当前的文本到语音的艺术状态更可取，并且故事的情感线，叙述者的面部表情和听者的情感之间存在复杂而有趣的关系，而且听者的移情作用通过其面部表情是显而易见的。这项工作是向情感讲故事机器人迈出的重要一步，这些机器人可以观察他们的听众并调整他们的风格，以最大限度地提高他们的效率。
In order to create effective storytelling agents three fundamental questions must be answered: first, is a physically embodied agent preferable to a virtual agent or a voice-only narration? Second, does a human voice have an advantage over a synthesised voice? Third, how should the emotional trajectory of the different characters in a story be related to a storyteller's facial expressions during storytelling time, and how does this correlate with the apparent emotions on the faces of the listeners? The results of two specially designed studies indicate that the physically embodied robot produces more attention to the listener as compared to a virtual embodiment, that a human voice is preferable over the current state of the art of text-to-speech, and that there is a complex yet interesting relation between the emotion lines of the story, the facial expressions of the narrating agent, and the emotions of the listener, and that the empathising of the listener is evident through its facial expressions. This work constitutes an important step towards emotional storytelling robots that can observe their listeners and adapt their style in order to maximise their effectiveness.