Impact of Personality on Nonverbal Behavior Generation
Impact of Personality on Nonverbal Behavior Generation
复制标题
DOI：
10.1145/3383652.3423908
复制
发表时间：
2020-10
期刊：
影响因子：
--
通讯作者：
Ryo Ishii;Chaitanya Ahuja;Y. Nakano;Louis-Philippe Morency
中科院分区：
文献类型：
--
作者：
Ryo Ishii;Chaitanya Ahuja;Y. Nakano;Louis-Philippe Morency
要实现看起来自然的虚拟代理，一个关键的技术挑战是从口语中自动生成非语言行为。由于非语言行为因个性而异，因此生成这些非语言行为以匹配虚拟代理的预期个性是很重要的。在这项工作中，我们研究了人格特征如何与从整个身体产生个人非言语行为的过程有关，包括头部、眼睛凝视、手臂和姿势。为了研究这一点，我们首先创建了一个对话语料库，包括成绩单、一系列被标记的非语言行为，以及二元互动参与者的五大人格得分。我们构建的模型可以从参与者的口语句子中预测作为输入语言表征的每个非语言行为标签。我们的实验结果表明，个性有助于提高对非言语行为的预测。
To realize natural-looking virtual agents, one key technical challenge is to automatically generate nonverbal behaviors from spoken language. Since nonverbal behavior varies depending on personality, it is important to generate these nonverbal behaviors to match the expected personality of a virtual agent. In this work, we study how personality traits relate to the process of generating individual nonverbal behaviors from the whole body, including the head, eye gaze, arms, and posture. To study this, we first created a dialogue corpus including transcripts, a broad range of labelled nonverbal behaviors, and the Big Five personality scores of participants in dyad interactions. We constructed models that can predict each nonverbal behavior label given as an input language representation from the participants' spoken sentences. Our experimental results show that personality can help improve the prediction of nonverbal behaviors.