Do you speak to a human or a virtual agent? automatic analysis of user’s social cues during mediated communication
Do you speak to a human or a virtual agent? automatic analysis of user’s social cues during mediated communication
复制标题
您在中介交流期间与真人还是虚拟代理交谈？
DOI：
--
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
T. Chaminade
中科院分区：
文献类型：
--
作者：
M. Ochs;Nathan Libermann;Axel Boidin;T. Chaminade
虽然一些研究工作表明，虚拟代理能够从用户生成自然和社会行为，但很少有人将这些社会反应与人-人中介通信期间表达的社会反应进行比较。在本文中，我们建议探索的社会线索，由用户在介导的通信过程中，无论是与一个具体的会话代理或与另一个人。为此，我们利用机器学习方法来识别每种交互类型中的面部和头部社交线索特征，并构建一个模型来自动确定用户是否正在与虚拟代理或另一个人进行交互。结果表明，实际上，用户在与虚拟代理或另一用户通信期间不表达相同的面部和头部运动。基于这些结果，我们建议使用这样的机器学习模型来自动测量虚拟代理的社交能力，以在用户中生成与人-人交互相当的社交行为。所得到的模型可以自动检测用户是在与虚拟的还是真实的对话者进行通信，在一秒钟内只看用户的脸和头。
While several research works have shown that virtual agents are able to generate natural and social behaviors from users, few of them have compared these social reactions to those expressed dur- ing a human-human mediated communication. In this paper, we propose to explore the social cues expressed by a user during a mediated communication either with an embodied conversational agent or with another human. For this purpose, we have exploited a machine learning method to identify the facial and head social cues characteristics in each interaction type and to construct a model to automatically determine if the user is interacting with a virtual agent or another human. e results show that, in fact, the users do not express the same facial and head movements during a communication with a virtual agent or another user. Based on these results, we propose to use such a machine learning model to automatically measure the social capability of a virtual agent to generate a social behavior in the user comparable to a human- human interaction. e resulting model can detect automatically if the user is communicating with a virtual or real interlocutor, looking only at the user’s face and head during one second.