Evaluation of Multimodal Behaviour of Embodied Agents

Evaluation of Multimodal Behaviour of Embodied Agents
复制标题

体现主体的多模态行为评估

DOI:
10.1007/1-4020-2730-3_8
复制
发表时间:
2004
期刊:
Journal of speech, language, and hearing research : JSLHR
影响因子:
--
通讯作者:
Jean
Jean
中科院分区:
--
文献类型:
--
作者:
S. Buisine;S. Abrilian;Jean

文献摘要

被引文献

相似文献

具体化会话代理(ECA)的个性可能既取决于代理的外观,也取决于其结合不同方式(如语音和手势)的方式。在这一章中,我们描述了一项研究,在这项研究中,男性和女性用户必须听ECA所做的三个简短的技术演示。本研究比较了手势与语音使用的三种多通道策略:冗余性策略、互补性策略和语音专门化策略。这些策略被随机归因于看起来不同的2D ECA,以独立检验多通道策略和ECA外观的效果。我们考察的变量是主观印象和回忆表现。事实证明,多通道策略影响了解释质量的主观评分,特别是对男性用户。另一方面,外表会影响人们的喜好,但也会影响回忆的表现。这些结果强调了多通道策略和外观的重要性,以确保呈现ECA的愉快和有效。
Individuality of Embodied Conversational Agents (ECAs) may depend on both the look of the agent and the way it combines different modalities such as speech and gesture. In this chapter, we describe a study in which male and female users had to listen to three short technical presentations made by ECAs. Three multimodal strategies of ECAs for using arm gestures with speech were compared: redundancy, complementarity, and speech-specialization. These strategies were randomly attributed to different-looking 2D ECAs, in order to test independently the effects of multimodal strategy and ECA's appearance. The variables we examined were subjective impressions and recall performance. Multimodal strategies proved to influence subjective ratings of quality of explanation, in particular for male users. On the other hand, appearance affected likeability, but also recall performance. These results stress the importance of both multimodal strategy and appearance to ensure pleasantness and effectiveness of presentation ECAs.