HCC:Small:Collaborative Research:Design and Evaluation of Socially Engaging Avatars

该项目将采用一个循环的两步过程来开发一个计算模型，该模型将动态表情和社交参与的非语言手势嵌入到说话的化身中，并在涉及人与数字代理交互的数字虚拟环境中实验测试其可用性。具体地说，本项目的研究目标包括：(1)富有表现力的说话面孔的合成和动态面部表情的建模，(2)社交参与的非语言脸部手势的合成，以及(3)对生成的化身的深入可用性研究。数字沉浸式虚拟环境技术对人机交互有着巨大的影响。数字人类表现的许多特征，特别是那些看起来像人类的代理人的特征，对于社会参与和社会影响是重要的。特别是，非语言行为起着至关重要的作用。在这些行为中，可以说最重要的是面部表情，这对数字代理的有意义的渲染至关重要。到目前为止，允许这种渲染的计算模型并不是最优的。事实上，用于呈现自发的、即时的非语言面部手势并将其与语音相结合的适用和系统的计算模型还没有被创造出来。这一拟议项目的成功将消除有用的数字人体表现技术在所有以计算机为媒介的通信可以发挥作用的应用中广泛应用的主要障碍，包括商业、教育、医疗、工程和娱乐应用。此外，它将具有深远的科学影响，提供一种计算上易于处理的机制，将人的素质嵌入到计算机控制的实体中，这些实体用于其他科学和工程领域。

This project will employ a cyclical two-step process to develop a computational model that embeds dynamic expression and socially engaging non-verbal gestures into talking avatars, and experimentally tests its usability within digital virtual environments involving human-digital agent interaction. Specifically, the research objectives of this project include: (1) synthesis of expressive talking faces and modeling of dynamic facial expressions, (2) synthesis of socially engaging non-verbal facial gestures, and (3) in-depth usability studies on resultant avatars. Digital immersive virtual environment technology has enormous implications for human-computer interaction. Many qualities of digital human representations, particularly those of human-appearing agents, are important for social engagement and social influence. In particular, non-verbal behaviors play a critical role. Among such behaviors, arguably the most important are facial expressions of emotion, which are critical for meaningful renderings of digital agents. To date, computational models that would permit such renderings are less than optimal. Indeed, an applicable and systematic computational model for rendering spontaneous, on-the-fly non-verbal facial gestures and integrating them with speech has not been created. The success of this proposed project will remove a major barrier to the widespread application of useful digital human representation technology for all applications in which computer-mediated communication can play a role, including commerce, education, health, engineering, and entertainment applications. In addition, it will have far-reaching scientific implications, providing a computationally tractable mechanism for embedding human qualities into computer-controlled entities that are used in other scientific and engineering fields.