HCC:Small:Collaborative Research:Design and Evaluation of Socially Engaging Avatars

该项目将采用一个循环的两步过程来开发一个计算模型，该模型将动态表达和社交参与的非语言手势嵌入到说话的化身中，并通过实验测试其在涉及人类-数字代理交互的数字虚拟环境中的可用性。具体而言，本项目的研究目标包括：（1）合成富有表现力的说话面部和动态面部表情的建模，（2）合成社交参与的非语言面部姿态，以及（3）对合成化身的深入可用性研究。数字沉浸式虚拟环境技术对人机交互有着巨大的影响。数字人类表征的许多品质，特别是人类出现的代理人的品质，对于社会参与和社会影响力非常重要。特别是，非语言行为起着关键作用。在这些行为中，可以说最重要的是情感的面部表情，这对于数字代理的有意义的渲染至关重要。到目前为止，允许这种渲染的计算模型还不是最佳的。事实上，还没有建立一个适用的和系统的计算模型来渲染自发的、即时的非语言面部手势并将它们与语音相结合。这个项目的成功将消除一个主要的障碍，广泛应用的有用的数字人类表示技术的所有应用程序，其中计算机介导的通信可以发挥作用，包括商业，教育，健康，工程和娱乐应用。此外，它将具有深远的科学意义，提供一种计算上易于处理的机制，将人类素质嵌入其他科学和工程领域使用的计算机控制的实体中。

This project will employ a cyclical two-step process to develop a computational model that embeds dynamic expression and socially engaging non-verbal gestures into talking avatars, and experimentally tests its usability within digital virtual environments involving human-digital agent interaction. Specifically, the research objectives of this project include: (1) synthesis of expressive talking faces and modeling of dynamic facial expressions, (2) synthesis of socially engaging non-verbal facial gestures, and (3) in-depth usability studies on resultant avatars. Digital immersive virtual environment technology has enormous implications for human-computer interaction. Many qualities of digital human representations, particularly those of human-appearing agents, are important for social engagement and social influence. In particular, non-verbal behaviors play a critical role. Among such behaviors, arguably the most important are facial expressions of emotion, which are critical for meaningful renderings of digital agents. To date, computational models that would permit such renderings are less than optimal. Indeed, an applicable and systematic computational model for rendering spontaneous, on-the-fly non-verbal facial gestures and integrating them with speech has not been created. The success of this proposed project will remove a major barrier to the widespread application of useful digital human representation technology for all applications in which computer-mediated communication can play a role, including commerce, education, health, engineering, and entertainment applications. In addition, it will have far-reaching scientific implications, providing a computationally tractable mechanism for embedding human qualities into computer-controlled entities that are used in other scientific and engineering fields.