Intelligent virtual character systems

智能虚拟角色系统

• 批准号: 298201-2006
• 负责人: DiPaola, Steve
• 金额: $ 0.95万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2007
• 资助国家: 加拿大
• 起止时间: 2007-01-01 至 2008-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=364067
• 关键词: Intelligent; virtual; character; systems

Recent developments in multimedia hardware and software have made it possible for many systems to incorporate audio-visual components. On the other hand, the human face as a communication object plays a major role in our interactions. This demands a special focus on computer-generated face animation as a specific area of research in multimedia systems and computer graphics. Among possible applications, communication, web-based services, interactive agents, computer games, and visual effects in movies can be mentioned. Our primary area of research is social user interfaces, i.e. a certain category of human-computer interaction where computers can show socially meaningful, verbal or non-verbal, behaviours such as gestures and expressions. This Discovery Grant is to support our long range research project - a comprehensive environment for interactive 2D and 3D face animation which uses a knowledge-based approach. This approach gives us a multi-dimensional parameter space language of hierarchical facial expressions, emotions and behaviours; creating a facial environment that uses a natural and complex knowledge representation of the face (and face expressions). To achieve these goals our development system uses component-based streaming architecture, and Face Modeling Language (FML), an XML-based language compatible with MPEG-4 XMT framework, and is called iFace.  iFACE is based on the idea of Face Multimedia Object (FMO), designed for a variety of face-centric applications.

多媒体硬件和软件的最新发展使许多系统能够结合视听组件。另一方面，作为交流对象的人脸在我们的互动中扮演着重要的角色。这就需要特别关注计算机生成的人脸动画，将其作为多媒体系统和计算机图形学研究的一个特定领域。在可能的应用中，可以提到通信、基于网络的服务、交互代理、计算机游戏和电影中的视觉效果。我们的主要研究领域是社交用户界面，即某种类型的人机交互，其中计算机可以显示具有社会意义的语言或非语言行为，如手势和表情。这笔发现补助金是为了支持我们的长期研究项目-一个使用基于知识的方法的交互式2D和3D人脸动画的综合环境。这种方法为我们提供了一种多维参数空间语言，其中包括面部表情、情感和行为的层次化；创建了一个使用面部(和面部表情)的自然而复杂的知识表示的面部环境。为了实现这些目标，我们的开发系统使用了基于组件的流媒体架构，以及人脸建模语言(FML)，这是一种与MPEG-4 XMT框架兼容的基于XML的语言，被称为iFace。iFace基于人脸多媒体对象(FMO)的思想，专为各种以人脸为中心的应用程序而设计。