The recognition and simulation of conversational facial expressions at various levels of photorealism

不同真实感级别对话面部表情的识别和模拟

• 批准号: 18510149
• 负责人: Professor Dr.-Ing. Wolfgang Straßer (†)
• 金额: --
• 依托单位: Fachbereich IV: Informatik
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2006
• 资助国家: 德国
• 起止时间: 2005-12-31 至 2008-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/18510149?language=en
• 关键词: recognition; simulation; conversational; facial; expressions

Communication is simultaneously one of the most important and one of the most complex tasks that humans undertake. Facial motions play a central role in the process of communication, and can be used to help modify what is said, to control the flow of a dialog, or to convey complex intentions without saying a word. In this project, we aim to use a synergistic combination of psychophysical and computer graphics methodologies in order to develop a systematic description of the facial motions that are required to produce realistic, natural looking, conversational facial animations. In one line of research, we will employ advanced facial animation techniques to determine which areas of the face need to move (and which are sufficient) for an expression to be recognized. The information that is used to recognize an expression, or to determine its believability must be dependent on the information that is actually present. The perception of expressions may, then, be dependent on the level of realism. The project will examine the perception of expressions at different levels of abstraction, from real video footage, through highly realistic animations down to highly non-photorealistic animations.

沟通是人类承担的最重要和最复杂的任务之一。面部动作在交流过程中起着核心作用，可以用来帮助修改所说的内容，控制对话的流程，或者不用说一句话就能传达复杂的意图。在这个项目中，我们的目标是使用心理物理学和计算机图形学方法的协同组合，以开发一个系统的描述所需的面部运动，以产生逼真的，自然的外观，会话面部动画。在一条研究线中，我们将采用先进的面部动画技术来确定面部的哪些区域需要移动（以及哪些区域足够）以识别表情。用来识别一个表达或确定其可信度的信息必须依赖于实际存在的信息。因此，对表达的感知可能取决于现实主义的水平。该项目将研究不同抽象层次的表情感知，从真实的视频片段，通过高度逼真的动画到高度非照片级逼真的动画。