HIGH FIDELITY FACIAL MUSCLE MODELING AND ITS DYNAMIC CONTROL BY ANATOMICALAPPROACH

本研究的目的是通过构建模拟高保真肌肉组织动力学的个人面部肌肉模型，实现高质量的人脸动画合成。将面部各扁平肌肉组织模型化为一组分布在平面上的弹簧，并考虑受力和收缩，通过求解运动方程来模拟各肌肉的运动。提出了基于肌电的肌肉动作客观评价方法和基于噪声语音的唇部同步性评价方法；设计了基于图形用户界面的人脸拟合工具，为每个人定制通用的人脸肌肉模型。首先，通过人工将特征点添加到采集的人脸纹理中，自动修改通用的人脸肌肉模型以适应个人范围数据。然后每个肌肉组织的3D位置也是定制的。通过对各个肌肉位置的细微调整和人脸皮肤表面的运动检测，完成人脸肌肉模型，通过操纵各个肌肉构建人脸动画控制工具，生成人脸表情的多个变化。并结合人脸肌肉弹力确定了基于FACS的每个基本目标人脸。这一结果包含在拟人语音对话代理的开源工具包的面部合成模块中。本研究的部分成果参与了为2005年世博会而开发的“未来投射系统”。

The purpose of this research is to realize a high quality facial animation synthesis by constructing personal facial muscle model which simulate high fidelity muscle tissues' dynamics. Each flat facial muscle tissue is modeled by group of springs spread on a plane and the motion of each muscle is simulated by solving motion equation by considering force and contraction. Collision detection of each muscle, resistance force from skull surface and muscle volume are also considered to generate natural model of facial dynamics.Objective evaluation method of muscle action using EMG is proposed and also evaluation method of lip synchronization using noise added voice is proposed.To customize a generic facial muscle model to each person, GUI based face fitting tool is designed. Firstly by putting feature points to captured face texture manually, automatically generic facial muscle model is modified to fit onto personal range data. Then 3D location of each muscle tissue is also customized. By minor adjustment of each muscle location and checking motion of face skin surface, personal facial muscle model is completed.Facial animation control tool by manipulating each muscle is constructed to generate several variation of face expression. And we define each basic target face considering FACS by combination of facial muscle spring forces. This result is included in the face synthesis module in the open source toollkit for anthropomorphic spoken dialog agent. And some of the result from this research contributed to "Future Cast System" which is developed for Expo 2005.