Three-dimensional Analysis of Faces and Application to Facial Animation with Expressions

面部三维分析及其在面部表情动画中的应用

• 批准号: 07680399
• 负责人: YOKOYA Naokazu
• 金额: $ 1.28万
• 依托单位: Nara Institute of Science and Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1995
• 资助国家: 日本
• 起止时间: 1995 至 1996
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-07680399/
• 关键词: Facial Image Processing; Expression Analysis; Expression Synthesis; 3D Measurement; Cylindrical range Image; 3D Shape Analysis; Image Warping; Facial Animation

We have obtained the following research results in this project.1. Three-dimendional Measurement of Faces Firstly faces of more than thirty testees were measured in neutral and six primary expressions (anger, disgust, surprise, fear, happiness, sadness) by using a laser rangefinder. Both cylindrical range and surface color images were obtained in this measurement. In order to remove the influence of pose and position of testees, we defined an object-centered coordinate system on a face. Preliminary experiments have shown that the employed feature point representation is approximately invariant to variations of facial shapes.2. Three-dimensional Shape Analysis of Faces Using Range Images We have developed a method of quantifying six primary facial expressions by computing 3D motion vectors at feature points in range images during expressions. Such motion vectors indicate the facial deformation during expressions. We have also developed a method of automatically extracting facial compone … More nts from color images as well as that of face recognition based on a subspace method using range images. It has been observed that the mosaicing of images increases the recognition rate.3. Image Warping for Range Images A framework of generating a 3D facial expression image from a neutral image has been established . The method is based upon applying an image warping technique to range and surface color images. The image warping employed is based upon radial basis functions. Now we can generate facial images with six primary expressions from an image with neutral expression. The subjective evaluation has been conducted for evaluating the quality of generated images.4. Facial Animation with Expressions The facial animation is computed by gradually changing the magnitude of expression in the process of generating facial images with six primary expressions, which is mentioned above. Moreover, we have investigated in the motion animation based on dynamics using a musculoskeletal model toward the future research. Less

在本项目中，我们取得了以下研究成果。面孔的三维测量首先使用激光测距仪测量了30多名受试者在中性和六种主要表情(愤怒、厌恶、惊讶、恐惧、快乐和悲伤)下的面孔。在测量中获得了柱面范围和表面彩色图像。为了消除受试者的姿态和位置的影响，我们在人脸上定义了一个以对象为中心的坐标系。初步实验表明，所采用的特征点表示对人脸形状的变化具有近似不变性。基于深度图像的人脸三维形状分析我们提出了一种通过在表情过程中计算深度图像特征点的三维运动矢量来量化六种主要面部表情的方法。这样的运动矢量表示表情过程中的面部变形。我们还开发了一种自动提取面部成分…的方法更多的NTS来自彩色图像以及基于深度图像的子空间方法的人脸识别。实验结果表明，图像拼接提高了识别率。深度图像的图像扭曲建立了从中性图像生成3D面部表情图像的框架。该方法基于将图像扭曲技术应用于范围和表面彩色图像。所采用的图像扭曲是基于径向基函数的。现在，我们可以从一幅中性表情的图像中生成具有六个主要表情的面部图像。对生成的图像质量进行主观评价。具有表情的面部动画在生成具有六种基本表情的面部图像的过程中，通过逐渐改变表情的大小来计算面部动画，如上所述。此外，我们还研究了在基于动力学的运动动画中使用肌肉骨骼模型进行进一步的研究。较少

项目成果

Yumiko Tatsuno: "Analysis and Synthesis of Six primary Facial Expressions Using Cylindrical Data" Journal of ITE. 50・10. 1474-1481 (1996)

Yumiko Tatsuno：“使用圆柱数据分析和综合六种主要面部表情” ITE 杂志 50・10（1996）。

Yumiko Tatsuno: "Analysis and Synthesis of Six Primary Facial Expressions Using Range Images" Proc.13th Int.Conf.on Pattern Recognition. 3. 489-493 (1996)

Yumiko Tatsuno：“使用范围图像分析和综合六种主要面部表情”Proc.13th Int.Conf.on 模式识别。

Ryuji Funayama: "Facial component extraction by cooperative active nets with global constraints" Proc.13th Int.on Pattern Recognition. 2. 300-304 (1996)

Ryuji Funayama：“通过具有全局约束的协作主动网络进行面部成分提取”Proc.13th Int.on Pattern Recognition。

宮部 素明: "筋肉モデルを用いた動力学的計算に基づく腕動作アニメーションの作成" 電子情報通信学会技術研究報告(信学技報). 97. (1997)

Motoaki Miyabe：“基于使用肌肉模型的动态计算创建手臂运动动画”IEICE技术研究报告（IEICE Technical Report）97。（1997）。

Satoshi, Suzuki: "Analysis and Synthesis of Human Facial Expression Using Range Images" Proc.2nd Asian Conf.on Computer Vision. 2. 474-478 (1995)

Satoshi, Suzuki：“使用范围图像分析和合成人类面部表情”Proc.2nd Asian Conf.on Computer Vision。