Design of a face and gesture analysis system that can adapt to changes of user's intention by using anatomical knowledge

利用解剖学知识设计适应用户意图变化的人脸和手势分析系统

• 批准号: 14580417
• 负责人: SAJI Hitoshi
• 金额: $ 2.3万
• 依托单位: Shizuoka University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2003
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-14580417/
• 关键词: Motion Analysis; 3D Shape Variation; Anatomical Knowledge; Variation of Consciousness; Variation of Facial Expressions; 表情; 動作; 両眼視; 3次元計測; 顔; 動画; 対応付け; 腕

In the human facial expressions and gesture, there are intentional and unintentional changes both in space and time. We can realize the human interface that enables face-to-face interaction between a human and a computer by distinguishing the change of human intentions. The purpose of our research is to recognize the human emotions by distinguishing the changes of intention. We studied as follows.(1)Measurement of facial Shapes To analyze the human facial expressions and gestures that adapt to he change of human, intensions accurately, we have to measure the change of the shape and motion. Therefore, we constructed the system that measures the shape of a human face and the motion of a human gesture. First, we constructed the system that measured the change of the three-dimensional facial shapes.(2)Tracking of hand motions To analyze the change of the gesture, we constructed the system that tracked the motions of the hand in the three-dimensional space.(3)Experiments We evaluated our system by experimenting on several subjects, and we considered the difference of the measured values between in the intentional case and the unintentional case.(4)Design of application system We considered the feature space that can distinguish the human intentions, and we considered the method of analyzing the user's intentions by using anatomical knowledge. Furthermore, we considered the application of our system.

在人类的面部表情和手势中，存在着有意和无意的时空变化。我们可以通过区分人的意图变化来实现人与计算机面对面互动的人机界面。我们的研究目的是通过区分意图的变化来识别人类的情绪。我们的研究如下。(1)面部形状的测量为了准确地分析适应人类情绪变化的面部表情和手势，必须测量其形状和动作的变化。因此，我们构建了一个测量人脸形状和人类手势动作的系统。首先，我们构建了三维人脸形态变化测量系统。(2)手部运动跟踪为了分析手势的变化，我们构建了三维空间手部运动跟踪系统。我们通过对几个被试进行实验来评估我们的系统，我们考虑了在有意情况下和无意情况下测量值的差异。(4)应用系统设计我们考虑了能够区分人类意图的特征空间，并考虑了利用解剖学知识分析用户意图的方法。此外，我们还考虑了系统的应用。

项目成果

Hitoshi Saji, Hiromasa Nakatani: "Fusion of Color Photometric Stereo Method and Slit Pattern Projection Method to Measure Three-Dimensional Shapes of a Human Face"Proc. of DICTA2003. 731-740 (2003)

Hitoshi Saji、Hiromasa Nakatani：“融合彩色光度立体方法和狭缝图案投影方法来测量人脸的三维形状”Proc。

Takanao Inaguma, Hitoshi Saji, Hiromasa Nakatani: "Two-handed Gesture Tracking in the Case of Occlusion of Hands"Proc.of IAPR Workshop on Machine Vision Applications. 306-309 (2002)

Takanao Inaguma、Hitoshi Saji、Hiromasa Nakatani：“双手遮挡情况下的双手手势跟踪”IAPR 机器视觉应用研讨会论文集。

Hitoshi Saji: "Measuring Three-Dimensional Shapes of a Human Face Using Photometric Stereo Method with Color Light Sources and Slit Patterns"Optical Engineering. (採録決定). (2003)

Hitoshi Saji：“使用彩色光源和狭缝图案的光度立体方法测量人脸的三维形状”光学工程（已接受）。

Hitoshi Saji, Hiromasa Nakatani: "Measuring Three-Dimensional Shapes of a Human Face Using Photometric Stereo Method with Color Light Sources and Slit Patterns"Optical Engineering. Vol.42 Issue.9. 2727-2733 (2003)

Hitoshi Saji、Hiromasa Nakatani：“使用彩色光源和狭缝图案的光度立体方法测量人脸的三维形状”光学工程。

Takanao Inaguma, Hitoshi Saji, Hiromasa Nakatani: "Two-handed Gesture Tracking in the Case of Occlusion of Hands"Proc. of IAPR Workshop on Machine Vision Applications. 306-309 (2003)

Takanao Inaguma、Hitoshi Saji、Hiromasa Nakatani：“双手遮挡情况下的双手手势跟踪”Proc。