Design of a face and gesture analysis system that can adapt to changes of user's intention by using anatomical knowledge

在人类的面部表情和手势中，存在着有意和无意的空间和时间变化。我们可以通过区分人类意图的变化来实现人机接口，使人与计算机之间能够进行面对面的交互。我们的研究目的是通过区分意图的变化来识别人类的情感。我们研究如下。（1）面部表情的测量要准确地分析出适应人的意图变化的人脸表情和手势，就必须测量出人脸表情的形状和动作的变化。因此，我们构建了测量人脸形状和人类手势运动的系统。首先，我们建立了测量三维面部形状变化的系统。（2）手部运动的跟踪为了分析手势的变化，我们构建了在三维空间中跟踪手部运动的系统。（3）实验我们通过对几个被试进行实验来评估我们的系统，并且我们考虑了有意情况和无意情况下的测量值之间的差异。（4）应用系统的设计我们考虑了能够区分人类意图的特征空间，并考虑了利用解剖学知识分析用户意图的方法。此外，我们考虑了我们的系统的应用。

In the human facial expressions and gesture, there are intentional and unintentional changes both in space and time. We can realize the human interface that enables face-to-face interaction between a human and a computer by distinguishing the change of human intentions. The purpose of our research is to recognize the human emotions by distinguishing the changes of intention. We studied as follows.(1)Measurement of facial Shapes To analyze the human facial expressions and gestures that adapt to he change of human, intensions accurately, we have to measure the change of the shape and motion. Therefore, we constructed the system that measures the shape of a human face and the motion of a human gesture. First, we constructed the system that measured the change of the three-dimensional facial shapes.(2)Tracking of hand motions To analyze the change of the gesture, we constructed the system that tracked the motions of the hand in the three-dimensional space.(3)Experiments We evaluated our system by experimenting on several subjects, and we considered the difference of the measured values between in the intentional case and the unintentional case.(4)Design of application system We considered the feature space that can distinguish the human intentions, and we considered the method of analyzing the user's intentions by using anatomical knowledge. Furthermore, we considered the application of our system.