Design of a face and gesture analysis system that can adapt to changes of user's intention by using anatomical knowledge

在人类的面部表情和手势中，无论是在空间上还是在时间上都有有意和无意的变化。我们可以通过区分人的意图的变化来实现人与计算机之间的面对面交互的人机界面。我们研究的目的是通过区分意图的变化来识别人类的情感。主要研究内容如下：(1)人脸形状的测量要准确地分析出适应人类内涵变化的面部表情和手势，就必须测量人脸的形状和运动的变化。因此，我们构建了一个测量人脸形状和人体手势运动的系统。实验首先构建了三维人脸形状变化的测量系统。(2)手势跟踪为了分析手势的变化，我们构建了手部在三维空间中的运动跟踪系统。(3)实验我们通过在多个对象上进行实验来评估我们的系统，考虑了有意和无意情况下测量值的差异。(4)应用系统的设计考虑了能够区分人类意图的特征空间，并考虑了利用解剖学知识分析用户意图的方法。此外，我们还考虑了我们的系统的应用。

In the human facial expressions and gesture, there are intentional and unintentional changes both in space and time. We can realize the human interface that enables face-to-face interaction between a human and a computer by distinguishing the change of human intentions. The purpose of our research is to recognize the human emotions by distinguishing the changes of intention. We studied as follows.(1)Measurement of facial Shapes To analyze the human facial expressions and gestures that adapt to he change of human, intensions accurately, we have to measure the change of the shape and motion. Therefore, we constructed the system that measures the shape of a human face and the motion of a human gesture. First, we constructed the system that measured the change of the three-dimensional facial shapes.(2)Tracking of hand motions To analyze the change of the gesture, we constructed the system that tracked the motions of the hand in the three-dimensional space.(3)Experiments We evaluated our system by experimenting on several subjects, and we considered the difference of the measured values between in the intentional case and the unintentional case.(4)Design of application system We considered the feature space that can distinguish the human intentions, and we considered the method of analyzing the user's intentions by using anatomical knowledge. Furthermore, we considered the application of our system.