A Common Platform for Analysis and Synthesis of Face to Realize a Kansei Communication

到目前为止，几个研究机构和大学已经尝试了人脸识别和人脸图像合成方案，他们才刚刚开始生产商业产品。然而，大多数的基本技术都是通过逐个案例的需求来实现的，它们没有与其他技术的公共接口和扩展功能。在此背景下，本课题试图实现构建一个具有广义分级功能的通用人脸图像处理软件系统。该软件系统的主要组成部分是一个通用的人脸处理库，它既可以处理人脸识别，也可以处理人脸合成。在人脸识别系统中，包括人脸和人脸部分的提取和参数化，视频序列中人脸的跟踪，身份识别和表情识别的基本工具。并编制了应用程序接口，使系统具有通用性。在人脸图像合成系统中，构建了3D模型和人脸表情规则，生成了自然真实的人脸图像和动画。人脸识别系统根据特征点提取结果，对通用人脸模型进行修改，使其自动匹配到人脸正面图中，从而实现人脸模型的定制。我们研究的一个新点是将多个研究机构独立开发的各种算法组合在一起，对系统进行泛化。第二点是动画面部表情质量的重大改善。作为一种交互技术，还考虑了通过窄带网络对情感状态和交流的处理，并提出了实现网页交流的通用标记语言作为新的结果。通过心理分析，准确处理了人脸表情动画在时间尺度上的变化规律。

Until now, several research institutes and university have tried a face recognition and face image synthesis schemes and they just have come to produce a commercial product. However, most of the elemental technologies are realized about case by case requirement and they don't have a common interface with other technologies and extension function. In this background, our project tried to realize to construct a common software system about face image processing with generalized hierarchical function. The major element of this software system is composed of a common face processing library which can treat both face recognition and face synthesis. In the face recognition system, an extraction and parameterization of face and face parts, tracking of face in video sequence, basic tool for person identification and expression recognition are included. And also API is produced to make generalization of system. In the face image synthesis system, 3D model and facial expression rule to generate a natural and real face image and animation are constructed. A generic face model is modified to be fitted automatically to face frontal picture based on feature points extraction result by face recognition system to make customization of face model. One new point of our research is a combination of each algorithm produced independently by several research institutes to make generalization of system. A major improvement of animation quality of facial expression is second point. As an interaction technology, a treatment of emotion condition and communication through narrow band network is also considered, and common markup language to realize a communication on WEB page is also proposed as a new result. By psychological analysis, facial expression animation rule on time scale is exactly treated.