SGER: Analyzing Facial Expression in Three Dimensional Space

------拟进行的研究将在完整的3D空间中进行面部表情表征、检测、跟踪和分类的试点研究。为了证明3D面部表情识别的概念，本研究将探讨3D面部特征如何以及哪些特征可以使3D面部表情识别优于2d面部识别。对三维面部表情的分析将有助于研究自然表情固有的精细结构变化和精确的时间过程。虽然三维建模技术已广泛应用于三维人脸识别和三维人脸动画，但对三维面部表情识别的研究却很少。这类研究尚未开展的一个主要原因是目前还没有3D表达数据库。作为概念验证，将建立一个最先进的3D动态面部表情数据库来测试算法，并向研究界公开，以促进该领域的研究。该项目旨在在识别广泛的面部表情方面实现高准确率，最终目标是在详细层面上增加对面部行为和面部表情3D结构的一般理解。因此，这项探索性研究将导致构建一个人性化的面部表情识别系统，这对下一代人机交互、安全、人类情感识别、生物医学、执法和心理学研究至关重要。该项目将通过自动3D面部表情识别促进下一代人机交互的研究。这将有助于增加对人类视觉系统认知过程的科学理解和建模。由此产生的系统和3D面部表情数据库将在安全、执法、生物医学、行为科学、娱乐和教育等领域的应用中具有价值。3D面部表情数据库将向整个研究界开放。作为一所学术机构，宾厄姆顿州立大学拥有庞大而多样化的学生和教职员工。这将有助于为数据库扫描许多不同种族背景的人。这项研究的结果可以整合到纽约州立大学宾厄姆顿分校与图像处理、计算机视觉和计算机图形学相关的研究生和本科生课程中。

------The proposed study will conduct a pilot research on facial expression representation, detection, tracking and classification in a complete 3D space. To prove the concept of 3D face expression recognition, the study will investigate the issue on how and what 3D facial features could make the 3D-based expression recognition better than 2D-based recognition. The analysis of 3D facial expressions will facilitate the examination of both the fine structural changes inherent in and the precise time course of spontaneous expressions. Although 3D modeling techniques have been extensively used for 3D face recognition and 3D face animation, barely any research on 3D facial expression recognition has been reported. A primary reason why such research has not yet been undertaken is that no 3D expression database exists. As a proof-of-concept, a state-of-the-art 3D dynamic facial expression database will be constructed to test the algorithms and make it public to the research community to foster the research in the field. The project aims to achieve a high rate of accuracy in identifying a wide range of facial expressions, with the ultimate goal of increasing the general understanding of facial behavior and 3D structure of facial expressions on a detailed level. As a result, this exploratory research will lead to building a humanized system for recognizing spontaneous facial expression, which is crucial to the next generation of human computer interaction, security, human affect recognition, biomedicine, law-enforcement and psychology research.This project will facilitate research on the next generation of human-computer interaction through automatic 3D facial expression recognition. It will help increase the scientific understanding and modeling of cognitive processes of the human visual system. The resulting system and the 3D facial expression database will be valuable for applications in security, law-enforcement, biomedicine, behavior science, entertainment and education. The 3D face expression database will be made available to the entire research community. As an academic institution, SUNY Binghamton has a large and diverse student and staff population. This will facilitate scanning many people of diverse ethnic backgrounds for the database. The results of this research can be integrated into graduate and undergraduate courses at SUNY Binghamton related to image processing, computer vision, and computer graphics.