SGER: Analyzing Facial Expression in Three Dimensional Space

SGER：分析三维空间中的面部表情

• 批准号: 0541044
• 负责人: Lijun Yin
• 金额: --
• 依托单位: SUNY at Binghamton
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-08-01 至 2007-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0541044&HistoricalAwards=false
• 关键词: SGER; Analyzing; Facial; Expression; Three

------The proposed study will conduct a pilot research on facial expression representation, detection, tracking and classification in a complete 3D space. To prove the concept of 3D face expression recognition, the study will investigate the issue on how and what 3D facial features could make the 3D-based expression recognition better than 2D-based recognition. The analysis of 3D facial expressions will facilitate the examination of both the fine structural changes inherent in and the precise time course of spontaneous expressions. Although 3D modeling techniques have been extensively used for 3D face recognition and 3D face animation, barely any research on 3D facial expression recognition has been reported. A primary reason why such research has not yet been undertaken is that no 3D expression database exists. As a proof-of-concept, a state-of-the-art 3D dynamic facial expression database will be constructed to test the algorithms and make it public to the research community to foster the research in the field. The project aims to achieve a high rate of accuracy in identifying a wide range of facial expressions, with the ultimate goal of increasing the general understanding of facial behavior and 3D structure of facial expressions on a detailed level. As a result, this exploratory research will lead to building a humanized system for recognizing spontaneous facial expression, which is crucial to the next generation of human computer interaction, security, human affect recognition, biomedicine, law-enforcement and psychology research.This project will facilitate research on the next generation of human-computer interaction through automatic 3D facial expression recognition. It will help increase the scientific understanding and modeling of cognitive processes of the human visual system. The resulting system and the 3D facial expression database will be valuable for applications in security, law-enforcement, biomedicine, behavior science, entertainment and education. The 3D face expression database will be made available to the entire research community. As an academic institution, SUNY Binghamton has a large and diverse student and staff population. This will facilitate scanning many people of diverse ethnic backgrounds for the database. The results of this research can be integrated into graduate and undergraduate courses at SUNY Binghamton related to image processing, computer vision, and computer graphics.

--本研究将在完整的三维空间中对人脸表情表示、检测、跟踪和分类进行初步研究。为了证明三维人脸表情识别的概念，本研究将探讨如何以及什么样的三维人脸特征可以使基于三维的表情识别优于基于二维的识别。3D面部表情的分析将有助于检查自发表情固有的精细结构变化和精确的时间过程。虽然3D建模技术已被广泛用于3D人脸识别和3D人脸动画，几乎没有任何研究的3D人脸表情识别的报告。尚未进行此类研究的主要原因是不存在3D表达数据库。作为概念验证，将构建一个最先进的3D动态面部表情数据库来测试算法，并向研究界公开，以促进该领域的研究。该项目旨在实现识别各种面部表情的高准确率，最终目标是在细节层面上增加对面部行为和面部表情3D结构的一般理解。因此，本研究将有助于建立一个人性化的自发面部表情识别系统，这对下一代人机交互、安全、人类情感识别、生物医学、执法和心理学研究至关重要。本项目将通过自动3D面部表情识别促进下一代人机交互的研究。这将有助于提高对人类视觉系统认知过程的科学理解和建模。所得到的系统和3D面部表情数据库将在安全、执法、生物医学、行为科学、娱乐和教育等方面具有应用价值。3D面部表情数据库将提供给整个研究界。作为一所学术机构，SUNY Binghamton拥有庞大而多样化的学生和员工群体。这将有助于为数据库扫描许多不同种族背景的人。这项研究的结果可以整合到研究生和本科课程在纽约州立大学宾厄姆顿分校有关图像处理，计算机视觉和计算机图形学。