Collaborative Proposal: Automated Measurements of Infant Facial Expressions and Human Ratings of Their Emotional Intensity

合作提案：婴儿面部表情的自动测量和情绪强度的人类评级

• 批准号: 0418001
• 负责人: Jeffrey Cohn
• 金额: $ 5万
• 依托单位: University of Pittsburgh
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2004
• 资助国家: 美国
• 起止时间: 2004-09-15 至 2005-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0418001&HistoricalAwards=false
• 关键词: Collaborative; Proposal; Automated; Measurements; Infant

Infant smiles can predict later adaptive functioning, but little is known about the temporal course of infant smiles or their perceived emotional intensity. This collaborative project combines computer-based measurements of infant smiles with parents' ratings of those smiles. The project goals are to understand how infants smile, and to document the features that make infant smiles appear more or less joyful. To understand how infants smile, the smile strength and co-occurring mouth opening of 50 six-month-old infants' smiles will be measured using computer software (CMU/Pitt Automated Facial Image Analysis, v. IV). These objective measurements will be used to document how infant smile form, peak, and dissolve in time. That is, we will create real-time portraits of smiles to more fully understand positive emotional functioning. Statistical associations between smile strength and mouth opening will be examined, as will differences - both between smiles and between infants - in how strongly these components of smiles are associated. Complementary graphical and statistical approaches will encourage dynamic accounts of emotional functioning and new avenues of research on the role of emotion in learning and development. The project uses rating studies to document features that make infant smiles appear more or less joyful. Both parents of infants and undergraduates will be asked to rate the emotional intensity of both still images and video clips of smiles. Automated measurements of smile strength and mouth opening will then be used to predict ratings of positive emotional intensity. Positive findings would validate automated measurements of specific features of infant smiles as indices of infant joyful emotional intensity. In this project, leading infant emotion researchers will collaborate with a cutting-edge automated facial measurement team to investigate infants' smiles. Infants use positive facial expressions to express emotions and communicate with others. Basic knowledge of the temporal course of in vivo infant emotional expressions promises an objective view of normative and compromised emotional functioning and development. To that end, the acquired database of digitized facial expressions and their automated measurements will be made available to requesting investigators. These objective descriptions will be complemented by parental and naive observers' perceptions of the emotional intensity of these expressions. This will validate the emotional significance of the automated measurements, and contribute to the development of a tool for automated coding that has the potential for broad impact.

婴儿微笑可以预测以后的适应能力，但关于婴儿微笑的时间进程或他们感知的情绪强度，我们知之甚少。这个合作项目结合了基于计算机的婴儿微笑测量和父母对这些微笑的评分。该项目的目标是了解婴儿是如何微笑的，并记录让婴儿微笑或多或少显得快乐的特征。为了了解婴儿是如何微笑的，将使用计算机软件(CMU/PITT自动面部图像分析，V.IV)测量50名6个月大婴儿的微笑强度和同时出现的张嘴情况。这些客观测量将被用来记录婴儿微笑的形成、高峰和消失的时间。也就是说，我们将创建微笑的实时肖像，以更充分地了解积极的情绪功能。我们将研究微笑强度和张嘴之间的统计关系，以及微笑和婴儿之间的差异--微笑的这些组成部分之间的关联有多强。相辅相成的图表和统计方法将鼓励对情绪功能的动态描述，并鼓励研究情绪在学习和发展中的作用的新途径。该项目使用评级研究来记录让婴儿微笑看起来或多或少快乐的特征。婴儿和本科生的父母都将被要求对静止图像和微笑视频片段的情绪强度进行评分。然后，微笑强度和张嘴程度的自动测量将被用来预测积极情绪强度的评级。积极的发现将验证对婴儿微笑特定特征的自动测量作为婴儿快乐情绪强度的指数。在这个项目中，领先的婴儿情绪研究人员将与一个尖端的自动面部测量团队合作，调查婴儿的微笑。婴儿使用积极的面部表情来表达情感和与他人交流。对活体婴儿情绪表达的时间过程的基本知识保证了对正常和妥协的情绪功能和发展的客观看法。为此目的，将向提出请求的调查人员提供获取的数字化面部表情及其自动测量数据库。这些客观的描述将得到父母和天真的观察者对这些表达的情感强度的看法的补充。这将验证自动化测量的情感意义，并有助于开发具有广泛影响的自动化编码工具。