Automated Measurement of Facial Expression in Infant-Mother Interaction: A Pilot Study
Automated Measurement of Facial Expression in Infant-Mother Interaction: A Pilot Study
复制标题
DOI：
10.1080/15250000902839963
复制
发表时间：
2009-01-01
期刊：
影响因子：
2.6
通讯作者：
Cohn, Jeffrey F.
中科院分区：
文献类型：
--
作者：
Messinger, Daniel S.;Mahoor, Mohammad H.;Cohn, Jeffrey F.
使用计算机视觉的自动面部测量有可能客观地记录行为的持续变化。为了检查情绪表达和沟通，我们使用自动测量来量化两个 6 个月大的婴儿母亲二人组的微笑强度、眼睛收缩和张嘴程度，这对婴儿和母亲都进行了面对面的互动。自动测量显示与基于解剖学的手动编码高度相关（同时有效性）；微笑的测量结果显示，与天真的观察者对积极情绪的平均评分有很高的相关性（结构效度）。对于婴儿和母亲来说，微笑强度和眼睛收缩（杜氏标记）随着时间的推移而相关，从而创建了微笑强度的连续指数。婴儿和母亲的微笑活动表现出变化的（非固定的）局部关联模式，表明情感同步状态的二元修复和消解。该研究深入了解了面部动作自动测量的潜力和局限性。
Automated facial measurement using computer vision has the potential to objectively document continuous changes in behavior. To examine emotional expression and communication, we used automated measurements to quantify smile strength, eye constriction, and mouth opening in two 6-month-old infant-mother dyads who each engaged in a face-to-face interaction. Automated measurements showed high associations with anatomically based manual coding (concurrent validity); measurements of smiling showed high associations with mean ratings of positive emotion made by naive observers (construct validity). For both infants and mothers, smile strength and eye constriction (the Duchenne marker) were correlated over time, creating a continuous index of smile intensity. Infant and mother smile activity exhibited changing (nonstationary) local patterns of association, suggesting the dyadic repair and dissolution of states of affective synchrony. The study provides insights into the potential and limitations of automated measurement of facial action.