Effects of Speaker Emotional Facial Expression and Listener Age on Incremental Sentence Processing
Effects of Speaker Emotional Facial Expression and Listener Age on Incremental Sentence Processing
复制标题
DOI：
10.1371/journal.pone.0072559
复制
发表时间：
2013-09-06
期刊：
影响因子：
3.7
通讯作者：
Knoeferle, Pia
中科院分区：
文献类型：
--
作者：
Carminati, Maria Nella;Knoeferle, Pia
我们报告了两个视觉世界的眼动追踪实验，研究如何以及与哪些时间过程中的情绪信息从扬声器的脸影响年轻（N = 32，平均年龄= 23）和老年人（N = 32，平均年龄= 64）的听众的视觉注意力和语言理解，因为他们处理情绪的句子在视觉环境中。年龄操纵测试预测的社会情绪选择性理论的积极影响，在老年人。在计算机显示器上观看演讲者的情绪面部（快乐或悲伤）后，参与者同时呈现两张描绘相反效价事件（积极和消极; IAPS数据库）的图片，同时他们听一句话，指的是其中一个事件。当说话者的脸与句子的情感一致（或不一致）时，参与者在处理句子时对图片的注视会增加。这种增强发生在指称消歧的早期阶段，并受年龄的影响。对于老年人来说，积极的面孔更明显，而对于年轻人来说，消极的面孔更明显。这些发现第一次表明，情绪面部表情，类似于以前研究的扬声器线索，如眼睛凝视和手势，迅速融入句子处理。他们还提供了新的证据，积极的影响，在老年人的句子处理。
We report two visual-world eye-tracking experiments that investigated how and with which time course emotional information from a speaker's face affects younger (N = 32, Mean age = 23) and older (N = 32, Mean age = 64) listeners' visual attention and language comprehension as they processed emotional sentences in a visual context. The age manipulation tested predictions by socio-emotional selectivity theory of a positivity effect in older adults. After viewing the emotional face of a speaker (happy or sad) on a computer display, participants were presented simultaneously with two pictures depicting opposite-valence events (positive and negative; IAPS database) while they listened to a sentence referring to one of the events. Participants' eye fixations on the pictures while processing the sentence were increased when the speaker's face was (vs. wasn't) emotionally congruent with the sentence. The enhancement occurred from the early stages of referential disambiguation and was modulated by age. For the older adults it was more pronounced with positive faces, and for the younger ones with negative faces. These findings demonstrate for the first time that emotional facial expressions, similarly to previously-studied speaker cues such as eye gaze and gestures, are rapidly integrated into sentence processing. They also provide new evidence for positivity effects in older adults during situated sentence processing.