Similar Representations of Emotions Across Faces and Voices
Similar Representations of Emotions Across Faces and Voices
复制标题
DOI：
10.1037/emo0000282
复制
发表时间：
2017-09-01
期刊：
影响因子：
4.2
通讯作者：
Garrido, Lucia
中科院分区：
文献类型：
--
作者：
Kuhn, Lisa Katharina;Wydell, Taeko;Garrido, Lucia
情绪是社会沟通的重要组成部分，通过一系列形式和不同的感知信号进行，例如面部和上呼吸系统的特定肌肉收缩。先前的研究发现，脑损伤后的情感识别障碍取决于呈现的方式：面部识别可能受损，而声音识别仍然保留，反之亦然。另一方面，也有证据表明，在这两种方式的情绪处理过程中，共享的神经激活。在一项行为研究中，我们调查了在从面孔和声音中识别情绪时是否存在共享表征。我们使用了一个受试者内的设计，在这个设计中，参与者对6个基本情绪标签中的每一个的面部表情和非语言发声的强度进行评级。对于每个参与者和每种模态，我们然后计算了一个表示矩阵与每种情绪的强度评级。这些矩阵使我们能够检查情绪之间的混淆模式，并描述每种模态中情绪的表征。然后，我们通过计算人脸和声音之间的表征矩阵的相关性来比较不同模态的表征。我们发现了各种模式之间高度相关的矩阵，这表明面部和声音之间的情绪表现相似。我们还表明，这些结果不能解释的共同点之间的低层次的视觉和声学特性的刺激。因此，我们建议，有类似的或共享的编码机制的情绪，可能独立于模态，尽管他们不同的感知输入。
Emotions are a vital component of social communication, carried across a range of modalities and via different perceptual signals such as specific muscle contractions in the face and in the upper respiratory system. Previous studies have found that emotion recognition impairments after brain damage depend on the modality of presentation: recognition from faces may be impaired whereas recognition from voices remains preserved, and vice versa. On the other hand, there is also evidence for shared neural activation during emotion processing in both modalities. In a behavioral study, we investigated whether there are shared representations in the recognition of emotions from faces and voices. We used a within-subjects design in which participants rated the intensity of facial expressions and nonverbal vocalizations for each of the 6 basic emotion labels. For each participant and each modality, we then computed a representation matrix with the intensity ratings of each emotion. These matrices allowed us to examine the patterns of confusions between emotions and to characterize the representations of emotions within each modality. We then compared the representations across modalities by computing the correlations of the representation matrices across faces and voices. We found highly correlated matrices across modalities, which suggest similar representations of emotions across faces and voices. We also showed that these results could not be explained by commonalities between low-level visual and acoustic properties of the stimuli. We thus propose that there are similar or shared coding mechanisms for emotions which may act independently of modality, despite their distinct perceptual inputs.