Multisensory emotions: perception, combination and underlying neural processes
Multisensory emotions: perception, combination and underlying neural processes
复制标题
DOI：
10.1515/revneuro-2012-0040
复制
发表时间：
2012-08-01
影响因子：
4.1
通讯作者：
Mathiak, Klaus
中科院分区：
文献类型：
--
作者：
Klasen, Martin;Chen, Yu-Han;Mathiak, Klaus
在日常生活中，我们通过多种感官渠道感知情感信息。这一点在社交环境中表现得尤为明显。在过去的几年里，大量的研究已经解决了听觉和视觉渠道传达的情感线索是如何整合的问题。行为研究表明，听觉和视觉情感表达可以相互支持和影响，这一观点得到了基础神经生物学研究的支持。许多电生理学和神经影像学研究已经确定了服务于多模态情绪整合的大脑区域，并为声音和面部情感信息协同融合的神经处理步骤提供了新的见解。在这篇文章中，我们提供了一个全面的综述，涵盖目前行为，电生理和功能神经影像学的发现，从听觉和视觉领域的结合情绪。多模态冗余产生的行为优势与神经层面的特定整合模式是平行的，从早期感觉皮层的编码到晚期高级关联区域的认知评估。综上所述，这些发现表明双峰情绪在视听整合过程的多个阶段相互作用。
In our everyday lives, we perceive emotional information via multiple sensory channels. This is particularly evident for emotional faces and voices in a social context. Over the past years, a multitude of studies have addressed the question of how affective cues conveyed by auditory and visual channels are integrated. Behavioral studies show that hearing and seeing emotional expressions can support and influence each other, a notion which is supported by investigations on the underlying neurobiology. Numerous electrophysiological and neuroimaging studies have identified brain regions subserving the integration of multimodal emotions and have provided new insights into the neural processing steps underlying the synergistic confluence of affective information from voice and face. In this paper we provide a comprehensive review covering current behavioral, electrophysiological and functional neuroimaging findings on the combination of emotions from the auditory and visual domains. Behavioral advantages arising from multimodal redundancy are paralleled by specific integration patterns on the neural level, from encoding in early sensory cortices to late cognitive evaluation in higher association areas. In summary, these findings indicate that bimodal emotions interact at multiple stages of the audiovisual integration process.