Neuro-cognitive studies of vocal emotion processing in speech

言语中声音情感处理的神经认知研究

• 批准号: 203708-2011
• 负责人: Pell, Marc
• 金额: $ 3.42万
• 依托单位: McGill University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2014
• 资助国家: 加拿大
• 起止时间: 2014-01-01 至 2015-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=546398
• 关键词: Neuro; cognitive; studies; vocal; emotion

The field of "social neuroscience" is developing rapidly, and there is a recent surge of interest in how humans communicate their emotions and respond to emotional stimuli. In this research program, we investigate a topic that has been somewhat neglected-how emotions are expressed and understood from the human voice while speaking, and how underlying mental functions are structured in the brain. To recognize vocal expressions of emotion (e.g., anger, joy), listeners must process acoustic fluctuations in speech, such as pitch, loudness, and rhythm, which differentiate over time in emotionally meaningful ways. The fact that emotional expressions in the voice are represented across time raises a critical empirical question: how quickly do we detect emotions when listening to a speaker's voice? And what neural structures are involved? Understanding the precise time course for recognizing emotional meanings in speech will be fundamental for describing the human capacity for acoustic communication and the basis of this system in the brain. Another important question that we will address is: when listeners recognize vocal expressions of emotion, does this information guide their visual attention and/or judgements of visual stimuli (e.g., facial expressions) in systematic ways? Answering this question will tell us much about natural social interactions, where humans must typically integrate emotional cues in more than one sensory modality in socially meaningful and adaptive ways. Our studies will involve young, healthy adults and our questions will be tested from different vantage points, using complementary methods at the forefront of cognitive neuroscience (behavioural approaches, eye-tracking, electrophysiology, and neuroimaging). Our research will lead to a more sophisticated model of the neuro-cognitive mechanisms that support emotional communication through the voice, and in broader terms, it will shed light on the uniquely human capacity to communicate both linguistic and emotional meanings using complex auditory signals. Our results will energize debate and spark new ideas that will significantly advance knowledge of how humans interact socially and communicate their emotions and intentions.

“社会神经科学”领域正在迅速发展，最近人们对人类如何交流情感和对情感刺激做出反应的兴趣激增。在这个研究项目中，我们调查了一个被忽视的话题--人类说话时如何从声音中表达和理解情感，以及大脑中潜在的心理功能是如何构建的。为了识别情感的语音表达（例如，愤怒、喜悦），听众必须处理语音中的声学波动，例如音高、响度和节奏，这些波动随着时间以情感上有意义的方式区分。声音中的情感表达是跨时间的，这一事实提出了一个关键的经验问题：当我们听到说话者的声音时，我们能多快地检测到情绪？涉及哪些神经结构？理解识别语音中情感意义的精确时间过程将是描述人类声学通信能力的基础，也是大脑中这一系统的基础。我们要解决的另一个重要问题是：当听众识别情感的声音表达时，这些信息是否指导他们的视觉注意力和/或对视觉刺激的判断（例如，面部表情）系统的方式？回答这个问题将告诉我们很多关于自然社会互动的信息，在这种互动中，人类通常必须以具有社会意义和适应性的方式将情感线索整合到一种以上的感官模态中。我们的研究将涉及年轻，健康的成年人，我们的问题将从不同的Vantage位置进行测试，使用认知神经科学前沿的补充方法（行为方法，眼动追踪，电生理学和神经成像）。我们的研究将导致一个更复杂的神经认知机制模型，支持通过声音进行情感交流，从更广泛的角度来看，它将揭示人类使用复杂的听觉信号进行语言和情感交流的独特能力。我们的研究结果将激发辩论，并激发新的想法，这将大大推进人类如何在社会上互动和交流他们的情感和意图的知识。