Neuro-cognitive studies of vocal emotion processing in speech

言语中声音情感处理的神经认知研究

• 批准号: RGPIN-2016-04373
• 负责人: Pell, Marc
• 金额: $ 2.55万
• 依托单位: McGill University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2019
• 资助国家: 加拿大
• 起止时间: 2019-01-01 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=685687
• 关键词: Neuro; cognitive; studies; vocal; emotion

This research program investigates how humans use their voice to communicate emotion and social intentions in the context of spoken language, as part of a growing effort to advance knowledge of the cognitive and affective processes that underlie human social behaviour. In the past decade, we have made significant gains in our understanding of the neuro-cognitive mechanisms involved in processing vocal expressions of basic' emotion (e.g., anger or joy). Increasingly, this work is being extended to look at how the brain responds to more socially-complex meanings encoded by the human voice in conjunction with the linguistic message (e.g.,sarcasm). Here, we plan new experiments that logically extend our long-standing work on the neuro-cognition of vocal emotion processing (THEME 1), while expanding our focus to novel studies that consider the social functions of vocal behaviour in relation to the adult human brain (THEMES 2 & 3). *** In THEME 1, we address a gap in the literature on emotions by comparing the cognitive underpinnings and time course for processing emotions embedded in speech (emotional prosody) versus non-linguistic expressions of emotion (laughs, screams). While vocal emotions expressed non-linguistically and in speech share core acoustic-perceptual features, these signals appear to engage different neural regions and have distinct on-line effects on the processing system. We will test these ideas further to clarify how the type of vocal expression (speech vs. non-linguistic) and type of emotion affect ongoing neural responses to the stimuli in reference to event-related brain potentials (ERPs).*** In THEME 2, we ask the question: how does the listener encode socially relevant vocal meanings that refer to a speaker's mental state, such as their confidence level (feeling of knowing)? And how are vocal speech cues processed to evaluate speaker believability? Our experiments will address these questions using ERPs and functional magnetic resonance imaging, for example, by investigating how utterances produced in a confident/unconfident manner are processed by listeners when the speaker has a native vs. foreign accent, or when they can access general knowledge concurrent with vocal cues.*** In THEME 3, we examine another important social dimension of the voice: how speakers use these cues to mark their interpersonal stance or orientation toward the listener. In a set of acoustic-perceptual and ERP studies, we will examine the contexts of politeness, jocularity (mock impoliteness), and vocal cues that communicate sexual innuendo.*** Our plan represents an original and feasible extension of previous work, and all necessary resources to ensure success are accessible to the research team. Our work will inform theories and new research at the interface of cognitive neuroscience and social psychology, and foster research that incorporates voice into descriptions of how humans socially interact.**

这个研究项目调查了人类如何在口语的背景下使用他们的声音来交流情感和社会意图，作为人类社会行为基础的认知和情感过程知识的一部分。在过去的十年里，我们对处理基本情绪（如愤怒或喜悦）的声音表达的神经认知机制的理解取得了重大进展。越来越多地，这项工作被扩展到观察大脑如何对人类声音与语言信息（例如，讽刺）编码的更复杂的社会意义做出反应。在这里，我们计划新的实验，从逻辑上扩展我们长期以来在声音情绪处理的神经认知方面的工作（主题1），同时将我们的重点扩展到考虑与成人大脑相关的声音行为的社会功能的新研究（主题2和3）。我们通过比较言语（情感韵律）和非语言表达（笑、尖叫）中嵌入的情感处理的认知基础和时间过程，解决了情感文献中的空白。虽然非语言和语音表达的声音情绪具有核心的声学感知特征，但这些信号似乎涉及不同的神经区域，并对处理系统具有不同的在线效应。我们将进一步测试这些想法，以阐明声音表达类型（语音与非语言）和情绪类型如何影响事件相关脑电位（ERPs）对刺激的持续神经反应。***在主题2中，我们提出了这样一个问题：听众如何编码与说话者的精神状态相关的社交声音含义，比如他们的信心水平（了解的感觉）？如何处理语音线索来评估说话人的可信度？我们的实验将使用erp和功能性磁共振成像来解决这些问题，例如，通过调查听者如何处理以自信/不自信的方式发出的话语，当说话者有本国口音和外国口音时，或者当他们可以在获得声音线索的同时获得一般知识时。在主题3中，我们研究了声音的另一个重要的社会维度：说话者如何使用这些线索来标记他们对听者的人际关系立场或方向。在一组声学感知和ERP研究中，我们将研究礼貌、幽默（模仿不礼貌）和表达性暗示的声音线索的语境。***我们的计划是对以前工作的原创和可行的扩展，研究团队可以获得所有必要的资源来确保成功。我们的工作将为认知神经科学和社会心理学的理论和新研究提供信息，并促进将声音纳入人类社会互动方式描述的研究