Audiovisual integration of identity information from the face and voice: behavioural fMRI and MEG studies.

来自面部和声音的身份信息的视听整合：行为功能磁共振成像和脑磁图研究。

• 批准号: BB/I022287/1
• 负责人: Pascal Belin
• 金额: $ 31.52万
• 依托单位: University of Glasgow
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2012
• 资助国家: 英国
• 起止时间: 2012 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=BB%2FI022287%2F1
• 关键词: Audiovisual; integration; identity; information; face

Often when we hear a voice we create an image of the speaker which turns out to be quite wrong when we see the face. This is because our brain combines information from the face and voice of persons to make better estimates of a person's characteristics and allow better, more efficient social interactions. But how the brain combines information on a person's identity from her face and voice is poorly understood. In this project we combine a range of state-of-the-art techniques (face and voice morphing, magnetic resonance imaging, magnetoencephalography) to investigate the brain mechanisms of audiovisual integration of identity information. Participants will be played video clips showing a person saying a simple syllable in which the face and voice contain similar or different identity information (e.g., Bob's voice with Sam's face), and be asked to categorise the person's identity (e.g., Bob vs. Sam). While they perform this task, participants' brain activity will be measured with very high, millisecond and millimetre precision. The results will allow us to understand how two sensory modalities - audition and vision - are integrated in our brain during a task important in our everyday social interactions. They will advance our understanding of how the brain recognizes persons from their face and voice, with important potential outcome for hearing impaired persons and impact on the growing technology for automated person recognition.

通常当我们听到一个声音时，我们会产生一个说话人的形象，而当我们看到该人的脸时，结果发现这是完全错误的。这是因为我们的大脑结合了来自人的面部和声音的信息，从而更好地估计一个人的特征，从而进行更好、更有效的社会互动。但人们对大脑如何从面部和声音中识别一个人的身份知之甚少。在这个项目中，我们结合了一系列最先进的技术（面部和声音变形，磁共振成像，脑磁图）来研究身份信息的视听整合的大脑机制。参与者将被播放一段视频片段，显示一个人说一个简单的音节，其中的面部和声音包含相似或不同的身份信息（例如，鲍勃的声音和萨姆的脸），并被要求对这个人的身份进行分类（例如，鲍勃和萨姆）。当他们执行这项任务时，参与者的大脑活动将被以非常高的毫秒和毫米精度测量。研究结果将让我们了解两种感觉模式——听觉和视觉——是如何在我们的大脑中整合在一起的，而这在我们日常的社会互动中是很重要的。它们将推进我们对大脑如何从面部和声音中识别人的理解，对听力受损的人有重要的潜在影响，并对不断发展的自动人物识别技术产生影响。

项目成果

Gender differences in the temporal voice areas.

时间语音领域的性别差异。

• DOI: 10.3389/fnins.2014.00228
• 发表时间: 2014
• 期刊: Frontiers in neuroscience
• 影响因子: 4.3
• 作者: Ahrens MM;Awwad Shiekh Hasan B;Giordano BL;Belin P
• 通讯作者: Belin P

The human voice areas: Spatial organization and inter-individual variability in temporal and extra-temporal cortices.

• DOI: 10.1016/j.neuroimage.2015.06.050
• 发表时间: 2015-10-01
• 期刊: NeuroImage
• 影响因子: 5.7
• 作者: Pernet CR;McAleer P;Latinus M;Gorgolewski KJ;Charest I;Bestelmeyer PE;Watson RH;Fleming D;Crabbe F;Valdes-Sosa M;Belin P
• 通讯作者: Belin P