Dynamic Neural Mechanisms of Audiovisual Speech Perception

视听言语感知的动态神经机制

• 批准号: 10676997
• 负责人: Michael S Beauchamp
• 金额: $ 107.4万
• 依托单位: UNIVERSITY OF PENNSYLVANIA
• 依托单位国家: 美国
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-09-15 至 2025-05-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10676997
• 关键词: Acoustics; Action Potentials; Anatomy; Articulation; Auditory; Brain; Code; Comprehensive Cancer Center; Computer software; Coupling; Data; Electrodes; Face; Film; Frequencies; Heart; Human; Knowledge; Measures; Medicine; Modality; Modeling; Movement; Nature; Neurons; Noise; Patients; Periodicity; Persons; Phase; Phonetics; Population; Resolution; Role; Speech; Speech Perception; Superior temporal gyrus; Surface; Techniques; Testing; Time; Universities; Visual; Voice; audiovisual speech; cognitive ability; college; encephalography; experimental study; innovation; multidisciplinary; multisensory; neural; neuromechanism; operation; programs; response; skills; spatiotemporal; statistics; visual information; visual speech

Project Summary/Abstract Speech perception is inherently multisensory: when conversing with someone that we can see, our brains combine auditory information from the voice with visual information from the face. Speech perception lies at the heart of our interactions with other people and is thus one of our most important cognitive abilities. However, there is a large gap in our knowledge about this uniquely human skill because most experimental techniques available in humans suffer from poor spatiotemporal resolution. In order to remedy this gap, we will examine the neural mechanisms of audiovisual speech perception using intracranial recording (iEEG) in humans. Audiovisual speech perception occurs in the posterior superior temporal gyrus and sulcus (pSTG) Understanding the dynamics of the neural computations within pSTG at the mesoscale (neurons organized into columns and patches) has been impossible in humans. We propose to leverage two technical innovations within the fast-changing field of iEEG to study them for the first time: first, high-resolution intracranial electrode grids, which allow for recording from a cortical volume hundreds of times smaller than the electrodes in standard iEEG grids; second, NeuroGrids that record single-neuron activity from a non-penetrating film of electrodes placed on the cortical surface. Our causal inference model requires the existence of distinct auditory, visual and audiovisual speech representations. Aim 1 will search for these representations in pSTG. Aim 2 will examine low-frequency oscillations in pSTG to determine their role in multisensory speech perception. If successful, the Aims will provide a comprehensive account of the neural mechanisms of multisensory speech perception, including the long-standing mystery of the perceptual benefit of visual speech.

项目总结/文摘