权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Multisensory Processing of Human Speech Measured with msec and mm Resolution

以毫秒和毫米分辨率测量的人类语音的多感官处理

基本信息

批准号：
10417100
负责人：
Sameer Anil Sheth
金额：
--
依托单位：
MICHAEL E DEBAKEY VA MEDICAL CENTER
依托单位国家：
美国
项目类别：
财政年份：
2015
资助国家：
美国
起止时间：
2015-04-01 至 2023-12-31
项目状态：
已结题

来源：
https://reporter.nih.gov/project-details/10417100
关键词：
Acquired Deafness Anatomic Models Anatomy Area Auditory Auditory area Basic Science Bayesian Analysis Behavior Brain Clinical Code Color Communication Complex Custom Data Data Analyses Data Collection Electrocorticogram Electrodes English Language Ensure Epilepsy Event Face Functional disorder Goals Health Hearing Human Implanted Electrodes Knowledge Lateral Lead Linguistics Measures Mental Depression Modality Modeling Movement Neurosciences Occipital lobe Oral cavity Oranges Patients Process Progress Reports Publishing Quality of life Research Resolution Sensory Series Shapes Social isolation Source Speech Speech Perception Statistical Models Stroke Techniques Temporal Lobe Testing Time Translating Veterans Visual Visual Cortex Visualization software Voice Work audiovisual speech base brain behavior cognitive task design disability experimental study hearing impairment improved language impairment mathematical model millimeter millisecond multisensory neuromechanism predictive modeling relating to nervous system response social relationships software development sound speech processing therapy design tool visual information visual speech

项目摘要

Face-to-face communication is the most important form of human interaction. When conversing we receive auditory information from the talker's voice and visual information from the talker's face. Combining these two sources of information is difficult, as they arrive quickly (about 5 syllables per second) and the correspondence between the vocal sounds and the mouth movements made by the talker is complex. We propose to study the neural mechanisms that underlie multisensory (auditory and visual) speech perception using electrocorticography (ECoG), a neural recording technique in which electrodes are implanted in the brain of epileptic patients. ECoG is the ideal technique for our research question because it measures human brain activity with very high temporal and spatial resolution (millisecond/millimeter). ECoG can be used to examine the diverse network of brain areas active during speech perception. Electrodes in auditory cortex are strongly activated by the auditory component of speech, while electrodes in occipital lobe are strongly activated by the visual component of speech. Between auditory and visual cortex, posterior lateral temporal cortex is thought to integrate auditory and visual speech. Poor hearing is one of the most common disabilities in veterans. Since speech is the basis of our social relationships, poor speech perception can lead to social isolation, depression and other health problems. A better understanding of the neural mechanisms underlying multisensory speech perception will allow us to improve veterans' ability to understand speech, leading to major improvements in their quality of life. To ensure that our results are immediately applicable to real world situations, we will study brain responses to natural English language words spoken by English talkers. In addition to its potential clinical benefits, the proposed research will also have a significant impact on basic science. Multisensory integration is a major new field in neuroscience and has proven to be fertile ground for mathematical models of brain and behavior. Our work will serve as a bridge between experiments and models of simple multisensory behavior, such as auditory-visual localization and more complex cognitive tasks, exemplified by multisensory speech perception. The successful completion of these studies will represent a major step forward in our understanding of the neural substrates of multisensory speech perception.

面对面的交流是人际交往中最重要的形式。交谈时，我们接受