Visual Speech Perception and Neural Processing

视觉语音感知和神经处理

• 批准号: 8063350
• 负责人: LYNNE Esther Bernstein
• 金额: $ 24.91万
• 依托单位: GEORGE WASHINGTON UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-07-15 至 2011-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8063350
• 关键词: 3-Dimensional; Adult; Aging; Area; Auditory; Brain; Child; Clinical; Cochlear Implants; Communication; Computers; Data; Discrimination; Distant; Event-Related Potentials; Face; Frequencies; Hearing; Hearing Aids; Hearing Impaired Persons; Individual; Knowledge; Language; Lead; Learning; Lipreading; Location; Masks; Measures; Memory; Methods; Modeling; Motion; Neighborhoods; Noise; Optics; Patients; Perception; Phonetics; Procedures; Process; Public Health; Recruitment Activity; Research; Sensory; Sensory Aids; Signal Transduction; Source; Speech; Speech Perception; Speech Synthesizers; Speed; Stimulus; Structure; Sudden Hearing Loss; System; Techniques; Testing; Time; Training; Video Recording; Visual; Visuospatial; base; deafness; density; design; hearing impairment; improved; long term memory; neural circuit; neuromechanism; reconstruction; relating to nervous system; research study; speech processing; tool; visual process; visual processing

DESCRIPTION (provided by applicant): Perception of visible speech (lipreading/speechreading) can be sufficient for acquiring a first language and carrying out everyday communication. Under noisy conditions, individuals with hearing loss may need to rely on lipreading, even if they have sensory aids (hearing aids, cochlear implants). Lipreading demonstrates plasticity in individuals with prelingual profound hearing impairments (deaf), such that accuracy in deaf adults frequently far exceeds accuracy in normal-hearing adults. The long-term research aim of this proposed project is to explain, in terms of sensory and perceptual processes and underlying neural mechanisms, lipreading in deaf experts, in individuals with normal hearing, and in individuals with idiopathic sudden profound hearing loss. The long-term clinical aim is to develop effective tools for lipreading training and assessment. In Study 1, it is hypothesized that expert deaf adult lipreaders are more capable at the level of lower-sensory constraints related to visual spatial frequency processing than are normal-hearing adults. The study applies a method for estimating visual critical spatial frequency bands using contrast thresholds. In Study 2, it is hypothesized that faster and more sensitive perceptual processing of the visual phonetic stimulus is a major component of the expert lipreader's advantage. A speeded discrimination method will be used to study perceptual sensitivity and longterm memory structure for visual phonetic speech. In Study 3, the same hypothesis will be tested, but the stimuli will be generated with a new visual speech synthesizer. In Study 4, the hypothesis is that expert lipreading is associated with phonetic exogenous and possibly neuroplastic cortical effects. Electrophysiological event related potentials (ERPs) will be obtained during a target discrimination task. Prelingually deaf adults who are expert lipreaders will be compared with normal- hearing adults to isolate sources of the expert's lipreading advantage. Patients with sudden hearing loss will be recruited to study perceptual and neuroplastic effects that may occur rapidly following an abrupt change in input stimulation. Relevance to public health: Experiments are designed to lead to more effective lipreading assessment and training, which would be relevant to a wide range of conditions involving hearing loss and degraded perception under noisy conditions. Applications of the visual speech synthesizer include computer-based training systems for speech perception in children with hearing impairments. Knowledge about learning and plasticity in adults is important, as hearing loss is a frequent occurrence associated with aging.

描述（由申请人提供）：可见语音的感知（唇读/语音阅读）足以获得第一语言和进行日常交流。在嘈杂的条件下，听力损失的人可能需要依靠唇读，即使他们有感官辅助设备（助听器，人工耳蜗）。唇读在语前深度听力障碍（聋人）的个体中表现出可塑性，因此聋人的准确性经常远远超过听力正常的成年人。这个项目的长期研究目标是从感觉和知觉过程以及潜在的神经机制方面解释聋人专家、听力正常者和特发性突发性极重度听力损失者的唇读。长期的临床目标是开发有效的唇读训练和评估工具。在研究1中，它是假设，专家失聪成人唇读更有能力在较低的视觉空间频率处理相关的感官限制的水平比听力正常的成年人。该研究应用了一种使用对比度阈值估计视觉临界空间频带的方法。在研究2中，假设更快和更敏感的视觉语音刺激的知觉处理是专家唇读优势的主要组成部分。采用快速判别法研究视觉语音的知觉敏感性和长时记忆结构。在研究3中，将测试相同的假设，但刺激将产生一个新的视觉语音合成器。在研究4中，假设专家唇读与语音外源性和可能的神经可塑性皮质效应有关。将在目标辨别任务期间获得电生理事件相关电位（ERP）。语言前聋的成年人谁是专家唇读将与正常听力的成年人进行比较，以隔离的来源，专家的唇读优势。将招募突发性听力损失患者，以研究输入刺激突然变化后可能迅速发生的感知和神经可塑性影响。与公共卫生的相关性：实验的目的是导致更有效的唇读评估和培训，这将是相关的广泛的条件下，涉及听力损失和噪声条件下的感知退化。视觉语音合成器的应用包括基于计算机的听力障碍儿童语音感知训练系统。关于成人学习和可塑性的知识很重要，因为听力损失是与衰老相关的常见事件。