Visual Speech Perception and Neural Processing

视觉语音感知和神经处理

• 批准号: 7468434
• 负责人: LYNNE Esther Bernstein
• 金额: $ 34.01万
• 依托单位: HOUSE RESEARCH INSTITUTE
• 依托单位国家: 美国
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-07-15 至 2011-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7468434
• 关键词: 3-Dimensional; Adult; Aging; Area; Auditory; Brain; Child; Clinical; Cochlear Implants; Communication; Computers; Condition; Data; Discrimination; Distant; Event-Related Potentials; Face; Frequencies; Hearing; Hearing Aids; Hearing Impaired Persons; Individual; Knowledge; Language; Lead; Learning; Lipreading; Location; Masks; Measures; Memory; Methods; Modeling; Motion; Neighborhoods; Noise; Optics; Patients; Perception; Phonetics; Procedures; Process; Public Health; Range; Recruitment Activity; Research; Sensory; Sensory Aids; Signal Transduction; Source; Speech; Speech Perception; Speech Synthesizers; Speed; Stimulus; Structure; Sudden Hearing Loss; System; Techniques; Testing; Time; Training; Video Recording; Visual; Visuospatial; base; deafness; density; design; hearing impairment; improved; long term memory; neural circuit; neuromechanism; reconstruction; relating to nervous system; research study; speech processing; tool; visual process; visual processing

DESCRIPTION (provided by applicant): Perception of visible speech (lipreading/speechreading) can be sufficient for acquiring a first language and carrying out everyday communication. Under noisy conditions, individuals with hearing loss may need to rely on lipreading, even if they have sensory aids (hearing aids, cochlear implants). Lipreading demonstrates plasticity in individuals with prelingual profound hearing impairments (deaf), such that accuracy in deaf adults frequently far exceeds accuracy in normal-hearing adults. The long-term research aim of this proposed project is to explain, in terms of sensory and perceptual processes and underlying neural mechanisms, lipreading in deaf experts, in individuals with normal hearing, and in individuals with idiopathic sudden profound hearing loss. The long-term clinical aim is to develop effective tools for lipreading training and assessment. In Study 1, it is hypothesized that expert deaf adult lipreaders are more capable at the level of lower-sensory constraints related to visual spatial frequency processing than are normal-hearing adults. The study applies a method for estimating visual critical spatial frequency bands using contrast thresholds. In Study 2, it is hypothesized that faster and more sensitive perceptual processing of the visual phonetic stimulus is a major component of the expert lipreader's advantage. A speeded discrimination method will be used to study perceptual sensitivity and longterm memory structure for visual phonetic speech. In Study 3, the same hypothesis will be tested, but the stimuli will be generated with a new visual speech synthesizer. In Study 4, the hypothesis is that expert lipreading is associated with phonetic exogenous and possibly neuroplastic cortical effects. Electrophysiological event related potentials (ERPs) will be obtained during a target discrimination task. Prelingually deaf adults who are expert lipreaders will be compared with normal- hearing adults to isolate sources of the expert's lipreading advantage. Patients with sudden hearing loss will be recruited to study perceptual and neuroplastic effects that may occur rapidly following an abrupt change in input stimulation. Relevance to public health: Experiments are designed to lead to more effective lipreading assessment and training, which would be relevant to a wide range of conditions involving hearing loss and degraded perception under noisy conditions. Applications of the visual speech synthesizer include computer-based training systems for speech perception in children with hearing impairments. Knowledge about learning and plasticity in adults is important, as hearing loss is a frequent occurrence associated with aging.

描述（由申请人提供）：对可见语音（唇读/语音阅读）的感知足以习得第一语言并进行日常交流。在嘈杂的环境下，听力损失的人可能需要依靠唇读，即使他们有感官辅助设备（助听器、人工耳蜗）。唇读显示了语前严重听力障碍（聋人）个体的可塑性，因此聋人成年人的准确性常常远远超过听力正常成年人的准确性。该项目的长期研究目标是从感觉和知觉过程以及潜在的神经机制方面解释聋哑专家、听力正常的个体以及特发性突发性重度听力损失个体的唇读。长期临床目标是开发有效的唇读训练和评估工具。在研究 1 中，假设聋哑成人唇读专家在与视觉空间频率处理相关的较低感官限制水平上比听力正常的成年人更有能力。该研究应用了一种使用对比度阈值来估计视觉关键空间频带的方法。在研究 2 中，假设对视觉语音刺激的更快、更灵敏的感知处理是唇读专家优势的主要组成部分。快速辨别方法将用于研究视觉语音语音的感知敏感性和长期记忆结构。在研究 3 中，将测试相同的假设，但将使用新的视觉语音合成器生成刺激。在研究 4 中，假设专家唇读与语音外源性和可能的​​神经塑性皮质效应有关。将在目标辨别任务期间获得电生理事件相关电位（ERP）。语前聋哑成人的唇读专家将与听力正常的成人进行比较，以找出专家唇读优势的来源。将招募突发性听力损失患者来研究输入刺激突然变化后可能迅速发生的知觉和神经塑性效应。与公共卫生的相关性：实验旨在进行更有效的唇读评估和培训，这与涉及听力损失和噪音条件下感知能力下降的多种情况相关。视觉语音合成器的应用包括基于计算机的听力障碍儿童语音感知训练系统。有关成人学习和可塑性的知识非常重要，因为听力损失是与衰老相关的常见现象。