Cross-frequency integration for speech recognition in bimodal hearing

双模态听力中语音识别的跨频集成

• 批准号: 7857584
• 负责人: YING-YEE KONG
• 金额: $ 7.8万
• 依托单位: NORTHEASTERN UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-17 至 2010-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7857584
• 关键词: Accounting; Acoustic Stimulation; Acoustics; Algorithms; Auditory; Characteristics; Cochlear Implants; Contralateral; Cueing for speech; Cues; Development; Ear; Electric Stimulation; Exhibits; Frequencies; Fuzzy Logic; Goals; Hearing; Hearing Aids; Implant; Individual; Individual Differences; Investigation; Knowledge; Label; Life; Lipreading; Materials Testing; Measures; Modeling; Outcome; Patients; Pattern; Perception; Performance; Pitch Perception; Process; Protocols documentation; Rehabilitation therapy; Reporting; Research Personnel; Residual state; Signal Transduction; Simulate; Source; Speech; Statistical Models; Stimulus; Stress; System; Testing; Variant; Visual; Work; base; clinically relevant; computerized data processing; design; hearing impairment; improved; rehabilitation strategy; simulation; speech processing; speech recognition; transmission process

DESCRIPTION (provided by applicant): The benefit of combined electric and acoustic stimulation in speech and pitch perception has been demonstrated in a number of studies. A close examination of the amount of combined benefit reported varies across studies and across test materials and conditions. Some patients did not demonstrate any combined benefit and in rare occasions, some even exhibited a potential incompatibility between the two types of stimulation. Several attempts have been made to relate combined acoustic and electric hearing benefits to some measure of auditory function in the residual hearing, but significant correlations were not found. This study focuses on bimodal hearing in which listeners receive electric stimulation in one ear and acoustic stimulation in the contralateral ear. The long-term goals of this project are (1) to understand the processing of speech in CI listeners who receive combined acoustic and electric stimulation, and (2) to provide a basis for the development of rehabilitation strategies for improving speech recognition in CI listeners. The specific aims are (1) to identify the speech information extracted in electric hearing in the high-frequency regions and residual acoustic hearing in the low-frequency regions; (2) to investigate how the extracted information from each ear is integrated in normal-hearing and cochlear-implant listeners; and (3) to relate phoneme recognition performance to sentence recognition performance. We will apply several well-developed speech integration models, including a simple probabilistic model, Fuzzy Logic Model of Perception, and Pre-Labeling and Post- Labeling models to predict intelligibility scores for combined hearing performance. This model-based approach provides the means to systematically study the differences in the abilities of cochlear-implant listeners to simultaneously extract speech information from acoustic and electric stimulation and integrate this information across ears. The proposed work is of high clinical relevance because it may help identify deficits in information extraction and/or integration, encountered by implant users on an individual basis and aid in developing rehabilitative strategies tailored to individual needs. Relevance: The purpose of this study is to investigate how speech information is integrated across ears in individuals who wear a cochlear implant in one ear and a hearing aid in the opposite ear. The proposed work is of high clinical relevance because it may help identify the problems encountered by implant users and aid in developing rehabilitative strategies tailored to individual needs.

描述(由申请人提供)：许多研究已经证明了电和声联合刺激在语音和音调知觉方面的好处。对报告的综合受益金额的仔细检查因研究和测试材料和条件的不同而不同。一些患者没有表现出任何联合益处，在极少数情况下，一些患者甚至表现出两种刺激之间潜在的不相容。人们曾多次尝试将声学和电学结合的听力益处与残留听力中的某种程度的听觉功能联系起来，但没有发现显著的相关性。本研究以双峰听觉为研究对象，受试者一侧耳接受电刺激，对侧耳接受声刺激。本项目的长期目标是(1)了解接受声和电刺激的CI听者的言语加工过程，以及(2)为制定改善CI听者语音识别的康复策略提供基础。其具体目标是：(1)在高频区域识别电听觉提取的语音信息，在低频区域识别剩余声听觉提取的语音信息；(2)研究从每只耳朵提取的信息在正常听力和人工耳蜗听者中是如何整合的；(3)将音素识别性能与句子识别性能联系起来。我们将应用几种成熟的语音集成模型，包括简单概率模型、感知的模糊逻辑模型以及前标记和后标记模型来预测综合听力表现的清晰度分数。这种基于模型的方法提供了系统研究人工耳蜗听者同时从声和电刺激中提取语音信息并跨耳整合这些信息的能力差异的手段。这项拟议的工作具有很高的临床意义，因为它可能有助于识别植入用户在个人基础上遇到的信息提取和/或整合方面的缺陷，并有助于制定适合个人需求的康复策略。 相关性：这项研究的目的是调查在一只耳朵佩戴人工耳蜗，另一只耳朵佩戴助听器的个体中，语音信息是如何在两只耳朵之间整合的。这项拟议的工作具有很高的临床意义，因为它可能有助于确定植入者遇到的问题，并有助于制定适合个人需求的康复策略。