Cross-frequency integration for speech recognition in bimodal hearing

双模态听力中语音识别的跨频集成

• 批准号: 7638421
• 负责人: YING-YEE KONG
• 金额: $ 15.6万
• 依托单位: NORTHEASTERN UNIVERSITY
• 依托单位国家: 美国
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-06-13 至 2011-05-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7638421
• 关键词: Accounting; Acoustic Stimulation; Acoustics; Algorithms; Auditory; Characteristics; Cochlear Implants; Contralateral; Cueing for speech; Cues; Development; Ear; Electric Stimulation; Exhibits; Frequencies; Fuzzy Logic; Goals; Hearing; Hearing Aids; Implant; Individual; Individual Differences; Investigation; Knowledge; Label; Life; Lipreading; Materials Testing; Measures; Modeling; Outcome; Patients; Pattern; Perception; Performance; Pitch Perception; Process; Protocols documentation; Rehabilitation therapy; Reporting; Research Personnel; Residual state; Signal Transduction; Simulate; Source; Speech; Statistical Models; Stimulus; Stress; System; Testing; Variant; Visual; Work; base; clinically relevant; computerized data processing; design; hearing impairment; improved; rehabilitation strategy; simulation; speech processing; speech recognition; transmission process

DESCRIPTION (provided by applicant): The benefit of combined electric and acoustic stimulation in speech and pitch perception has been demonstrated in a number of studies. A close examination of the amount of combined benefit reported varies across studies and across test materials and conditions. Some patients did not demonstrate any combined benefit and in rare occasions, some even exhibited a potential incompatibility between the two types of stimulation. Several attempts have been made to relate combined acoustic and electric hearing benefits to some measure of auditory function in the residual hearing, but significant correlations were not found. This study focuses on bimodal hearing in which listeners receive electric stimulation in one ear and acoustic stimulation in the contralateral ear. The long-term goals of this project are (1) to understand the processing of speech in CI listeners who receive combined acoustic and electric stimulation, and (2) to provide a basis for the development of rehabilitation strategies for improving speech recognition in CI listeners. The specific aims are (1) to identify the speech information extracted in electric hearing in the high-frequency regions and residual acoustic hearing in the low-frequency regions; (2) to investigate how the extracted information from each ear is integrated in normal-hearing and cochlear-implant listeners; and (3) to relate phoneme recognition performance to sentence recognition performance. We will apply several well-developed speech integration models, including a simple probabilistic model, Fuzzy Logic Model of Perception, and Pre-Labeling and Post- Labeling models to predict intelligibility scores for combined hearing performance. This model-based approach provides the means to systematically study the differences in the abilities of cochlear-implant listeners to simultaneously extract speech information from acoustic and electric stimulation and integrate this information across ears. The proposed work is of high clinical relevance because it may help identify deficits in information extraction and/or integration, encountered by implant users on an individual basis and aid in developing rehabilitative strategies tailored to individual needs. Relevance: The purpose of this study is to investigate how speech information is integrated across ears in individuals who wear a cochlear implant in one ear and a hearing aid in the opposite ear. The proposed work is of high clinical relevance because it may help identify the problems encountered by implant users and aid in developing rehabilitative strategies tailored to individual needs.

描述（由申请人提供）：多项研究证明了电和声刺激组合对语音和音高感知的益处。对报告的综合获益量的仔细检查在不同研究以及不同试验材料和条件下有所不同。有些患者没有表现出任何组合的好处，在极少数情况下，有些甚至表现出两种类型的刺激之间的潜在不兼容性。几次尝试已经取得了一些措施的听觉功能的残余hearing. This研究的重点是双峰听力，其中听众在一只耳朵和听觉刺激在对侧耳接受电刺激的声学和电听力的好处，但显着的相关性没有被发现。本研究的长期目标是：（1）了解接受声电联合刺激的CI听者的言语加工过程;（2）为改善CI听者言语识别的康复策略的发展提供基础。具体目标是：（1）识别高频区的电听觉和低频区的残余听觉中提取的语音信息;（2）研究从每只耳朵提取的信息如何在正常听力和耳蜗植入者中整合;以及（3）将音素识别性能与句子识别性能相关联。我们将应用几个成熟的语音整合模型，包括一个简单的概率模型，感知的模糊逻辑模型，以及预标记和后标记模型来预测组合听力性能的可懂度分数。这种基于模型的方法提供了系统地研究耳蜗植入者从声刺激和电刺激中同时提取语音信息并将这些信息整合到耳朵中的能力差异的方法。拟议的工作是高度的临床相关性，因为它可能有助于识别缺陷的信息提取和/或整合，遇到植入用户在个人的基础上，并在制定康复策略，根据个人需求的援助。 相关性：本研究的目的是调查如何语音信息是在个人谁戴人工耳蜗在一只耳朵和助听器在对耳集成。拟议的工作是高度的临床相关性，因为它可能有助于识别植入用户遇到的问题，并在制定适合个人需求的康复策略援助。