Auditory Scene Analysis with Complex Sounds

复杂声音的听觉场景分析

• 批准号: 9339650
• 负责人: Josh H McDermott
• 金额: $ 37.57万
• 依托单位: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
• 依托单位国家: 美国
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9339650
• 关键词: Acoustics; Address; Algorithms; Area; Attention; Auditory; Auditory system; Behavioral; Binaural; Brain; Characteristics; Cochlear Implants; Communication; Competence; Complex; Cues; Dependence; Development; Devices; Disease; Ear; Engineering; Exhibits; Frequencies; Frustration; Goals; Grouping; Hearing; Hearing Aids; Human; Implant; Knowledge; Measures; Methods; Modeling; Mono-S; Music; Noise; Performance; Process; Property; Prosthesis; Psychoacoustics; Reporting; Research; Restaurants; Role; Signal Transduction; Social isolation; Source; Speech; Speech Intelligibility; Stimulus; Stream; Structure; System; Technology; Testing; Time; Voice; Work; auditory comprehension; design; experimental study; hearing impairment; improved; insight; interest; novel; remediation; segregation; sound; speech recognition; success; vocal cord

PROJECT SUMMARY / ABSTRACT Perhaps the most pervasive problem faced by listeners with hearing impairment or cochlear implants is the difficulty of recognizing speech and other sounds in the presence of competing sound sources, as when conversing at a restaurant. This difficulty in “sound segregation” – hearing a particular sound of interest when it is embedded in a mixture of other sounds – often leads to frustration and social isolation, and is not adequately addressed by current hearing aids and implants. Sound segregation difficulties are also commonly reported in developmental auditory disorders. The long-term goal of the proposed research is to reveal the basis of sound segregation and to provide insights that will facilitate improved prosthetic devices and remediation strategies, as well as more effective machine systems for processing sounds, e.g. for automatic speech recognition. The development of more effective devices, technologies, and therapies is currently limited by an incomplete understanding of the factors that underlie sound segregation by normal-hearing listeners. In particular, little is known about sound segregation with complex naturalistic sounds, in part because much of the research in this area has been conducted using simple signals that are impoverished relative to the sounds listeners normally encounter. We propose to enrich the understanding of sound segregation with three sets of experiments that use novel sound synthesis methods to manipulate properties of natural speech and other sounds and test their role in segregation with behavioral experiments in human listeners. Aim 1 manipulates the classically proposed grouping cue provided by harmonic frequency relations and investigates the mechanisms underlying their effect. Aim 2 investigates the role of prior knowledge of voice and speech structure on segregation, and should help to explain why some voices are easier or harder to segregate than others. Aim 3 investigates the role of attentive tracking in the segregation of sounds from mixtures, and will explore the factors that facilitate tracking or cause it to fail. The results will reveal the mechanisms underlying sound segregation by the healthy auditory system, and will provide insights into the factors that limit auditory comprehension in the presence of multiple sound sources, hopefully suggesting new strategies for signal enhancement, prosthetic devices, and behavioral remediation.

项目总结/摘要 也许听力障碍或人工耳蜗植入者面临的最普遍的问题是 在存在竞争声源的情况下识别语音和其他声音的困难，如当 在餐厅聊天这种“声音分离”的困难-听到一个特定的声音感兴趣时， 是嵌入在其他声音的混合-往往导致挫折和社会孤立， 目前的助听器和植入物解决了这个问题。健全的隔离困难也普遍报告， 发育性听觉障碍这项研究的长期目标是揭示声音的基础 隔离，并提供见解，这将有助于改善假体装置和补救策略， 以及用于处理声音（例如用于自动语音识别）的更有效的机器系统。的 更有效的设备、技术和疗法的开发目前受到不完整的 理解听力正常的听众声音分离的因素。尤其是， 我们知道声音分离与复杂的自然主义声音，部分原因是这方面的大部分研究 该地区已进行了使用简单的信号是贫困相对于正常的声音听众 遭遇我们建议通过三组实验来丰富对声音分离的理解， 使用新的声音合成方法来操纵自然语音和其他声音的属性，并测试它们的 在人类听众中进行的行为实验。目标1操纵经典建议 分组提示提供的谐波频率关系，并探讨其机制 效果目的2探讨语音和言语结构的先验知识对分离的作用， 有助于解释为什么有些声音比其他声音更容易或更难分离。目标3研究了 注意跟踪分离的声音从混合物，并将探讨因素，促进跟踪 或导致其失败。研究结果将揭示健康听觉者声音分离的机制 系统，并将提供深入了解的因素，限制听觉理解的存在多个 声音来源，希望提出新的战略，信号增强，假肢设备， 行为矫正