RI: Small: Binaural Sound Source Separation Robust to Listener Head Movements

RI：小：双耳声源分离对听众头部运动具有鲁棒性

• 批准号: 1320059
• 负责人: Jonas Braasch
• 金额: $ 18.66万
• 依托单位: Rensselaer Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-08-01 至 2016-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1320059&HistoricalAwards=false
• 关键词: RI; Small; Binaural; Sound; Source

The goal of this project is to develop a new binaural model to separate sounds in complex environments. The new aspect of the model is that it can utilize head movements to improve its localization performance by analyzing dynamic localization cues and combining these with information about its own head position. In addition, the model uses a dual approach to eliminate the influence of room reflections on sound source localization and segregation. In the first stage, specular reflections are eliminated using an autocorrelation- based algorithm. In the second stage, diffuse reverberation is removed by measuring interaural cross correlation across time/frequency bins, knowing that these values decrease with decreasing direct-to- reverberant energy ratio. The model development is accompanied by a behavioral study to better understand the underlying principles of how humans can perform robustly in complex scenarios. The results are also used as a benchmark test for the model algorithms.This project intends to bridge the gap that exists between fundamentally knowing how the auditory system processes binaural tasks for simple multiple-sound-source scenarios, and understanding and modeling how it performs when the environment reaches real-life complexity. The resulting model is expected to operate in real time to localize sound sources in robot or surveillance applications or serve as a front end for sound- source separation algorithms, speech recognizers, predictors for acoustical quality of rooms, and Computational Auditory Scene Analysis (CASA) models.

该项目的目标是开发一种新的双耳模型，以分离复杂环境中的声音。该模型的新的方面是，它可以利用头部运动，以提高其定位性能，通过分析动态定位线索，并结合这些与自己的头部位置的信息。此外，该模型采用了双重的方法来消除房间反射对声源定位和分离的影响。在第一阶段，镜面反射被消除使用基于自相关的算法。在第二阶段中，通过测量跨时间/频率仓的耳间互相关来去除扩散混响，知道这些值随着直接混响能量比的减小而减小。模型开发伴随着行为研究，以更好地理解人类如何在复杂场景中稳健地执行的基本原则。结果也被用来作为一个基准测试的模型algorithm.This项目旨在弥合之间存在的差距差距，从根本上知道听觉系统如何处理双耳任务简单的多声源的情况下，理解和建模时，它如何执行环境达到现实生活中的复杂性。所得到的模型预期在真实的时间中操作以定位机器人或监视应用中的声源，或者用作声源分离算法、语音识别器、房间声学质量预测器和计算听觉场景分析（CASA）模型的前端。