Multimodal blind source separation with a circular microphone array and robust beamforming
Multimodal blind source separation with a circular microphone array and robust beamforming
复制标题
DOI：
--
复制
发表时间：
2011-08
期刊：
影响因子：
--
通讯作者：
S. M. Naqvi;Muhammad Salman Khan;Qingju Liu;Wenwu Wang;J. Chambers
中科院分区：
文献类型：
--
作者：
S. M. Naqvi;Muhammad Salman Khan;Qingju Liu;Wenwu Wang;J. Chambers
在室内环境下，提出了一种新的多模态（视听）方法来解决盲源分离问题。BSS在现实环境中的主要挑战是：信号源运动复杂，房间脉冲响应长。对于移动源，仅从有限数量的音频样本中获得的统计信息很难计算分离音频信号的解混滤波器。对于在具有长脉冲响应的房间中测量的物理固定源，仅音频BSS方法的性能是有限的。因此，利用视觉形态来促进分离。利用基于马尔可夫链蒙特卡罗粒子滤波（MCMC-PF）的三维跟踪器检测声源的运动，估计声源到达麦克风阵列的方向信息。实现了一种鲁棒最小二乘频率不变数据无关（RLSFIDI）波束形成器，用于实时语音增强。在波束形成器的设计中，采用凸优化方法控制了波束形成器在源定位和到达信息方向上的不确定性。采用16元圆形阵列配置。基于客观和主观测量的仿真研究证实了波束形成处理相对于传统BSS方法的优势。
A novel multimodal (audio-visual) approach to the problem of blind source separation (BSS) is evaluated in room environments. The main challenges of BSS in realistic environments are: sources are moving in complex motions and the room impulse responses are long. For moving sources the unmixing filters to separate the audio signals are difficult to calculate from only statistical information available from a limited number of audio samples. For physically stationary sources measured in rooms with long impulse responses, the performance of audio only BSS methods is limited. Therefore, visual modality is utilized to facilitate the separation. The movement of the sources is detected with a 3-D tracker based on a Markov Chain Monte Carlo particle filter (MCMC-PF), and the direction of arrival information of the sources to the microphone array is estimated. A robust least squares frequency invariant data independent (RLSFIDI) beamformer is implemented to perform real time speech enhancement. The uncertainties in source localization and direction of arrival information are also controlled by using a convex optimization approach in the beamformer design. A 16 element circular array configuration is used. Simulation studies based on objective and subjective measures confirm the advantage of beamforming based processing over conventional BSS methods.