Multi-Speaker Separation in Reverberant Room Using Velocity-Based Microphone

点击翻译按钮获取中文摘要

Audio signal separation has found many applications in electrical and computer engineering fields, such as**automatic speech recognition, voice communication, hearing aids etc. These applications have driven the need**of directional microphone solutions that can pick up only the sound from the desired speaker while suppressing**the voices from other speakers as well as the background noise. Conventional solutions using array of**pressure-based microphones combined with digital signal processing (DSP) techniques do not work well in**space-constrained applications where the captured sound contains mixed voices and ambient noises. Soundskrit**is developing a revolutionary fiber-based directional microphone technology that can directly measure the**particle velocity of an incoming sound wave. Currently, the Soundskrit R&D team lacks signal processing**expertise that is required to develop sound separation software based on the real data acquired by the new**fiber-based microphone in a multi-speaker and reverberant environment.**In this project, we intend to develop DSP algorithms for the Soundskrit's prototype to separate multiple moving**speakers in a reverberant room. The project has two main objectives: (1) localizing active sources in a**reverberant room using sound intensity, and (2) beamforming toward the desired speaker to attenuate unwanted**sounds and noise. The proposed work is divided into three phases. Phase 1 is to build a baseline system to**study the performance of the existing solutions via computer simulation. Phase 2 is to develop DSP algorithms**for the Soundskrit prototype to achieve the objectives in a simulated environment and compare it with the**solutions in Phase 1. In Phase 3, real data will be collected using Soundskrit's prototype in several reverberant**rooms, and the algorithm will be tested and evaluated in real-time. The research results achieved in this project**will be transferred to Soundskrit through a detailed technical report including all software codes and hardware**design.