Beamforming with acoustic vector sensors for audio user interfaces

点击翻译按钮获取中文摘要

We aim to create new Audio User Interfaces (AUIs) for the automatic separation and annotation of audio from complex sound scenes using acoustic vector sensor beamforming technology. Specifically, we will develop: speech AUIs for noisy, multi-talker, reverberant environments; and sound transcription AUIs for the deaf. Ultimately, users will be able to walk into a room, hold conversations and leave with a searchable, automatically-generated transcript of the audio events, tagged with metadata. The application of these technologies will create new possibilities for recording audio in the music, radio, TV industries, and future home based audio communication systems.