Multi-microphone adaptive array augmented with visual cueing.
Multi-microphone adaptive array augmented with visual cueing.
复制标题
多麦克风自适应阵列增强了视觉提示。
DOI：
10.1109/embc.2012.6346102
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
Kramer,Kevin
中科院分区：
文献类型：
--
作者：
Gibson,PaulL;Hedin,DanS;Davies-Venn,EvelynE;Nelson,Peggy;Kramer,Kevin
我们展示了一种视听阵列的开发，该阵列使助听器用户能够在混响环境中与多个扬声器交谈，该环境中存在明显的言语噪声，而助听器无法正常工作。该系统概念由智能手机、智能手机配件和智能手机软件应用程序组成。智能手机配件概念是多麦克风视听阵列，其外形尺寸允许连接到智能手机背面。该配件还将包含一个低功率无线电，通过它可以将音频信号传输到兼容的助听器。智能手机软件应用概念将使用智能手机的内置摄像头获取图像，并利用智能手机内置的人脸检测支持执行实时人脸检测。视听波束形成算法利用说话目标的位置来提高信噪比，从而提高用户的语音清晰度。由于所提出的阵列系统利用手持消费电子设备，因此它将是便携式且低成本的。开发了基于 PC 的实验系统来演示视听多麦克风阵列的可行性，并给出了这些结果。
We present the development of an audiovisual array that enables hearing aid users to converse with multiple speakers in reverberant environments with significant speech babble noise where their hearing aids do not function well. The system concept consists of a smartphone, a smartphone accessory, and a smartphone software application. The smartphone accessory concept is a multi-microphone audiovisual array in a form factor that allows attachment to the back of the smartphone. The accessory will also contain a lower power radio by which it can transmit audio signals to compatible hearing aids. The smartphone software application concept will use the smartphone's built in camera to acquire images and perform real-time face detection using the built-in face detection support of the smartphone. The audiovisual beamforming algorithm uses the location of talking targets to improve the signal to noise ratio and consequently improve the user's speech intelligibility. Since the proposed array system leverages a handheld consumer electronic device, it will be portable and low cost. A PC based experimental system was developed to demonstrate the feasibility of an audiovisual multi-microphone array and these results are presented.