Communication Support System of Smart Glasses for the Hearing Impaired
Communication Support System of Smart Glasses for the Hearing Impaired
复制标题
听障智能眼镜通讯支持系统
DOI：
10.1007/978-3-319-94277-3_37
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Ohnishi Noboru
中科院分区：
文献类型：
--
作者：
Watanabe Daiki;Takeuchi Yoshinori;Matsumoto Tetsuya;Kudo Hiroaki;Ohnishi Noboru
在这项研究中，我们提出了一种新的系统，用于在智能眼镜上显示对话内容的字幕。我们建议使用智能眼镜进行自然交流，这比手语或手写等传统交流方法更像是听力正常的人之间的对话。该系统将口语翻译成文本，并将其显示在智能眼镜的屏幕上。它配备了四个麦克风，定位声源的方向，并区分声源的角度方向。使用来自四个麦克风的信号，该系统可以增强语音。为了提高噪声环境下的语音识别率，需要采用语音增强技术。实验结果表明，该系统可以估计语音的角度方向，并识别超过90%的单词。主题实验表明，所提出的系统具有接近现有智能手机应用程序的相似性得分。
In this research, we propose a novel system for displaying captions of conversation content on smart glasses. We propose natural communication using smart glasses that is more like a conversation between hearing people than conventional communication methods such as sign language or handwriting. The system translates spoken words into text and displays them on the screen of the smart glasses. It equips four microphones, localizes the direction of the sound source, and distinguishes the angular direction of the sound source. Using signals from four microphones, the system can enhance voices. The voice enhancement technique is required to improve the automatic speech recognition rate in noisy environments. Experimental results showed that the system can estimate the angular direction of a voice and recognize more than 90% of words that are spoken. The subject experiment showed that the proposed system had a similarity score close to an existing smartphone application.