Leveraging earables for unvoiced command recognition
Leveraging earables for unvoiced command recognition
复制标题
利用耳机进行无声命令识别
DOI：
10.1145/3498361.3538665
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Jain, Shubham
中科院分区：
文献类型：
--
作者：
Srivastava, Tanmay;Khanna, Prerna;Pan, Shijia;Nguyen, Phuc;Jain, Shubham
我们展示了一种耳戴式技术，可以通过跟踪下巴运动来识别人类无声命令。该耳戴式系统旨在实现持续的无声命令识别，以实现稳健的人机交互 (HCI) 应用。首先，系统可靠地提取隐藏在头部运动、行走和其他运动伪影引起的噪声下的下颌运动信号，以跟踪单个辅助发声器官（即单词）。然后，通过学习语言学和人类语音解剖学，我们设计了一种新颖的算法，可以定位命令中的音素，并重建单词。我们在 15 名志愿者的真实实验中评估了所提出的系统。我们的初步结果表明，该系统在无噪声条件下获得了 95.6% 的单词识别准确率，在点头和行走时获得了 93.2% 和 91.6% 的单词识别准确率。
We demonstrate an ear-worn technology that recognizes unvoiced human commands by tracking jaw motion. The ear-worn system is designed to achieve continual unvoiced command recognition for robust human-computer interaction (HCI) applications. First, the system reliably extracts the jaw motion signals buried under the noise caused by head motion, walking, and other motion artifacts to track single secondary voice articulator (i.e., word). Then, learning from linguistics and human speech anatomy, we design a novel algorithm that localizes the phonemes in the command, and reconstructs the word. We evaluate the proposed system in real-world experiments with 15 volunteers. Our preliminary results show that the proposed system obtains a word recognition accuracy of 95.6% in noise-free conditions and 93.2% and 91.6%, while head nodding and walking.
影响因子：
3.7
作者：
Ammari, Tawfiq;Kaye, Jofish;Bentley, Frank
通讯作者：
Bentley, Frank
DOI：
--
发表时间：
2004
期刊：
影响因子：
--
作者：
K. D. Jong
通讯作者：
K. D. Jong