Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels.
Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels.
复制标题
DOI：
10.1038/s41598-023-40509-7
复制
发表时间：
2023-08-16
影响因子：
4.6
通讯作者：
中科院分区：
文献类型：
--
作者：
人工耳蜗 (CI) 彻底改变了听力损失的治疗方法，但全球有大量人口无法使用人工耳蜗，原因要么是由于妨碍植入的疾病，要么是因为人工耳蜗价格昂贵且需要专科手术。最近的技术发展意味着通过振动传输语音的触觉辅助设备可以提供一种可行的低成本、非侵入性替代方案。一项重要的发展是，紧凑型触觉执行器现在可以在多个频率上提供强烈的刺激。我们探讨了这些多个频道是否可以传输频谱信息以改善触觉音素辨别力。为了将音频转换为振动，从一个或多个音频频带中提取语音幅度包络，并用于对传递到手腕上单个部位的一种或多种振动触觉音调进行幅度调制。在 26 名触摸敏感度正常的参与者中，使用 1 个、4 个或 8 个频带评估纯触觉音素辨别能力。与一个频段相比，四个频段的性能提高了 5.9%，八个频段的性能提高了 8.4%。多频段信号处理方法可以在紧凑型设备上实时实现，并且振动触觉音调可以通过最新的紧凑型低功率执行器再现。因此，这种方法可以很容易地在低成本触觉助听器中实施，以带来现实世界的好处。
Cochlear implants (CIs) have revolutionised treatment of hearing loss, but large populations globally cannot access them either because of disorders that prevent implantation or because they are expensive and require specialist surgery. Recent technology developments mean that haptic aids, which transmit speech through vibration, could offer a viable low-cost, non-invasive alternative. One important development is that compact haptic actuators can now deliver intense stimulation across multiple frequencies. We explored whether these multiple frequency channels can transfer spectral information to improve tactile phoneme discrimination. To convert audio to vibration, the speech amplitude envelope was extracted from one or more audio frequency bands and used to amplitude modulate one or more vibro-tactile tones delivered to a single-site on the wrist. In 26 participants with normal touch sensitivity, tactile-only phoneme discrimination was assessed with one, four, or eight frequency bands. Compared to one frequency band, performance improved by 5.9% with four frequency bands and by 8.4% with eight frequency bands. The multi-band signal-processing approach can be implemented in real-time on a compact device, and the vibro-tactile tones can be reproduced by the latest compact, low-powered actuators. This approach could therefore readily be implemented in a low-cost haptic hearing aid to deliver real-world benefits.
登录
查看更多内容
影响因子：
3.7
作者：
Kong YY;Mullangi A;Kokkinakis K
通讯作者：
Kokkinakis K
影响因子：
4.3
作者：
Fletcher MD;Verschuur CA
通讯作者：
Verschuur CA
影响因子：
4.3
作者：
Fletcher MD
通讯作者：
Fletcher MD
影响因子：
4.6
作者：
Fletcher MD;Zgheib J;Perry SW
通讯作者：
Perry SW
影响因子：
4.6
作者：
Fletcher, Mark D.;Thini, Nour;Perry, Samuel W.
通讯作者：
Perry, Samuel W.