Can Haptic Stimulation Enhance Music Perception in Hearing-Impaired Listeners?
Can Haptic Stimulation Enhance Music Perception in Hearing-Impaired Listeners?
复制标题
DOI：
10.3389/fnins.2021.723877
复制
发表时间：
2021
影响因子：
4.3
通讯作者：
Fletcher MD
中科院分区：
文献类型：
--
作者：
Fletcher MD
耳蜗植入物（CI）在恢复轻度至重度听力受损个体的听力方面取得了显著的成功。然而，用户通常难以用多个同时的声音来解构复杂的听觉场景，这可能导致音乐享受降低和背景噪声中的语音理解受损。助听器使用者经常有类似的问题，尽管这些问题通常不那么严重。最近的几项研究表明，触觉刺激可以通过访问通过电CI信号传输不佳的声音特征来增强CI听力。这种“电触觉刺激”改善了旋律识别和音高辨别，以及噪声中的语音性能和声音定位。这种方法的成功表明，它也可以增强助听器使用者和其他听力受损者的听觉感知。本文综述了触觉刺激在听障者音乐感知中的应用。音乐在日常生活中很普遍，对电影和视频游戏等媒体至关重要，并且经常是婚礼和葬礼等活动的中心。它代表了信号处理的最大挑战，因为它通常是一个非常复杂的声学信号，包含多个同时的谐波和非谐波声音。因此，为增强音乐感知而开发的信号处理方法对于听障听众所面临的其他关键问题（例如在嘈杂环境中理解语音）可能具有重要的实用性。本文首先讨论了听觉障碍者音乐感知的局限性和触觉系统的局限性。然后讨论了大脑中音频和触觉刺激整合的证据。接下来，功能，适用性和成功的当前触觉设备，以提高音乐感知的审查，以及信号处理方法，可以部署在未来的触觉设备。最后，讨论了可以利用触觉来增强音乐感知的尖端技术。其中包括最新的微型电机和驱动器技术、低功耗无线技术、机器学习、大数据和云计算。提高听障者音乐感知能力的新方法可以大大改善听障者的生活质量。此外，用于提供复杂声音信息的有效触觉技术可以提供一种非侵入性的、负担得起的手段，用于更广泛地增强听力受损个体的听力。
Cochlear implants (CIs) have been remarkably successful at restoring hearing in severely-to-profoundly hearing-impaired individuals. However, users often struggle to deconstruct complex auditory scenes with multiple simultaneous sounds, which can result in reduced music enjoyment and impaired speech understanding in background noise. Hearing aid users often have similar issues, though these are typically less acute. Several recent studies have shown that haptic stimulation can enhance CI listening by giving access to sound features that are poorly transmitted through the electrical CI signal. This “electro-haptic stimulation” improves melody recognition and pitch discrimination, as well as speech-in-noise performance and sound localization. The success of this approach suggests it could also enhance auditory perception in hearing-aid users and other hearing-impaired listeners. This review focuses on the use of haptic stimulation to enhance music perception in hearing-impaired listeners. Music is prevalent throughout everyday life, being critical to media such as film and video games, and often being central to events such as weddings and funerals. It represents the biggest challenge for signal processing, as it is typically an extremely complex acoustic signal, containing multiple simultaneous harmonic and inharmonic sounds. Signal-processing approaches developed for enhancing music perception could therefore have significant utility for other key issues faced by hearing-impaired listeners, such as understanding speech in noisy environments. This review first discusses the limits of music perception in hearing-impaired listeners and the limits of the tactile system. It then discusses the evidence around integration of audio and haptic stimulation in the brain. Next, the features, suitability, and success of current haptic devices for enhancing music perception are reviewed, as well as the signal-processing approaches that could be deployed in future haptic devices. Finally, the cutting-edge technologies that could be exploited for enhancing music perception with haptics are discussed. These include the latest micro motor and driver technology, low-power wireless technology, machine learning, big data, and cloud computing. New approaches for enhancing music perception in hearing-impaired listeners could substantially improve quality of life. Furthermore, effective haptic techniques for providing complex sound information could offer a non-invasive, affordable means for enhancing listening more broadly in hearing-impaired individuals.
登录
查看更多内容
影响因子：
3.7
作者：
Abel, Mary Kathryn;Li, H. Charles;Loui, Psyche
通讯作者：
Loui, Psyche
影响因子：
1.7
作者：
Auer, Edward T., Jr.;Bernstein, Lynne E.;Singh, Manbir
通讯作者：
Singh, Manbir
影响因子：
3.7
作者：
Bergeson, TR;Pisoni, DB;Davis, RAO
通讯作者：
Davis, RAO
影响因子：
2.7
作者：
Buyens, Wim;van Dijk, Bas;Wouters, Jan
通讯作者：
Wouters, Jan
影响因子：
4.7
作者：
Convery, Elizabeth;Keidser, Gitte;Groth, Jennifer
通讯作者：
Groth, Jennifer