The modulation transfer function for speech intelligibility.
The modulation transfer function for speech intelligibility.
复制标题
语音清晰度的调制传递函数。
DOI：
10.1371/journal.pcbi.1000302
复制
发表时间：
2009-03
影响因子：
4.3
通讯作者：
Theunissen FE
中科院分区：
文献类型：
--
作者：
Elliott TM;Theunissen FE
我们系统地确定了语音中哪些频谱时间调制是人类听众理解所必需的。语音理解已被证明是强大的频谱和时间退化，但特定的退化的具体相关性是可解释的，由于在语音信号中的联合频谱和时间信息的复杂性。我们采用了一种新的调制滤波技术记录的句子，以限制声学信息定量，并获得一个联合spectrotemporal调制传递函数的语音理解，语音MTF。对于美式英语，语音MTF在时间和频率上都表现出低调制频率的关键性。当时间调制<12 Hz或频谱调制<4周期/kHz时，理解能力明显受损。更具体地说，MTF在时间调制中是带通的，在频谱调制中是低通的：从1到7 Hz的时间调制和<1周期/kHz的频谱调制是最重要的。我们评估了声谱时间调制对声音性别识别的重要性，并发现了一个不同的感兴趣区域：去除3到7个周期/kHz之间的频谱调制显著增加了女性说话者的性别错误识别。语音MTF的确定为产生具有减小的带宽但高可懂度的语音信号提供了另一种方法。这种压缩可以用于音频应用，例如文件压缩或噪声去除，以及用于临床应用，例如耳蜗植入物的信号处理。语音信号具有丰富的时频模式。这些功率在时间和频率上的波动称为调制。尽管它们的声学复杂性，但口语在时间或频率急剧下降后仍然可以理解。为了充分理解语音的感知，并能够将语音简化为最基本的组成部分，我们需要完全描述幅度和频率的调制如何共同促进语音的可理解性。霍尔马克研究在时间或频率上扭曲了语音，但描述了仅限于一个域或另一个域的任意操作，而没有量化信号的剩余和缺失部分。在这里，我们使用一种新的声音滤波技术，系统地研究在时间和频率的联合功能，理解语音是至关重要的。调制滤波方法和由此产生的语音表征都有可能改变语音在音频工程中的压缩方式以及在人工耳蜗等医疗应用中的处理方式。
We systematically determined which spectrotemporal modulations in speech are necessary for comprehension by human listeners. Speech comprehension has been shown to be robust to spectral and temporal degradations, but the specific relevance of particular degradations is arguable due to the complexity of the joint spectral and temporal information in the speech signal. We applied a novel modulation filtering technique to recorded sentences to restrict acoustic information quantitatively and to obtain a joint spectrotemporal modulation transfer function for speech comprehension, the speech MTF. For American English, the speech MTF showed the criticality of low modulation frequencies in both time and frequency. Comprehension was significantly impaired when temporal modulations <12 Hz or spectral modulations <4 cycles/kHz were removed. More specifically, the MTF was bandpass in temporal modulations and low-pass in spectral modulations: temporal modulations from 1 to 7 Hz and spectral modulations <1 cycles/kHz were the most important. We evaluated the importance of spectrotemporal modulations for vocal gender identification and found a different region of interest: removing spectral modulations between 3 and 7 cycles/kHz significantly increases gender misidentifications of female speakers. The determination of the speech MTF furnishes an additional method for producing speech signals with reduced bandwidth but high intelligibility. Such compression could be used for audio applications such as file compression or noise removal and for clinical applications such as signal processing for cochlear implants. The sound signal of speech is rich in temporal and frequency patterns. These fluctuations of power in time and frequency are called modulations. Despite their acoustic complexity, spoken words remain intelligible after drastic degradations in either time or frequency. To fully understand the perception of speech and to be able to reduce speech to its most essential components, we need to completely characterize how modulations in amplitude and frequency contribute together to the comprehensibility of speech. Hallmark research distorted speech in either time or frequency but described the arbitrary manipulations in terms limited to one domain or the other, without quantifying the remaining and missing portions of the signal. Here, we use a novel sound filtering technique to systematically investigate the joint features in time and frequency that are crucial for understanding speech. Both the modulation-filtering approach and the resulting characterization of speech have the potential to change the way that speech is compressed in audio engineering and how it is processed in medical applications such as cochlear implants.
登录
查看更多内容
影响因子：
2.4
作者：
CREELMAN, CD
通讯作者：
CREELMAN, CD
DOI：
10.1109/tassp.1984.1164317
发表时间：
1984-01-01
期刊：
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING
影响因子：
--
作者：
GRIFFIN, DW;LIM, JS
通讯作者：
LIM, JS
影响因子：
2.5
作者：
Gill, Patrick;Woolley, Sarah M. N.;Theunissen, Frederic E.
通讯作者：
Theunissen, Frederic E.
影响因子：
5.4
作者：
LIBERMAN, AM;COOPER, FS;STUDDERT.M
通讯作者：
STUDDERT.M
影响因子：
2.4
作者：
Mesgarani, Nima;David, Stephen V.;Shamma, Shihab A.
通讯作者：
Shamma, Shihab A.