Spectro-temporal modulation glimpsing for speech intelligibility prediction.
Spectro-temporal modulation glimpsing for speech intelligibility prediction.
复制标题
DOI：
10.1016/j.heares.2022.108620
复制
发表时间：
2022-12
期刊：
影响因子：
2.8
通讯作者：
Fogerty, Daniel
中科院分区：
文献类型：
--
作者：
Edraki, Amin;Chan, Wai-Yip;Jensen, Jesper;Fogerty, Daniel
我们比较了两种不同的语音可懂度预测算法：时频瞥见比例（GP）和频谱时间瞥见指数（STGI）。这两种算法假设，听众理解语音在具有挑战性的声学环境中的“瞥见”部分可用的信息从退化的语音。GP将瞥见定义为局部信噪比高于某个阈值的时频区域，并将可懂度估计为瞥见的时频区域的比例。另一方面，STGI将瞥见应用于频谱时间调制（STM）域，并使用基于干净和退化语音信号的STM包络之间的归一化互相关的相似性度量来估计可懂度作为所瞥见的STM通道的比例。我们的实验结果表明，STGI扩展了瞥见比例的概念，以更广泛的失真，包括非线性信号处理，并优于GP的加性不相关的噪声数据集，我们测试。此外，结果表明，频谱-时间调制分析，使STGI占掩蔽类型对语音可懂度的影响，从而导致上级性能超过GP调制噪声数据集。
We compare two alternative speech intelligibility prediction algorithms: time-frequency glimpse proportion (GP) and spectro-temporal glimpsing index (STGI). Both algorithms hypothesize that listeners understand speech in challenging acoustic environments by “glimpsing” partially available information from degraded speech. GP defines glimpses as those time-frequency regions whose local signal-to-noise ratio is above a certain threshold and estimates intelligibility as the proportion of the time-frequency regions glimpsed. STGI, on the other hand, applies glimpsing to the spectro-temporal modulation (STM) domain and uses a similarity measure based on the normalized cross-correlation between the STM envelopes of the clean and degraded speech signals to estimate intelligibility as the proportion of the STM channels glimpsed. Our experimental results demonstrate that STGI extends the notion of glimpsing proportion to a wider range of distortions, including non-linear signal processing, and outperforms GP for the additive uncorrelated noise datasets we tested. Furthermore, the results show that spectro-temporal modulation analysis enables STGI to account for the effects of masker type on speech intelligibility, leading to superior performance over GP in modulated noise datasets.
登录
查看更多内容
影响因子：
4.3
作者：
Elliott TM;Theunissen FE
通讯作者：
Theunissen FE
DOI：
10.1109/taslp.2016.2585878
发表时间：
2016-11-01
影响因子：
5.4
作者：
Jensen, Jesper;Taal, Cees H.
通讯作者：
Taal, Cees H.
影响因子：
2.4
作者：
Dau, T;Kollmeier, B;Kohlrausch, A
通讯作者：
Kohlrausch, A
影响因子：
2.4
作者：
Drullman, R;Bronkhorst, AW
通讯作者：
Bronkhorst, AW
影响因子：
2.4
作者：
Gibbs, Bobby E., II;Fogerty, Daniel
通讯作者：
Fogerty, Daniel