Multivariate fMRI responses in superior temporal cortex predict visual contributions to, and individual differences in, the intelligibility of noisy speech.
Multivariate fMRI responses in superior temporal cortex predict visual contributions to, and individual differences in, the intelligibility of noisy speech.
复制标题
DOI：
10.1016/j.neuroimage.2023.120271
复制
发表时间：
2023-09
期刊：
影响因子：
5.7
通讯作者：
Beauchamp, Michael S.
中科院分区：
文献类型：
--
作者：
Zhang, Yue;Rennig, Johannes;Magnotti, John F.;Beauchamp, Michael S.
人类具有独特的能力来解码构成语音的快速语言元素流，即使它被噪音污染。关于噪声语音感知的两个可靠的观察是，看到说话者的脸提高了可理解性，并且在感知噪声语音的能力方面存在个体差异。我们介绍了一个多变量BOLD功能磁共振成像测量，解释这两个观察。在两项独立的功能磁共振成像研究中，清晰和嘈杂的语音以视觉，听觉和视听格式呈现给37名参与者，他们对清晰度进行了评级。一个事件相关的设计被用来排序嘈杂的语音试验，其清晰度。个体差异多维标度被施加到功能磁共振成像反应模式在上级颞叶皮层和清晰的语音和嘈杂（但可理解）的语音反应之间的差异进行了测量。神经相异性是视听语音比仅语音，对应于更高的清晰度嘈杂的视听语音。与个体差异相对应，噪声语音感知较好的参与者的差异较小。这些关系举行了单个单词和整个句子的刺激，这表明他们是由可理解性，而不是特定的刺激测试。感知可懂度的神经测量可能有助于制定帮助言语感知受损者的策略。
Humans have the unique ability to decode the rapid stream of language elements that constitute speech, even when it is contaminated by noise. Two reliable observations about noisy speech perception are that seeing the face of the talker improves intelligibility and the existence of individual differences in the ability to perceive noisy speech. We introduce a multivariate BOLD fMRI measure that explains both observations. In two independent fMRI studies, clear and noisy speech was presented in visual, auditory and audiovisual formats to thirty-seven participants who rated intelligibility. An event-related design was used to sort noisy speech trials by their intelligibility. Individual-differences multidimensional scaling was applied to fMRI response patterns in superior temporal cortex and the dissimilarity between responses to clear speech and noisy (but intelligible) speech was measured. Neural dissimilarity was less for audiovisual speech than auditory-only speech, corresponding to the greater intelligibility of noisy audiovisual speech. Dissimilarity was less in participants with better noisy speech perception, corresponding to individual differences. These relationships held for both single word and entire sentence stimuli, suggesting that they were driven by intelligibility rather than the specific stimuli tested. A neural measure of perceptual intelligibility may aid in the development of strategies for helping those with impaired speech perception.
登录
查看更多内容
影响因子：
5.7
作者：
Dale, AM;Fischl, B;Sereno, MI
通讯作者：
Sereno, MI
影响因子：
16.6
作者：
Du Y;Buchsbaum BR;Grady CL;Alain C
通讯作者：
Alain C
影响因子：
56.9
作者：
Brewer, JB;Zhao, Z;Gabrieli, JDE
通讯作者：
Gabrieli, JDE
影响因子：
4.8
作者：
Alain, Claude;Du, Yi;Banai, Karen
通讯作者：
Banai, Karen
影响因子：
3.7
作者：
Abrams, Daniel A.;Ryali, Srikanth;Menon, Vinod
通讯作者：
Menon, Vinod