Cortical tracking of formant modulations derived from silently presented lip movements and its decline with age.
Cortical tracking of formant modulations derived from silently presented lip movements and its decline with age.
复制标题
DOI：
10.1093/cercor/bhab518
复制
发表时间：
2022-10-20
期刊：
影响因子：
--
通讯作者：
中科院分区：
文献类型：
--
作者：
视觉和听觉线索的整合对于言语的成功加工至关重要，特别是在不利条件下。最近的报告表明，当参与者观看静音的说话者视频时，关于声学语音包络的语音信息（与说话者的嘴唇运动相关但独立于说话者的嘴唇运动）由视觉皮层跟踪。然而，语音信号还携带更丰富的声学细节，例如，关于基频和共振频率，其视觉声学变换可以帮助语音处理。在这里，我们研究了这些更细粒度的声学细节的视觉-语音转换过程的神经基础，并评估了它们如何随着年龄的变化而变化。我们记录了全头脑磁图（MEG）数据，而参与者观看了安静的正常（即，自然）和反转的视频发言者，并注意他们的嘴唇运动。我们发现，视觉皮层能够跟踪与嘴唇运动相关的共振频率（或共振峰）和音高（或基频）的未听到的自然调制。重要的是，只有处理自然听不到的共振峰显着减少与年龄的视觉和扣带皮层。对于未听到的语音包络、基频或由嘴唇运动携带的纯视觉信息的处理，情况并非如此。这些结果表明，未听到的频谱细节（沿着与未听到的声学包络）从一个纯粹的视觉转换为语音表示。老化尤其影响在共振峰频率处导出频谱动态的能力。由于在嘈杂的环境中听应该利用跟踪光谱细节的能力，我们的研究结果提供了一个新的重点在这种具有挑战性的情况下的补偿过程。
The integration of visual and auditory cues is crucial for successful processing of speech, especially under adverse conditions. Recent reports have shown that when participants watch muted videos of speakers, the phonological information about the acoustic speech envelope, which is associated with but independent from the speakers’ lip movements, is tracked by the visual cortex. However, the speech signal also carries richer acoustic details, for example, about the fundamental frequency and the resonant frequencies, whose visuophonological transformation could aid speech processing. Here, we investigated the neural basis of the visuo-phonological transformation processes of these more fine-grained acoustic details and assessed how they change as a function of age. We recorded whole-head magnetoencephalographic (MEG) data while the participants watched silent normal (i.e., natural) and reversed videos of a speaker and paid attention to their lip movements. We found that the visual cortex is able to track the unheard natural modulations of resonant frequencies (or formants) and the pitch (or fundamental frequency) linked to lip movements. Importantly, only the processing of natural unheard formants decreases significantly with age in the visual and also in the cingulate cortex. This is not the case for the processing of the unheard speech envelope, the fundamental frequency, or the purely visual information carried by lip movements. These results show that unheard spectral fine details (along with the unheard acoustic envelope) are transformed from a mere visual to a phonological representation. Aging affects especially the ability to derive spectral dynamics at formant frequencies. As listening in noisy environments should capitalize on the ability to track spectral fine details, our results provide a novel focus on compensatory processes in such challenging situations.
登录
查看更多内容
影响因子：
25
作者：
通讯作者：
--
影响因子：
9.8
作者：
Gross J;Hoogenboom N;Thut G;Schyns P;Panzeri S;Belin P;Garrod S
通讯作者：
Garrod S
DOI：
10.1016/j.apacoust.2021.108051
发表时间：
2021-07
期刊：
Applied acoustics. Acoustique applique. Angewandte Akustik
影响因子：
--
作者：
通讯作者：
--
影响因子：
4.8
作者：
Goossens T;Vercammen C;Wouters J;van Wieringen A
通讯作者：
van Wieringen A
影响因子：
4.3
作者：
Chandrasekaran C;Trubanova A;Stillittano S;Caplier A;Ghazanfar AA
通讯作者：
Ghazanfar AA