Auditory detection is modulated by theta phase of silent lip movements.
Auditory detection is modulated by theta phase of silent lip movements.
复制标题
DOI：
10.1016/j.crneur.2021.100014
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Hanslmayr, Simon
中科院分区：
文献类型：
--
作者：
Biau, Emmanuel;Wang, Danying;Park, Hyojin;Jensen, Ole;Hanslmayr, Simon
视听语音感知依赖于我们的专业知识，以映射说话者的嘴唇运动与语音。这种多模态匹配由突出的音节特征促进，该音节特征使嘴唇运动和声学包络信号在4 - 8Hz θ频带中对齐。虽然不是唯一的，但研究表明，神经振荡跟踪初级听觉皮层中的声学包络，已经牢固地确立了theta节律在语音处理中的主导地位。视觉皮层中的等时θ振荡会导致嘴唇运动，而听觉皮层则在无声语音感知过程中被招募。这些发现表明，神经元θ振荡可能在组织视觉和听觉感觉区域的信息流中发挥功能性作用。我们提出了无声的语音电影，而参与者进行了纯音检测任务，以测试是否夹带嘴唇运动指导听觉系统和驱动器的行为结果。我们发现，听觉检测的变化取决于正在进行的θ阶段传达的嘴唇运动在电影中。在一个补充实验中，在记录参与者的脑电图（EEG）的同时呈现相同的电影，我们发现无声的嘴唇运动会引起视觉和听觉皮层的神经振荡，视觉相位领先于听觉相位。这些结果支持了这样的观点：嘴唇运动引起的视觉皮质通过θ相位同步过滤了听觉皮质的敏感性。受试者通过说话者的嘴唇运动来进行视觉活动。视觉诱导调节听觉感知和表现。无声的嘴唇知觉会同时调动视觉和听觉皮层。视觉和听觉皮层通过θ相位耦合同步。
Audiovisual speech perception relies, among other things, on our expertise to map a speaker's lip movements with speech sounds. This multimodal matching is facilitated by salient syllable features that align lip movements and acoustic envelope signals in the 4–8 Hz theta band. Although non-exclusive, the predominance of theta rhythms in speech processing has been firmly established by studies showing that neural oscillations track the acoustic envelope in the primary auditory cortex. Equivalently, theta oscillations in the visual cortex entrain to lip movements, and the auditory cortex is recruited during silent speech perception. These findings suggest that neuronal theta oscillations may play a functional role in organising information flow across visual and auditory sensory areas. We presented silent speech movies while participants performed a pure tone detection task to test whether entrainment to lip movements directs the auditory system and drives behavioural outcomes. We showed that auditory detection varied depending on the ongoing theta phase conveyed by lip movements in the movies. In a complementary experiment presenting the same movies while recording participants' electro-encephalogram (EEG), we found that silent lip movements entrained neural oscillations in the visual and auditory cortices with the visual phase leading the auditory phase. These results support the idea that the visual cortex entrained by lip movements filtered the sensitivity of the auditory cortex via theta phase synchronization. Subjects entrain to visual activity conveyed by speakers' lip movements. Visual entrainment modulates auditory perception and performances. Silent lips perception recruits both visual and auditory cortices. Visual and auditory cortices synchronize via theta phase coupling.