Speaker's hand gestures modulate speech perception through phase resetting of ongoing neural oscillations
Speaker's hand gestures modulate speech perception through phase resetting of ongoing neural oscillations
复制标题
DOI：
10.1016/j.cortex.2014.11.018
复制
发表时间：
2015-07-01
期刊：
影响因子：
3.6
通讯作者：
Soto-Faraco, Salvador
中科院分区：
文献类型：
--
作者：
Biau, Emmanuel;Torralba, Mireia;Soto-Faraco, Salvador
在自然的口语交流中，说话者经常伴随着自发的节拍手势。这些手势通常与词汇重音一致，并能调节其关联词的突显。在这里，我们讨论了节拍手势对言语知觉的神经关联的影响。以前的研究已经强调了theta振荡在语音时间预测中所起的作用。我们假设，看到节拍手势可能会影响相应单词开头周围正在进行的低频神经振荡。参与者在观看连续的、自然录制的演讲时，获得了脑电(EEG)记录。单词开始时的锁相值(PLV)是从EEG中计算出来的，这些相同的单词对在话语中同时使用和不使用节拍手势发音。我们观察到PLV在5-6赫兹的theta范围内增加，以及在8-10赫兹的阿尔法频段中的去同步化，在以节拍手势开始的单词周围。这些发现表明，节拍有助于调节自然言语感知过程中相关时刻的低频振荡活动，为言语和副语言信息的整合提供了新的见解。(C)2015爱思唯尔有限公司。保留所有权利。
Speakers often accompany speech with spontaneous beat gestures in natural spoken communication. These gestures are usually aligned with lexical stress and can modulate the saliency of their affiliate words. Here we addressed the consequences of beat gestures on the neural correlates of speech perception. Previous studies have highlighted the role played by theta oscillations in temporal prediction of speech. We hypothesized that the sight of beat gestures may influence ongoing low-frequency neural oscillations around the onset of the corresponding words. Electroencephalographic (EEG) recordings were acquired while participants watched a continuous, naturally recorded discourse. The phase-locking value (PLV) at word onset was calculated from the EEG from pairs of identical words that had been pronounced with and without a concurrent beat gesture in the discourse. We observed an increase in PLV in the 5-6 Hz theta range as well as a desynchronization in the 8-10 Hz alpha band around the onset of words preceded by a beat gesture. These findings suggest that beats help tune low-frequency oscillatory activity at relevant moments during natural speech perception, providing a new insight of how speech and paralinguistic information are integrated. (C) 2015 Elsevier Ltd. All rights reserved.