Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study.
Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study.
复制标题
自发产生的代表性共同语音手势的多模态整合：一项功能磁共振成像研究。
DOI：
10.1080/23273798.2016.1245426
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Emmorey,Karen
中科院分区：
文献类型：
--
作者：
Weisberg,Jill;Hubbard,AmyLynn;Emmorey,Karen
为了检验更生态有效的共同语言手势刺激是否会引发与依赖脚本刺激的研究结果一致的大脑反应，我们在fMRI扫描期间向参与者展示了自发产生的、有意义的共同语言手势（n= 28）。以手势呈现的言语（与单独呈现的相比）引起双侧后颞上区、前运动区和额下区活动增强。在左颞叶和前运动区，而不是下额叶区，我们发现了具有超加性反应的小簇，这表明这些离散的区域支持感觉和语义整合。相反，周围区域和额下回可能支持任何一种感觉语义整合。当有意义的手势伴随着语音时，语言相关区域的语言激活减少表明分配的神经资源减少。手语经验不影响同语手势的激活。总的来说，我们的结果表明，脚本刺激具有最小的混杂影响；然而，它们可能会忽略细微的超加性效应。
To examine whether more ecologically valid co-speech gesture stimuli elicit brain responses consistent with those found by studies that relied on scripted stimuli, we presented participants with spontaneously produced, meaningful co-speech gesture during fMRI scanning (n= 28). Speech presented with gesture (vs. either presented alone) elicited heightened activity in bilateral posterior superior temporal, premotor, and inferior frontal regions. Within left temporal and premotor, but not inferior frontal regions, we identified small clusters with superadditive responses, suggesting that these discrete regions support both sensory and semantic integration. In contrast, surrounding areas and the inferior frontal gyrus may support either sensoryorsemantic integration. Reduced activation for speech with gesture in language-related regions indicates allocation of fewer neural resources when meaningful gestures accompany speech. Sign language experience did not affect co-speech gesture activation. Overall, our results indicate that scripted stimuli have minimal confounding influences; however, they may miss subtle superadditive effects.