Seeing is believing: neural representations of visual stimuli in human auditory cortex correlate with illusory auditory perceptions.
Seeing is believing: neural representations of visual stimuli in human auditory cortex correlate with illusory auditory perceptions.
复制标题
DOI：
10.1371/journal.pone.0073148
复制
发表时间：
2013
期刊：
影响因子：
3.7
通讯作者：
Greger B
中科院分区：
文献类型：
--
作者：
Smith E;Duede S;Hanrahan S;Davis T;House P;Greger B
在人际交往中，听者往往既能听到说话者的声音，也能看到说话者的样子。视觉刺激可以微妙地改变听者的听觉感知，如在麦格克错觉中，其中音素的听觉身份的感知被同时发出不同音素的嘴的视频改变。研究尚未将视觉对语言神经表征的影响与主观语言感知联系起来。在这里，我们表明，在呈现听觉刺激之前，视觉会影响人类听觉皮质中音素的电生理表现。我们使用麦格克效应将音素的主观感知与听觉刺激分离开来。在这个范例中，我们证明了听觉皮层的神经表征与口部发音的视觉刺激的相关性更密切，口部发音的视觉刺激驱动了虚幻的主观听觉感知，而不是实际的听觉刺激。此外，在音素感知过程中，视觉和听觉刺激的信息沿着颞上回在尾侧-喙侧方向传递，这与视觉信息从枕叶皮层流入腹侧听觉处理流的预期一致。这些结果表明，视觉刺激影响听觉皮层的神经表征早期的感觉加工，并可能覆盖主观听觉感知通常由听觉刺激产生。这些研究结果描绘了一个显着的影响，视觉听觉的神经处理在三级听觉皮层，并建议麦格克效应的机械基础。
In interpersonal communication, the listener can often see as well as hear the speaker. Visual stimuli can subtly change a listener’s auditory perception, as in the McGurk illusion, in which perception of a phoneme’s auditory identity is changed by a concurrent video of a mouth articulating a different phoneme. Studies have yet to link visual influences on the neural representation of language with subjective language perception. Here we show that vision influences the electrophysiological representation of phonemes in human auditory cortex prior to the presentation of the auditory stimulus. We used the McGurk effect to dissociate the subjective perception of phonemes from the auditory stimuli. With this paradigm we demonstrate that neural representations in auditory cortex are more closely correlated with the visual stimuli of mouth articulation, which drive the illusory subjective auditory perception, than the actual auditory stimuli. Additionally, information about visual and auditory stimuli transfer in the caudal–rostral direction along the superior temporal gyrus during phoneme perception as would be expected of visual information flowing from the occipital cortex into the ventral auditory processing stream. These results show that visual stimuli influence the neural representation in auditory cortex early in sensory processing and may override the subjective auditory perceptions normally generated by auditory stimuli. These findings depict a marked influence of vision on the neural processing of audition in tertiary auditory cortex and suggest a mechanistic underpinning for the McGurk effect.
登录
查看更多内容
DOI：
10.1523/jneurosci.2041-09.2009
发表时间：
2009-10-28
期刊：
The Journal of neuroscience : the official journal of the Society for Neuroscience
影响因子：
--
作者：
Manning JR;Jacobs J;Fried I;Kahana MJ
通讯作者：
Kahana MJ
细胞外田地和电流的起源-EEG，ECOG，LFP和尖峰。
DOI：
10.1038/nrn3241
发表时间：
2012-05-18
期刊：
Nature reviews. Neuroscience
影响因子：
--
作者：
Buzsáki G;Anastassiou CA;Koch C
通讯作者：
Koch C
影响因子：
25
作者：
Rauschecker, Josef P.;Scott, Sophie K.
通讯作者：
Scott, Sophie K.
影响因子：
5.7
作者：
Ungerleider, Leslie G.;Haxby, James V.
通讯作者：
Haxby, James V.
影响因子：
2.8
作者：
Besle, Julien;Bertrand, Olivier;Giard, Marie-Helene
通讯作者：
Giard, Marie-Helene