Early auditory sensory processing of voices is facilitated by visual mechanisms
Early auditory sensory processing of voices is facilitated by visual mechanisms
复制标题
视觉机制促进了声音的早期听觉感觉处理
DOI：
10.1016/j.neuroimage.2013.03.043
复制
发表时间：
2013
期刊：
影响因子：
5.7
通讯作者：
K. von Kriegstein
中科院分区：
文献类型：
--
作者：
S. Schall;S.J. Kiebel;B. Maess;K. von Kriegstein
我们如何认识我们熟悉的人？ There is overwhelming evidence that our brains process voice and face in a combined fashion to optimally recognize both who is speaking and what is said.令人惊讶的是，即使丢失一条信息流，这种声音和面部的组合处理似乎也会发生。例如，如果受试者只听到他们熟悉的人说话，而看不到他们的脸，那么视觉面部处理区域就会活跃。 One reason for this crossmodal activation might be that it is instrumental for early sensory processing of voices—a hypothesis that is contrary to current models of unisensory perception. Here, we test this hypothesis by harnessing a temporally highly resolved method, i.e., magnetoencephalography (MEG), to identify the temporal response profile of the fusiform face area in response to auditory-only voice recognition.参与者通过视听方式简要学习了一组声音，即连同一张会说话的脸。学习后，我们测量了受试者对现在熟悉的纯听觉声音的脑磁图信号。 The results revealed three key mechanisms that characterize the sensory processing of familiar speakers' voices: (i) activation in the face-sensitive fusiform gyrus at very early auditory processing stages, i.e., only 100ms after auditory onset, (ii) a temporal facilitation of auditory processing (M200), and (iii) a correlation of this temporal facilitation with recognition performance. These findings suggest that a neural representation of face information is evoked before the identity of the voice is even recognized and that the brain uses this visual representation to facilitate early sensory processing of auditory-only voices.
How do we recognize people that are familiar to us? There is overwhelming evidence that our brains process voice and face in a combined fashion to optimally recognize both who is speaking and what is said. Surprisingly, this combined processing of voice and face seems to occur even if one stream of information is missing. For example, if subjects only hear someone who is familiar to them talking, without seeing their face, visual face-processing areas are active. One reason for this crossmodal activation might be that it is instrumental for early sensory processing of voices—a hypothesis that is contrary to current models of unisensory perception. Here, we test this hypothesis by harnessing a temporally highly resolved method, i.e., magnetoencephalography (MEG), to identify the temporal response profile of the fusiform face area in response to auditory-only voice recognition. Participants briefly learned a set of voices audio-visually, i.e., together with a talking face. After learning, we measured subjects' MEG signals in response to the auditory-only, now familiar, voices. The results revealed three key mechanisms that characterize the sensory processing of familiar speakers' voices: (i) activation in the face-sensitive fusiform gyrus at very early auditory processing stages, i.e., only 100ms after auditory onset, (ii) a temporal facilitation of auditory processing (M200), and (iii) a correlation of this temporal facilitation with recognition performance. These findings suggest that a neural representation of face information is evoked before the identity of the voice is even recognized and that the brain uses this visual representation to facilitate early sensory processing of auditory-only voices.
影响因子：
5.7
作者：
Gross J;Baillet S;Barnes GR;Henson RN;Hillebrand A;Jensen O;Jerbi K;Litvak V;Maess B;Oostenveld R;Parkkonen L;Taylor JR;van Wassenhove V;Wibral M;Schoffelen JM
通讯作者：
Schoffelen JM
电磁记录揭示了人类语音和音调处理的延迟差异。
DOI：
10.1016/s0926-6410(99)00028-2
发表时间：
1999
期刊：
Brain research. Cognitive brain research
影响因子：
--
作者：
H. Tiitinen;P. Sivonen;P. Alku;J. Virtanen;R. Näätänen
通讯作者：
R. Näätänen
影响因子：
3.7
作者：
Keil, Julian;Mueller, Nadia;Weisz, Nathan
通讯作者：
Weisz, Nathan