The effect of temporal asynchrony on the multisensory integration of letters and speech sounds.
The effect of temporal asynchrony on the multisensory integration of letters and speech sounds.
复制标题
DOI：
10.1093/cercor/bhl007
复制
发表时间：
2006-06
期刊：
影响因子：
3.7
通讯作者：
N. V. van Atteveldt;E. Formisano;L. Blomert;R. Goebel
中科院分区：
文献类型：
--
作者：
N. V. van Atteveldt;E. Formisano;L. Blomert;R. Goebel
时间接近是多感觉神经元跨模式整合的关键决定因素。信息内容可以作为更复杂或更不自然的多感官信息的额外约束因素。字母和语音是识字的基础，它们并不是自然相关的，而是通过外显学习而联系在一起的。我们通过在同一功能磁共振成像(FMRI)设计中处理这两个因素，研究了时间邻近性和信息内容在字母和语音整合中的相对重要性。研究结果显示，时间贴近性与前后听联结皮层的内容一致性之间存在显著的交互作用，这表明时间同步性对字母和语音的整合至关重要。听觉联合皮质中多感觉整合的时间分布与不同大脑结构和动物物种中单个多感觉神经元的时间分布相似。这种相似性表明，基本的神经整合规则适用于多感觉信息的绑定，这些信息并不是自然相关的，而是在识字习得过程中过度学习的。此外，本研究还显示了功能磁共振成像在研究多感觉神经加工的时间方面的适用性。
Temporal proximity is a critical determinant for cross-modal integration by multisensory neurons. Information content may serve as an additional binding factor for more complex or less natural multisensory information. Letters and speech sounds, which form the basis of literacy acquisition, are not naturally related but associated through explicit learning. We investigated the relative importance of temporal proximity and information content on the integration of letters and speech sounds by manipulating both factors within the same functional magnetic resonance imaging (fMRI) design. The results reveal significant interactions between temporal proximity and content congruency in anterior and posterior auditory association cortex, indicating that temporal synchrony is critical for the integration of letters and speech sounds. The temporal profiles for multisensory integration in the auditory association cortex resemble those demonstrated for single multisensory neurons in different brain structures and animal species. This similarity suggests that basic neural integration rules apply to the binding of multisensory information that is not naturally related but overlearned during literacy acquisition. Furthermore, the present study shows the suitability of fMRI to study temporal aspects of multisensory neural processing.