Selective attention and audiovisual integration: Is attending to both modalities a prerequisite for early integration?
Selective attention and audiovisual integration: Is attending to both modalities a prerequisite for early integration?
复制标题
DOI：
10.1093/cercor/bhk016
复制
发表时间：
2007-03-01
期刊：
影响因子：
3.7
通讯作者：
Woldorff, Marty G.
中科院分区：
文献类型：
--
作者：
Talsma, Durk;Doty, Tracy J.;Woldorff, Marty G.
多感官整合和注意力之间的相互作用进行了研究，使用相结合的视听流设计和快速串行视觉呈现范式。将视听对象（AV）的事件相关电位（ERP）与听觉（A）和视觉对象（V）的ERP之和进行比较。整合过程表示为这些AV和（A + V）的反应之间的差异，并进行了研究，而注意力是针对一个或两个模式或其他地方。结果表明，多感觉整合效应依赖于多感觉对象被充分关注，也就是说，当视觉和听觉都出席。在这种条件下，观察到P50成分的超加性视听整合效应。当无人看管时，这种影响被逆转;多感觉ERP的P50成分小于unisensory总和。此外，我们发现，当受试者参加多感官对象的视觉组件时，晚期额叶负波增强。这种效应与听觉处理的负性非常相似，似乎反映了后期注意力相关的处理，这种处理已经扩展到包括多感觉对象的听觉成分。总之，我们的研究结果揭示了大脑如何处理多感官听觉和视觉信息，包括注意力如何调节多感官整合过程。
Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and (A + V) responses and were studied while attention was directed to one or both modalities or directed elsewhere. Results show that multisensory integration effects depend on the multisensory objects being fully attended-that is, when both the visual and auditory senses were attended. In this condition, a superadditive audiovisual integration effect was observed on the P50 component. When unattended, this effect was reversed; the P50 components of multisensory ERPs were smaller than the unisensory sum. Additionally, we found an enhanced late frontal negativity when subjects attended the visual component of a multisensory object. This effect, bearing a strong resemblance to the auditory processing negativity, appeared to reflect late attention-related processing that had spread to encompass the auditory component of the multisensory object. In conclusion, our results shed new light on how the brain processes multisensory auditory and visual information, including how attention modulates multisensory integration processes.