Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study
Cross-modal binding and activated attentional networks during audio-visual speech integration: a functional MRI study
复制标题
DOI：
10.1093/cercor/bhi052
复制
发表时间：
2005-11-01
期刊：
影响因子：
3.7
通讯作者：
Sadato, N
中科院分区：
文献类型：
--
作者：
Saito, DN;Yoshimura, K;Sadato, N
我们使用功能磁共振成像评估了视听语音整合过程中跨模式结合和注意力分散的神经基质。受试者（n = 17）接受语音一致或不一致的听觉和视觉言语刺激。执行了三种不同的匹配任务：听觉-听觉（AA）、视觉-视觉（VV）和听觉-视觉（AV）。受试者被询问所提示的对是否一致。我们通过 VV-AA 和 AA-VV 定义了模态内匹配任务的神经基质。我们将跨模态区域定义为 AV-AA 和 AV-VV 定义的基因座的交集。听觉任务激活双侧颞上回和颞上沟、左侧颞平面和左侧舌回。视觉任务激活双侧额中回和下回、右侧枕颞交界处、顶内沟和左侧小脑。与 AA 和 VV 相比，AV 期间双侧背侧前运动皮层、后顶叶皮层（包括双侧顶上小叶和左侧顶内沟）和右侧小脑表现出更显着的激活。在这些区域内，后顶叶皮层在一致刺激下表现出比不一致刺激更多的激活，因此与跨模式结合有关。我们的结果表明，语音阅读过程中跨模态注意力控制与跨模态绑定之间存在密切关系。
We evaluated the neural substrates of cross-modal binding and divided attention during audio-visual speech integration using functional magnetic resonance imaging. The subjects (n = 17) were exposed to phonemically concordant or discordant auditory and visual speech stimuli. Three different matching tasks were performed: auditory-auditory (AA), visual-visual (VV) and auditory-visual (AV). Subjects were asked whether the prompted pair were congruent or not. We defined the neural substrates for the within-modal matching tasks by VV-AA and AA-VV. We defined the cross-modal area as the intersection of the loci defined by AV-AA and AV-VV. The auditory task activated the bilateral anterior superior temporal gyrus and superior temporal sulcus, the left planum temporale and left lingual gyrus. The visual task activated the bilateral middle and inferior frontal gyrus, right occipito-temporal junction, intraparietal sulcus and left cerebellum. The bilateral dorsal premotor cortex, posterior parietal cortex (including the bilateral superior parietal lobule and the left intraparietal sulcus) and right cerebellum showed more prominent activation during AV compared with AA and VV. Within these areas, the posterior parietal cortex showed more activation during concordant than discordant stimuli, and hence was related to cross-modal binding. Our results indicate a close relationship between cross-modal attentional control and cross-modal binding during speech reading.