The optimal time window of visual-auditory integration: a reaction time analysis.
The optimal time window of visual-auditory integration: a reaction time analysis.
复制标题
DOI：
10.3389/fnint.2010.00011
复制
发表时间：
2010
影响因子：
3.5
通讯作者：
Diederich A
中科院分区：
文献类型：
--
作者：
Colonius H;Diederich A
整合的时空窗口已经成为多感觉研究中广泛接受的概念：落在这个窗口内的跨通道信息很可能被整合，而落在窗口外的信息则不被整合。在这里，我们进一步探讨这个概念的反应时间的背景下，冗余的跨模态目标。无限大的时间窗口将导致强制积分，零宽度的时间窗口将完全排除积分。明确假设由跨模态刺激集触发的外周感觉处理时间之间的到达时间差，我们推导出一个决策规则，该规则确定最佳窗口宽度作为（i）有利于共同多感觉源的先验概率，（ii）到达时间差的可能性，以及（iii）做出正确或错误决策的回报的函数;此外，我们建议了一个详细的实验装置来验证理论。我们的方法是符合成熟的框架建模多感官整合（近）最佳决策，但没有这些研究，据我们所知，已考虑反应时间作为可观察的变量。该理论可以很容易地扩展到集中注意力范式下收集的反应时间。可能的变体的理论来解释判断的crossmodal的一致性进行了讨论。最后，神经基础的理论在初级感觉皮层的振荡反应的假设。
The spatiotemporal window of integration has become a widely accepted concept in multisensory research: crossmodal information falling within this window is highly likely to be integrated, whereas information falling outside is not. Here we further probe this concept in a reaction time context with redundant crossmodal targets. An infinitely large time window would lead to mandatory integration, a zero-width time window would rule out integration entirely. Making explicit assumptions about the arrival time difference between peripheral sensory processing times triggered by a crossmodal stimulus set, we derive a decision rule that determines an optimal window width as a function of (i) the prior odds in favor of a common multisensory source, (ii) the likelihood of arrival time differences, and (iii) the payoff for making correct or wrong decisions; moreover, we suggest a detailed experimental setup to test the theory. Our approach is in line with the well-established framework for modeling multisensory integration as (nearly) optimal decision making, but none of those studies, to our knowledge, has considered reaction time as observable variable. The theory can easily be extended to reaction times collected under the focused attention paradigm. Possible variants of the theory to account for judgments of crossmodal simultaneity are discussed. Finally, neural underpinnings of the theory in terms of oscillatory responses in primary sensory cortices are hypothesized.