Temporal structure and complexity affect audio-visual correspondence detection
Temporal structure and complexity affect audio-visual correspondence detection
复制标题
DOI：
10.3389/fpsyg.2012.00619
复制
发表时间：
2013-01-01
影响因子：
3.8
通讯作者：
Ruff, Christian C.
中科院分区：
文献类型：
--
作者：
Denison, Rachel N.;Driver, Jon;Ruff, Christian C.
不同感觉中的事件之间的同步性一直被认为是多感觉整合的关键时间线索。在这里，使用听觉和视觉事件的快速流，我们演示了人类如何使用时间结构（而不仅仅是时间巧合）来检测多感官相关性。我们发现psychopathically，参与者可以检测匹配的听觉和视觉流，通过共享的时间结构的crossmodal滞后高达200毫秒。在这个任务上的表现再现了过去的研究结果的基础上明确的时间判断的功能，但没有表现出任何特殊的优势，完美的同步流。重要的是，时间模式的复杂性影响对对应的敏感性。随机的，不规则的流-更丰富的时间模式信息-导致更高的视听匹配灵敏度比可预测的，有节奏的流。我们的研究结果表明，时间结构及其复杂性是人类检测视听对应的关键决定因素。我们的新范式对时间模式的独特强调可能有助于研究视听时间感知和多感觉整合可疑异常的特殊人群。
Synchrony between events in different senses has long been considered the critical temporal cue for multisensory integration. Here, using rapid streams of auditory and visual events, we demonstrate how humans can use temporal structure (rather than mere temporal coincidence) to detect multisensory relatedness. We find psychophysically that participants can detect matching auditory and visual streams via shared temporal structure for crossmodal lags of up to 200 ms. Performance on this task reproduced features of past findings based on explicit timing judgments but did not show any special advantage for perfectly synchronous streams. Importantly, the complexity of temporal patterns influences sensitivity to correspondence. Stochastic, irregular streams - with richer temporal pattern information - led to higher audio-visual matching sensitivity than predictable, rhythmic streams. Our results reveal that temporal structure and its complexity are key determinants for human detection of audio-visual correspondence. The distinctive emphasis of our new paradigms on temporal patterning could be useful for studying special populations with suspected abnormalities in audio-visual temporal perception and multisensory integration.