Multisensory perception: Audiovisual interactions under dynamic conditions

项目总结 这项研究调查了听觉刺激影响的感觉间机制。 视觉感知。单细胞神经生理学、事件相关脑电位和功能的发现 核磁共振成像显示，曾经被认为是单一感觉的皮质区域的神经元可以受到刺激的驱动 来自多个医疗机构。此外，多感官驱动活动的时机是这样的，它不太可能 因为只是从解剖学上后来的大脑皮层区域反馈。最近报道的一系列行为影响 显示了与信息无关但同时呈现的视觉感知的增强 听觉刺激似乎是这些多感官机制的表现。然而，到目前为止，这些 影响还没有从任何常见的感觉间机制的角度来理解。 这项研究测试了视听时间封装假说，该假说表明一个突然的 瞬时听觉刺激定义了一个时间窗口，在该时间窗口内视觉刺激的表示 出现在时间窗口中，与时间周围视觉信息的交互隔离。这 假设可以解释上面回顾的所有影响，并且它做出了超出这些的新预测， 这些都是本提案的重点。值得注意的是，已经报道的感觉间影响 这些文献主要是伴随听觉刺激促进视觉的例子。新的预测 我们从视听时间封装假说中得出的结论是视觉受损的例子 伴随的听觉刺激的知觉，这使得它们在检验假设方面特别强大。 一般的想法是，如果视觉信息被伴随的听觉刺激所封装，那么它就会遵循 需要将封装的可视信息与在 不同的时间会受到影响。这一想法将在三个具体目标上得到检验。特定目标1测试以下各项的效果 视觉整合任务中的听觉刺激。特定目标2测试听觉刺激对过程的影响 通过这种方式，运动刺激的可见持续性被主动抑制，称为运动去模糊。特定的 目的3测试听觉刺激对视觉信息被抑制的过程的影响 眼球运动，称为眼跳抑制。 如果得到证实，视听时间封装假说可以解释为什么人们易受影响。 当从事主要是视觉任务(例如，驾驶)时，会导致听觉分心。此外， 包埋过程可能是一种机制，在受损状态下容易因药物、酒精而失败 或疾病。这也可能是一种随年龄增长而衰退的机制。

PROJECT SUMMARY This research investigates intersensory mechanisms that underlie the influence of auditory stimuli on visual perception. Findings from single-cell neurophysiology, event-related brain potentials, and functional MRI indicate that neurons in cortical areas that were once thought to be unisensory can be driven by stimuli from multiple modalities. Moreover, the timing of multisensory-driven activity is such that it is unlikely to be due to just to feedback from anatomically later cortical areas. A set of recently reported behavioral effects showing the enhancement of visual perception from informationally unrelated but concomitantly presented auditory stimuli seem to be manifestations of these multisensory mechanisms. To date, however, these effects have not been understood in terms of any common intersensory mechanism. This research tests the audiovisual temporal-encapsulation hypothesis which states that an abrupt transient auditory stimulus defines a temporal window within which the representation of visual stimuli that appear in that time window are isolated from interaction with temporally surrounding visual information. This hypothesis can account for all of the effects reviewed above and it makes novel predictions beyond these, which are the focus of the present proposal. Significantly, the intersensory effects that have been reported in the literature are primarily examples of visual facilitation by concomitant auditory stimuli. The new predictions that we have derived from the audiovisual temporal encapsulation hypothesis are examples of impaired visual perception by concomitant auditory stimuli, which make them especially powerful for testing the hypothesis. The general idea is that if visual information is encapsulated by concomitant auditory stimuli, then it follows that tasks that require integration of that encapsulated visual information with information sampled at a different time will be impaired. This idea will be tested in three specific aims. Specific Aim 1 tests the effects of auditory stimuli in a visual integration task. Specific Aim 2 tests the effects of auditory stimuli on the processes by which visible persistence for moving stimuli is actively suppressed known, as motion deblurring. Specific Aim 3 tests the effects of auditory stimuli on the processes by which visual information is suppressed during eye movements, known as saccadic suppression. If confirmed, the audiovisual temporal-encapsulation hypothesis could explain why people are susceptible to auditory distraction when engaged in what are primarily visual tasks (e.g., driving). Moreover, the encapsulation process might be a mechanism that is subject to failure in impaired states due to drugs, alcohol or disease. It may also be a mechanism that is subject to decline with age.