Multisensory integration, sensory recalibration, and the reduction of cross-modal perceptual discrepancies

多感官整合、感官重新校准和减少跨模式感知差异

• 批准号: 425795980
• 负责人: Professor Dr. Christoph Kayser
• 金额: --
• 依托单位: Arbeitsgruppe Kognitive Neurowissenschaften
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2019
• 资助国家: 德国
• 起止时间: 2018-12-31 至 2022-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/425795980?language=en
• 关键词: Multisensory; integration; sensory; recalibration; reduction

We experience the environment by combining information across our different senses. Often, these provide at least somewhat discrepant evidence, and our brain is faced with the challenge to merge this information into a coherent and unified percept. For example, when visual and auditory stimuli are presented at different locations, or when a hand movement ends at a location different from the one perceived visually, spatial biases influence our percepts. That is, the perceived location of an event deviates from the physical reality, or from what would be perceived if only a single stimulus had been present. Such cross-modal biases can arise from the discrepant multisensory information available at any given moment, a process known as multisensory integration. However, such biases can also arise from the adaptation to discrepancies in the multisensory environment that persist for minutes or longer, a process known as recalibration. While in typical experimental settings integration and recalibration emerge on distinct time scales, they are both central mechanisms to reduce apparent discrepancies in the available sensory information. We here propose to investigate the perceptual mechanisms underlying multisensory integration and recalibration, and how these interact to collectively shape perception. We focus on two paradigms: one relying on passive audio-visual perception, the other capitalizing the active interaction with the environment via hand movements under visual feedback (visuo-motor task), in order to distinguish results that generalize across modalities and the nature of the perceptual task from paradigm-specific results. We focus on three key hypotheses derived from previous work, each to be tested in a separate series of experiments: i) both processes are modulated in parallel by the observer’s belief that the apparently discrepant information actually arises from a common object; ii) both processes are affected in parallel by the relative reliabilities of the two modalities; and iii) integration and recalibration both work to ensure a coherent percept, but each by removing sensory discrepancies on distinct time scales. Knowledge of mechanisms that guide the interplay between multisensory integration and recalibration is paramount to understand how the brain flexibly adapts to the often volatile sensory evidence in real-life environments. In turn, this understanding can then be used to uncover the underlying neural mechanisms in the brain, and how perceptual challenges affect individuals with sensory disabilities, specific disorders, or during cognitive decline.

我们通过组合不同感官的信息来体验环境。通常情况下，这些至少提供了一些不一致的证据，我们的大脑面临着将这些信息合并成一个连贯统一的概念的挑战。例如，当视觉和听觉刺激出现在不同的位置时，或者当手部运动结束的位置与视觉感知的位置不同时，空间偏差会影响我们的感知。也就是说，事件的感知位置偏离了物理现实，或者偏离了如果只有一个刺激存在的话会被感知到的位置。这种跨模态偏差可能源于任何特定时刻可用的不一致的多感官信息，这一过程称为多感官整合。然而，这种偏差也可能来自于对多感官环境中持续数分钟或更长时间的差异的适应，这一过程被称为重新校准。虽然在典型的实验环境中，整合和重新校准出现在不同的时间尺度上，但它们都是减少可用感官信息中明显差异的核心机制。在这里，我们建议调查的感知机制的多感官整合和重新校准，以及这些如何相互作用，共同塑造感知。我们专注于两个范例：一个依赖于被动的视听感知，另一个利用在视觉反馈下通过手部运动与环境的主动交互（视觉运动任务），以便区分跨模态概括的结果和感知任务的性质与特定于范例的结果。我们集中在三个关键的假设来自以前的工作，每一个被测试在一个单独的一系列实验：i）这两个过程是平行调制的观察者的信念，显然不一致的信息实际上来自一个共同的对象; ii）这两个过程是平行影响的相对可靠性的两种方式;和iii）整合和重新校准都能确保连贯的感知，但每一种都是通过消除不同时间尺度上的感觉差异来实现的。了解引导多感觉整合和重新校准之间相互作用的机制对于理解大脑如何灵活地适应现实生活环境中经常波动的感觉证据至关重要。反过来，这种理解可以用来揭示大脑中潜在的神经机制，以及感知挑战如何影响感官残疾，特定疾病或认知衰退的个体。