Predicting the multisensory future: Role of neuronal connectivity for integrative information processing across modalities

在自然情况下，我们不断地监测和整合进入我们感觉系统的多种输入。例如，当在忙碌的街道上骑自行车时，整合其他车辆的声音和景象是很重要的。根据各种方式的感官线索预测其他道路使用者的行为对我们的生存至关重要。最近的电生理学研究提供的证据表明，正在进行的振荡和皮层网络中的神经元连接的整合和即将到来的多感官刺激的感知起着至关重要的作用。持续的振荡究竟如何影响多感官刺激的处理和感知还没有很好的理解。此外，只有少数研究调查了多感觉整合中隐含的皮层网络内的神经元连接和信息流。这个建议的中心目标是解决正在进行的振荡，神经元连接，以及皮质网络内的信息流如何影响即将到来的多感官刺激的整合和感知。该项目将针对两个互补的研究问题：1）正在进行的振荡活动对即将到来的多感官刺激的处理和感知的作用是什么？2）初级感觉、多感觉和高级皮层区域在多感觉知觉之前和期间如何相互作用？这些问题将在一系列人类实验中得到解决，包括视听错觉范例。拟议的实验包括经颅磁刺激和脑电图结合国家的最先进的源分析方法。这个项目的结果将大大促进我们对皮层网络中正在进行的处理如何调节感知和整合感官刺激的理解。

In natural situations, we continuously monitor and integrate the multiple inputs that enter our sensory system. For instance, when cycling on a busy street it is important to integrate the sounds and sights of other vehicles. Predicting behaviour of other road users based on sensory cues across modalities is essential for our survival. Recent electrophysiological studies have provided evidence that ongoing oscillations and neuronal connectivity in cortical networks play a crucial role for the integration and perception of upcoming multisensory stimuli. How exactly ongoing oscillations affect processing and perception of multisensory stimuli is not well understood. Moreover, there are only a few studies that have investigated neuronal connectivity and the flow of information within cortical networks implied in multisensory integration. The central goal of this proposal is to address how ongoing oscillations, neuronal connectivity, and information flow within cortical networks influence the integration and perception of upcoming multisensory stimuli. The project will target two complementary research questions: 1) What is the role of ongoing oscillatory activity for the processing and perception of forthcoming multisensory stimuli? and 2) How do primary sensory, multisensory and higher-order cortical areas interact prior to and during multisensory perception? These questions will be addressed in a series of experiments in humans comprising of audiovisual illusion paradigms. The proposed experiments include transcranial magnetic stimulation and electroencephalography in combination with state-of-the-art source analysis approaches. The outcome of this project will substantially further our understanding of how ongoing processing in cortical networks modulate the perception and integration of sensory stimuli across modalities.