Predicting the multisensory future: Role of neuronal connectivity for integrative information processing across modalities

在自然情况下，我们不断地监控和整合进入我们感官系统的多种输入。例如，当在繁忙的街道上骑自行车时，整合其他车辆的声音和视觉是很重要的。根据感官线索预测其他道路使用者的行为对于我们的生存至关重要。最近的电生理学研究表明，皮层网络中的持续振荡和神经元连接对即将到来的多感觉刺激的整合和感知起着至关重要的作用。持续的振荡究竟如何影响多感官刺激的处理和感知，目前还不是很清楚。此外，只有几项研究研究了多感觉整合所隐含的神经元连接和皮质网络内的信息流。这项建议的中心目标是解决正在进行的振荡、神经元连接和皮质网络内的信息流如何影响即将到来的多感觉刺激的整合和感知。该项目将针对两个互补的研究问题：1)正在进行的振荡活动对即将到来的多感觉刺激的处理和感知起什么作用？2)在多感觉知觉之前和期间，初级感觉、多感觉和高级皮层区域是如何相互作用的？这些问题将在包括视听错觉范例的一系列人类实验中得到解决。拟议的实验包括经颅磁刺激和脑电图术，并结合最先进的源分析方法。这个项目的结果将大大加深我们对大脑皮层网络中正在进行的处理如何调节感觉刺激的感知和跨通道整合的理解。

In natural situations, we continuously monitor and integrate the multiple inputs that enter our sensory system. For instance, when cycling on a busy street it is important to integrate the sounds and sights of other vehicles. Predicting behaviour of other road users based on sensory cues across modalities is essential for our survival. Recent electrophysiological studies have provided evidence that ongoing oscillations and neuronal connectivity in cortical networks play a crucial role for the integration and perception of upcoming multisensory stimuli. How exactly ongoing oscillations affect processing and perception of multisensory stimuli is not well understood. Moreover, there are only a few studies that have investigated neuronal connectivity and the flow of information within cortical networks implied in multisensory integration. The central goal of this proposal is to address how ongoing oscillations, neuronal connectivity, and information flow within cortical networks influence the integration and perception of upcoming multisensory stimuli. The project will target two complementary research questions: 1) What is the role of ongoing oscillatory activity for the processing and perception of forthcoming multisensory stimuli? and 2) How do primary sensory, multisensory and higher-order cortical areas interact prior to and during multisensory perception? These questions will be addressed in a series of experiments in humans comprising of audiovisual illusion paradigms. The proposed experiments include transcranial magnetic stimulation and electroencephalography in combination with state-of-the-art source analysis approaches. The outcome of this project will substantially further our understanding of how ongoing processing in cortical networks modulate the perception and integration of sensory stimuli across modalities.