Immersive Neuroscience: Bringing the Study of the Human Brain and Behavior Closer to Real Life

沉浸式神经科学：使人脑和行为的研究更接近现实生活

• 批准号: RGPIN-2022-04271
• 负责人: Culham, Jody
• 金额: $ 5.68万
• 依托单位: University of Western Ontario
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=763987
• 关键词: Immersive; Neuroscience; Bringing; Study; Human

The overarching goal of my research is to understand how the human brain uses vision to perceive the world and perform actions. The short-term goal for this granting period is to cultivate a new approach that I call Immersive Neuroscience to use novel technologies to study the brain and behavior in the real world and compelling simulations. Over my past three NSERC Discovery grants, I have developed techniques to study real actions and real objects using human neuroimaging (specifically functional magnetic resonance imaging, fMRI). This research suggests that real stimuli and real actions are more engaging -- both behaviorally and neurally -- than simulations (such as pantomimed actions and images), a phenomenon we call the "real-world advantage". While the results have been suggestive, using fMRI to study real situations is very challenging and has limitations. Emerging technologies are providing new ways forward for Immersive Neuroscience. First, 3D displays and virtual/augmented reality technologies enable the presentation of compelling real-world scenes, enabling cognitive neuroscience to move beyond heavy reliance on static 2D images. Second, new optical neuroimaging technologies (functional near infrared spectroscopy, fNIRS, and high-resolution approaches like the Kernel Flow) enable the measurement of cortical brain responses directly in the real world. My research program will pioneer new approaches with these technologies to bring cognitive neuroscience research closer to the real world. This grant will focus on the following three lines of research. First, I will examine how the human brain processes complex three-dimensional visual stimuli like faces, scenes and objects. Second, I will examine which aspects of realism (particularly 3D vision and actability) change behavior and brain responses to real objects and real people compared to images or videos. Third, I will examine how the brain functions during realistic tasks in which participants actively control their environments and get ongoing feedback. Immersive Neuroscience will provide rich opportunities for next-generation neuroscience to move closer to everyday life by pushing the realism of cognitive neuroscience while maintaining sufficient control for carefully designed experiments. This approach offers the potential to make innovative discoveries about the factors crucial to realism. Moreover, it enhances the likelihood of success for applications of virtual reality (e.g., training, image-guided surgery) and optical neuroimaging (e.g., brain-computer interfaces).

我研究的首要目标是了解人类大脑如何使用视觉来感知世界和执行动作。这段时间的短期目标是培养一种新的方法，我称之为沉浸式神经科学，使用新技术来研究真实的世界和令人信服的模拟中的大脑和行为。在我过去的三次NSERC发现赠款中，我开发了使用人类神经成像（特别是功能性磁共振成像，fMRI）研究真实的行为和真实的物体的技术。这项研究表明，真实的刺激和真实的动作在行为和神经上都比模拟（如哑剧动作和图像）更具吸引力，我们称之为“现实世界优势”。虽然研究结果具有启发性，但使用功能磁共振成像研究真实的情况非常具有挑战性，并且具有局限性。新兴技术为沉浸式神经科学提供了新的发展方向。首先，3D显示和虚拟/增强现实技术能够呈现引人注目的现实世界场景，使认知神经科学超越对静态2D图像的严重依赖。其次，新的光学神经成像技术（功能性近红外光谱、fNIRS和高分辨率方法，如Kernel Flow）能够直接在真实的世界中测量大脑皮层的反应。我的研究计划将利用这些技术开拓新的方法，使认知神经科学研究更接近真实的世界。该基金将重点关注以下三个方面的研究。首先，我将研究人类大脑如何处理复杂的三维视觉刺激，如面部，场景和物体。其次，我将研究现实主义的哪些方面（特别是3D视觉和可操作性）与图像或视频相比，会改变行为和大脑对真实的物体和真实的人的反应。第三，我将研究在参与者主动控制环境并获得持续反馈的现实任务中，大脑是如何运作的。 沉浸式神经科学将为下一代神经科学提供丰富的机会，通过推动认知神经科学的现实主义，同时保持对精心设计的实验的充分控制，使其更接近日常生活。这种方法提供了对现实主义的关键因素进行创新发现的潜力。此外，它提高了虚拟现实应用成功的可能性（例如，训练，图像引导手术）和光学神经成像（例如，脑机接口）。