Equipment for Neuroimaging of Virtual Stimuli and Virtual Interactions

越来越多的证据表明，刺激的真实性和对它们的反应会影响行为和大脑的处理。我们需要设备：(1)在3和7特斯拉的功能磁共振成像（fMRI）期间进行引人注目的双目3D显示；(2)在fMRI过程中测量眼球运动，以实现更真实的凝视策略；(3)在扫描仪中记录手部动作和其他动作的高分辨率视频。这个设备将在四个方面促进我们的研究。首先，3D投影仪将使我们能够建立在最近和正在进行的研究的基础上，这些研究显示了真实物体和真实动作与常见代理（图像和模拟动作）在大脑激活和模式上的差异。具体来说，它将允许我们确定刺激和任务的哪些方面是必不可少的，使参与者感到真实，并被大脑视为等同于真实。其次，在扫描仪中高度引人注目的物体和场景显示将成为合作研究计划的一部分，以开发新的范例，研究在虚拟环境中使用积极任务的大脑激活的主体间相关性，这些虚拟环境涉及广泛的感觉、认知和运动过程。第三，在扫描仪内双眼跟踪眼球运动的能力将使我们能够检查大脑激活或模式与凝视位置之间的相关性，而不是像fMRI研究中典型的那样不自然地限制凝视。第四，在扫描仪中记录高保真视频的能力将使我们能够描述手部动作并检查运动学和行为之间的相关性。总的来说，这些项目将通过增强范式的现实性和确保虚拟方面与真实现实相同的神经系统参与，推动认知神经科学向前发展。这些项目汇集了一批在视觉感知和行动方面具有专业知识的研究人员，增强了心理学和神经科学研究的真实感，使VR/AR适应实际应用，并利用功能磁共振成像和行为研究以前沿方法了解认知功能。鉴于虚拟现实（VR）和增强现实（AR）应用在模拟器培训、图像引导手术和康复以及手机和平板电脑上的消费应用的快速增长，该主题尤其及时。我们的工作将为技术发展提供信息，并为学员提供在行业工作或与行业联系的需求。

Growing evidence suggests that the realism of stimuli and actions toward them affects behavior and brain processing. We are requesting equipment to: (1) project compelling binocular 3D displays during functional magnetic resonance imaging (fMRI) at 3 and 7 Tesla; (2) measure eye movements during fMRI to enable more realistic gaze strategies; and (3) record high-resolution video of hand movements and other actions in the scanner. This equipment will advance our research in four ways. First, the 3D projector will enable us to build upon recent and ongoing research showing differences in brain activation and patterns for real objects and real actions vs. common proxies (images and simulated actions). Specifically, it will allow us to determine which aspects of stimuli and tasks are essential to make something feel real to the participant and be treated as equivalent to real by the brain. Second, highly compelling displays of objects and scenes in the scanner will form part of a collaborative research program to develop new paradigms to study intersubject correlations of brain activation using active tasks in virtual environments that engage a broad range of sensory, cognitive and motor processes. Third, the ability to track eye movements binocularly inside the scanner will enable us to examine correlations between brain activation or patterns and gaze location rather than restricting gaze unnaturally, as is typical in fMRI studies. Fourth, the ability to record high-fidelity video in the scanner will enable us to characterize hand actions and examine correlations between kinematics and behavior. Taken together, these projects will move cognitive neuroscience forward by enhancing the realism of paradigms and ensuring that the virtual aspects engage the same neural systems as true reality. The projects bring together a team of researchers with expertise in visual perception and action, enhancing realism of research in psychology and neuroscience, adapting VR/AR for practical applications, and using fMRI and behavioral studies to understand cognitive functions with cutting-edge approaches. The topic is particularly timely given the rapid growth of virtual reality (VR) and augmented reality (AR) applications for simulator training, image-guided surgery, and rehabilitation as well as consumer applications on phones and tablets. Our work will inform technological developments and provide a demand for trainees to work in or liaise with industry.