Equipment for Neuroimaging of Virtual Stimuli and Virtual Interactions

越来越多的证据表明，刺激和行动的现实性会影响行为和大脑处理。我们要求设备：（1）在3和7特斯拉的功能性磁共振成像（fMRI）过程中投射引人注目的双目3D显示;（2）在fMRI过程中测量眼球运动，以实现更逼真的凝视策略;（3）在扫描仪中记录手部运动和其他动作的高分辨率视频。这些设备将从四个方面推进我们的研究。首先，3D投影仪将使我们能够建立在最近和正在进行的研究的基础上，这些研究显示了真实的物体和真实的动作与普通代理（图像和模拟动作）的大脑激活和模式的差异。具体来说，它将使我们能够确定刺激和任务的哪些方面对于使参与者感觉到真实的并被大脑视为等同于真实的是必不可少的。第二，在扫描仪中高度引人注目的物体和场景显示将成为合作研究计划的一部分，以开发新的范式来研究在虚拟环境中使用主动任务的大脑激活的主体间相关性，这些虚拟环境涉及广泛的感官，认知和运动过程。第三，在扫描仪内双眼追踪眼球运动的能力将使我们能够检查大脑激活或模式与凝视位置之间的相关性，而不是像功能磁共振成像研究中典型的那样不自然地限制凝视。第四，在扫描仪中记录高保真视频的能力将使我们能够描述手部动作并检查运动学和行为之间的相关性。总之，这些项目将通过增强范式的真实性并确保虚拟方面与真实现实一样参与相同的神经系统来推动认知神经科学向前发展。这些项目汇集了一组具有视觉感知和行动专业知识的研究人员，增强了心理学和神经科学研究的现实性，使VR/AR适应实际应用，并使用fMRI和行为研究来了解认知功能。考虑到虚拟现实（VR）和增强现实（AR）在模拟器训练、图像引导手术和康复以及手机和平板电脑上的消费者应用的快速增长，这个主题特别及时。我们的工作将为技术发展提供信息，并为学员提供在工业界工作或与工业界联系的需求。

Growing evidence suggests that the realism of stimuli and actions toward them affects behavior and brain processing. We are requesting equipment to: (1) project compelling binocular 3D displays during functional magnetic resonance imaging (fMRI) at 3 and 7 Tesla; (2) measure eye movements during fMRI to enable more realistic gaze strategies; and (3) record high-resolution video of hand movements and other actions in the scanner. This equipment will advance our research in four ways. First, the 3D projector will enable us to build upon recent and ongoing research showing differences in brain activation and patterns for real objects and real actions vs. common proxies (images and simulated actions). Specifically, it will allow us to determine which aspects of stimuli and tasks are essential to make something feel real to the participant and be treated as equivalent to real by the brain. Second, highly compelling displays of objects and scenes in the scanner will form part of a collaborative research program to develop new paradigms to study intersubject correlations of brain activation using active tasks in virtual environments that engage a broad range of sensory, cognitive and motor processes. Third, the ability to track eye movements binocularly inside the scanner will enable us to examine correlations between brain activation or patterns and gaze location rather than restricting gaze unnaturally, as is typical in fMRI studies. Fourth, the ability to record high-fidelity video in the scanner will enable us to characterize hand actions and examine correlations between kinematics and behavior. Taken together, these projects will move cognitive neuroscience forward by enhancing the realism of paradigms and ensuring that the virtual aspects engage the same neural systems as true reality. The projects bring together a team of researchers with expertise in visual perception and action, enhancing realism of research in psychology and neuroscience, adapting VR/AR for practical applications, and using fMRI and behavioral studies to understand cognitive functions with cutting-edge approaches. The topic is particularly timely given the rapid growth of virtual reality (VR) and augmented reality (AR) applications for simulator training, image-guided surgery, and rehabilitation as well as consumer applications on phones and tablets. Our work will inform technological developments and provide a demand for trainees to work in or liaise with industry.