CAREER: A Neuro-Ophthalmic Approach to Virtual Reality Research

虚拟现实(VR)包含了一系列直接与人交互的技术，通过取代或增强人们对周围世界的感知。尽管这些技术曾经是科幻小说，但现在它们变得负担得起，而且随处可见，可以用于从娱乐到医疗实践的一切领域。然而，目前的VR技术有时并不能很好地匹配人们的身体和感知特征；这些不匹配会使VR体验变得更糟，甚至对一些人来说无法使用。该项目旨在通过结合计算机科学、神经科学和眼科学的见解来推进VR研究，以改善VR系统与人的感知能力和身体特征之间的耦合。融合这些不同的视角将使人们有可能找到新的创新方法来改进VR技术，同时更好地理解人类的视觉。该项目对人与VR技术之间的关系采取了全面的视角。从根本上说，VR中呈现的图像经历了一系列截然不同的转换，包括渲染、经典光学、生理光学、感觉、感知、认知和由此产生的动作。要了解每个阶段的细微差别，就必须采用传统上与VR研究无关的方法，如整合眼科模型、神经成像技术、计算机数控系统等。例如，利用眼科模型，可以根据个人独特的眼睛结构创建定制的虚拟场景，从而增强空间保真度。此外，将神经成像与空间判断任务结合使用，将有助于识别对真实场景和虚拟场景的感知之间的神经区别。通过使用这些方法，该项目不仅旨在推动高保真虚拟环境的发展，而且还将揭示研究人类空间视觉的新方法。该项目团队还将为大学生开发新的跨学科课程材料，并为初中生举办研讨会，试图吸引各种各样的学生学习虚拟现实、感知及其相互作用。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Virtual reality (VR) encompasses an array of technologies that directly interface with people, either by replacing or enhancing their perception of the surrounding world. Though these technologies were once science fiction, they are now becoming both affordable and widely available, lending themselves to use in everything from entertainment to medical practice. However, current VR technologies are sometimes not well-matched to people's physical and perceptual characteristics; these mismatches can make VR experiences worse, even to the point of being unusable for some people. This project seeks to advance VR research by combining insights from computer science, neuroscience, and ophthalmology to improve the coupling between VR systems and people's perceptual abilities and physical features. Blending these different perspectives will make it possible to find new and innovative ways to improve VR technologies while better understanding human vision. This project adopts a comprehensive perspective on the relationship between humans and VR technology. Fundamentally, the imagery presented in VR undergoes a series of distinct transformations including rendering, classical optics, physiological optics, sensation, perception, cognition, and resulting actions. Understanding the nuanced contributions of each stage necessitates embracing methods not traditionally associated with VR research, such as integrating ophthalmic eye models, neuroimaging techniques, computer numerical control systems, and others. For instance, leveraging ophthalmic models allows for the creation of virtual scenes customized to individuals' unique eye structure, enabling enhanced spatial fidelity. Additionally, employing neuroimaging in conjunction with spatial judgment tasks will aid in identifying neural distinctions between perceptions of real and virtual scenes. By employing these methods, this project aims to not only advance the development of high-fidelity virtual environments but also unveil novel approaches to studying human spatial vision. The project team will also develop new interdisciplinary course materials for university students and workshops for middle and high school students that seek to attract a wide variety of students to learn about VR, perception, and their intersection.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.