CAREER: A Neuro-Ophthalmic Approach to Virtual Reality Research

虚拟现实（VR）包括一系列直接与人交互的技术，通过取代或增强他们对周围世界的感知。虽然这些技术曾经是科幻小说，但它们现在变得既负担得起又广泛可用，从娱乐到医疗实践，它们都可以使用。然而，目前的VR技术有时与人们的身体和感知特征并不匹配;这些不匹配会使VR体验变得更糟，甚至对某些人来说无法使用。该项目旨在通过结合计算机科学、神经科学和眼科学的见解来推进VR研究，以改善VR系统与人的感知能力和身体特征之间的耦合。将这些不同的视角融合在一起，将有可能找到新的创新方法来改进VR技术，同时更好地理解人类视觉。该项目采用全面的视角来看待人类与VR技术之间的关系。从根本上讲，VR中呈现的图像经历了一系列不同的转换，包括渲染，经典光学，生理光学，感觉，感知，认知和由此产生的动作。了解每个阶段的细微贡献需要采用传统上与VR研究无关的方法，例如整合眼科眼睛模型，神经成像技术，计算机数控系统等。例如，利用眼科模型允许创建针对个人独特眼睛结构定制的虚拟场景，从而实现增强的空间保真度。此外，将神经成像与空间判断任务结合使用将有助于识别真实的和虚拟场景感知之间的神经区别。通过采用这些方法，该项目的目标不仅是推进高保真虚拟环境的发展，而且还揭示了研究人类空间视觉的新方法。此外，还将开发面向大学生的新的跨学科课程教材，以及面向初中和高中生的研讨会，旨在吸引各种各样的学生学习VR、感知及其交叉点。该奖项体现了NSF的法定使命，通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

Virtual reality (VR) encompasses an array of technologies that directly interface with people, either by replacing or enhancing their perception of the surrounding world. Though these technologies were once science fiction, they are now becoming both affordable and widely available, lending themselves to use in everything from entertainment to medical practice. However, current VR technologies are sometimes not well-matched to people's physical and perceptual characteristics; these mismatches can make VR experiences worse, even to the point of being unusable for some people. This project seeks to advance VR research by combining insights from computer science, neuroscience, and ophthalmology to improve the coupling between VR systems and people's perceptual abilities and physical features. Blending these different perspectives will make it possible to find new and innovative ways to improve VR technologies while better understanding human vision. This project adopts a comprehensive perspective on the relationship between humans and VR technology. Fundamentally, the imagery presented in VR undergoes a series of distinct transformations including rendering, classical optics, physiological optics, sensation, perception, cognition, and resulting actions. Understanding the nuanced contributions of each stage necessitates embracing methods not traditionally associated with VR research, such as integrating ophthalmic eye models, neuroimaging techniques, computer numerical control systems, and others. For instance, leveraging ophthalmic models allows for the creation of virtual scenes customized to individuals' unique eye structure, enabling enhanced spatial fidelity. Additionally, employing neuroimaging in conjunction with spatial judgment tasks will aid in identifying neural distinctions between perceptions of real and virtual scenes. By employing these methods, this project aims to not only advance the development of high-fidelity virtual environments but also unveil novel approaches to studying human spatial vision. The project team will also develop new interdisciplinary course materials for university students and workshops for middle and high school students that seek to attract a wide variety of students to learn about VR, perception, and their intersection.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.