CHS: Small: A Spatial Cognitive Framework For Personalizing Locomotion in Virtual Environments

CHS：小：虚拟环境中个性化运动的空间认知框架

• 批准号: 1816029
• 负责人: Jonathan Kelly
• 金额: $ 49.97万
• 依托单位: Iowa State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-08-01 至 2022-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1816029&HistoricalAwards=false
• 关键词: CHS; Small; Spatial; Cognitive; Framework

The availability of low-cost head-mounted displays has made virtual reality affordable to consumers and there are now millions of virtual reality users worldwide. The most natural way to explore a virtual environment is to walk and turn, just as one does when exploring a real environment. However, many virtual reality systems lack necessary technology to allow physical walking, and those that do allow physical walking provide only limited walking space. Therefore, virtual reality users must rely on navigation interfaces to fully explore the virtual environment. Perhaps the most common technique is the teleport interface, in which the user points a virtual laser pointer to the desired location in the virtual environment and is then directly transported to that location. The teleport interface is easy to learn but lacks body-based cues normally associated with walking, such as leg movement and sense of balance, which can cause rapid disorientation. This project's goals are to evaluate the effects of the teleport interface on navigation and to identify ways to help users stay oriented when using the teleport interface. Teleporting is likely to be especially disorienting for some users, such as those with low spatial ability, so this project incorporates a personalized approach to determine the amount of and type of adaptive navigation support that should be provided to a given user. Findings from this project will support creation of the Design of Virtual Environments (DOVE) website, a public Wikipedia-style site for research-based guidelines from virtual reality research, along with materials to support both undergraduate and graduate education and outreach to programs targeted at broadening participation in computing.This project uses a novel framework based on concordance/discordance between movement through a virtual environment (VE) and movement of the user's body. Within this framework, this project evaluates the impact of three common navigation interfaces (walking, teleporting to change position, and teleporting to change position and orientation) and several types of environmental cues on users' ability to perform two fundamental navigation tasks. The first task, spatial updating, involves keeping track of self-location and orientation when moving through space, answering the question, "Where am I?" Disorientation represents a failure of spatial updating. Accurate spatial updating is critical for a successful VE, particularly in time-sensitive domains such as remote medical assistance and training for extreme workplace circumstances. The second task, cognitive map formation, involves storing experienced locations and relationships between them in memory, and is critical for tasks that involve navigation to remembered locations or selection of alternative routes or shortcuts, e.g., "How do I get there?" The results from a series of experiments will be used to make evidence-based recommendations for navigation interfaces and aids that VR designers should ideally include in a VE, either uniformly or using an adaptive personalized approach based on users' spatial abilities or other individual differences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

低成本的头部安装显示器的可用性使消费者负担得起虚拟现实，现在全球有数百万个虚拟现实用户。 探索虚拟环境的最自然方法是走路和转弯，就像探索真实环境时一样。 但是，许多虚拟现实系统缺乏允许物理步行的必要技术，而那些确实允许物理步行的技术仅提供有限的步行空间。 因此，虚拟现实用户必须依靠导航接口来充分探索虚拟环境。 也许最常见的技术是传送接口，其中用户指向虚拟激光指针指向虚拟环境中所需的位置，然后直接将其直接运输到该位置。 传送界面很容易学习，但缺乏通常与步行相关的身体线索，例如腿部运动和平衡感，这可能会引起快速迷失方向。 该项目的目标是评估传送接口对导航的影响，并确定使用传送接口时帮助用户保持定向的方法。 对于某些用户，例如具有较低空间能力的用户，传送可能会特别迷失方向，因此该项目结合了一种个性化方法，以确定应向给定用户提供的自适应导航支持的数量和类型。 该项目的调查结果将支持创建虚拟环境设计（Dove）网站，这是一个公共Wikipedia风格的网站，用于虚拟现实研究的基于研究指南，以及支持本科和研究生教育的材料，以及针对范围扩大计算参与的计划的本科教育和计划。这些项目都基于与一致性/不一致的环境（通过环境之间的动作）（ve）（VEV）（VEV）。 在此框架内，该项目评估了三个通用导航接口（步行，传送到更改位置，转移到更改位置和方向）的影响以及几种类型的环境线索对用户执行两项基本导航任务的能力。空间更新的第一项任务涉及跟踪在太空中移动时的自我定位和方向，回答“我在哪里？”的问题。迷失方向代表空间更新的失败。准确的空间更新对于成功的VE至关重要，尤其是在时间敏感的领域，例如远程医疗援助和针对极端工作环境的培训。第二个任务是认知地图的形成，涉及将经验丰富的位置和它们之间的关系存储在内存中，并且对于涉及导航的任务至关重要，该任务涉及导航以记住位置或选择替代路线或快捷方式，例如“我如何到达那里？”一系列实验的结果将用于为VR设计者理想地包括在VE中包括的导航界面和辅助设备提供基于证据的建议，无论是均匀或使用基于用户的空间能力或其他个性化差异的自适应个性化方法，该奖项反映了NSF的法定任务，反映了通过评估范围的范围，并通过评估了范围的范围。

项目成果

The Effectiveness of Locomotion Interfaces Depends on Self-Motion Cues, Environmental Cues, and the Individual

运动界面的有效性取决于自我运动线索、环境线索和个人

• DOI: 10.1109/vrw52623.2021.00082
• 发表时间: 2021
• 期刊: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW
• 作者: Kelly, Jonathan W.;Gilbert, Stephen B.
• 通讯作者: Gilbert, Stephen B.

Teleporting through virtual environments: Effects of path scale and environment scale on spatial updating

• DOI: 10.1109/tvcg.2020.2973051
• 发表时间: 2020-05-01
• 期刊: IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
• 影响因子: 5.2
• 作者: Kelly, Jonathan W.;Ostrander, Alec G.;Gilbert, Stephen B.
• 通讯作者: Gilbert, Stephen B.

Rotational Self-motion Cues Improve Spatial Learning when Teleporting in Virtual Environments

旋转自运动提示可改善虚拟环境中传送时的空间学习

• DOI: 10.1145/3385959.3418443
• 发表时间: 2020
• 期刊: Symposium on Spatial User Interaction
• 作者: Lim, Alex F.;Kelly, Jonathan W.;Sepich, Nathan C.;Cherep, Lucia A.;Freed, Grace C.;Gilbert, Stephen B.
• 通讯作者: Gilbert, Stephen B.

Teleporting through virtual environments: benefits of navigational feedback and practice

通过虚拟环境传送：导航反馈和实践的好处

• DOI: 10.1007/s10055-022-00737-0
• 发表时间: 2023
• 期刊: Virtual Reality
• 影响因子: 4.2
• 作者: Kelly, Jonathan W.;Powell, Nicole;Hoover, Melynda;Gilbert, Stephen B.
• 通讯作者: Gilbert, Stephen B.

Boundaries Reduce Disorientation in Virtual Reality

• DOI: 10.3389/frvir.2022.882526
• 发表时间: 2022-01-01
• 期刊: Frontiers in Virtual Reality
• 作者: Kelly, J. W.;Doty, T. A.;Gilbert, S. B.
• 通讯作者: Gilbert, S. B.