Hands-Free 2D & 3D Locomotion Interfaces for Virtual Reality and Telepresence

免提 2D

• 批准号: RGPIN-2020-05447
• 负责人: Riecke, Bernhard
• 金额: $ 3.5万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2021
• 资助国家: 加拿大
• 起止时间: 2021-01-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=740201
• 关键词: Hands; Free; 2D; 3D; Locomotion

Since ancient times, humans have dreamt of flying. Yet, despite technological advances, only a small fraction of humans (such as aircraft pilots) have the opportunity to fly themselves. Even for those few lucky ones however, flight is mediated through an aircraft and controllers. In this research program, I will investigate how we could use the power and increasing affordability of immersive virtual reality (VR) to provide a much wider audience with a truly embodied and compelling first-person locomotion experience, such as flying. Just like a bird or in dreams, VR offers the potential for humans to fly (or drive) unencumbered by any hand-held controllers. However, with current prevailing hand-controller based VR systems, users frequently experience motion sickness (35-95%), disorientation, high cognitive load, and reduced performance compared to natural walking. This critically impairs user experience and commercial success. The goal of my research program is to tackle these critical challenges, by designing motion sickness mitigation techniques and improved low-cost flying and driving interfaces. Specifically, we will expand our recent research on the innovative design, evaluation and examination of novel and highly efficient "leaning-based" interfaces where one can simply lean in the direction one wishes to travel in (similar to controlling a Segway), without the distraction of gamepads or other controllers. These interfaces will be designed to be accessible and easy to use for flying or driving through virtual environments, while reducing motion sickness and cognitive overload. Further, this program will investigate the most effective adaptation of these hands-free interfaces for usage with remote-controlled "telepresence robots", such as camera-equipped flying quadcopter drones or driving conference robots (e.g., "Skype on wheels" increasingly used in workplaces). This unprecedented research will provide an opportunity for users to "be" somewhere else ("(tele)presence") while having their hands free for other tasks. For instance, a user may sit/stand comfortably while wearing a head-mounted display showing an immersive view from the perspective of their flying drone. Simply by leaning, they can fly in any direction they desire, while having their hands free to zoom in and capture a stunning video. This research can improve numerous applications including architectural planning and walk/flythroughs; virtual tourism; immersive education, training, flight simulation, entertainment and gaming; and telepresent filming, photography, tourism, conferencing, and search-and-rescue. Improving telepresence can also help reduce needs to travel, benefiting workplace productivity, remote collaboration, and reducing environmental footprint. This program builds on more than 20 years of experience in using immersive multi-modal VR to study human perception, cognition, and performance, and applying this knowledge to design novel human-centred VR interfaces.

自古以来，人类就梦想着飞行。然而，尽管技术进步，只有一小部分人（比如飞行员）有机会自己驾驶飞机。然而，即使是那些少数幸运的人，飞行也是通过飞机和控制人员来调节的。在这个研究项目中，我将研究我们如何利用沉浸式虚拟现实（VR）的力量和日益增长的可负担性，为更广泛的受众提供真正体现和引人注目的第一人称运动体验，比如飞行。就像一只鸟或在梦中一样，VR为人类提供了不受任何手持控制器阻碍的飞行（或驾驶）的可能性。然而，与自然行走相比，目前流行的基于手控的VR系统，用户经常会出现晕动病（35-95%）、定向障碍、高认知负荷和性能下降。这严重损害了用户体验和商业成功。我的研究计划的目标是解决这些关键的挑战，通过设计晕动病缓解技术和改进的低成本飞行和驾驶接口。具体来说，我们将扩大我们最近对创新设计的研究，评估和检查新颖高效的“基于学习的”界面，人们可以简单地向自己希望旅行的方向倾斜（类似于控制赛格威），而不需要游戏手柄或其他控制器的干扰。这些界面将被设计成易于访问和易于使用，用于在虚拟环境中飞行或驾驶，同时减少晕动病和认知超载。此外，该计划将调查最有效地适应这些免提接口与遥控“远程呈现机器人”的使用，如配备摄像头的飞行四轴飞行器或驾驶会议机器人（例如，“Skype上的轮子”越来越多地在工作场所使用）。这项前所未有的研究将为用户提供一个机会，让他们“在”其他地方（“（远程）存在”），同时腾出双手去做其他事情。例如，用户可以舒适地坐着/站着，同时戴着头戴式显示器，从他们飞行的无人机的角度显示沉浸式视图。只需倾斜，它们就可以朝任何想要的方向飞行，同时腾出双手放大并捕捉令人惊叹的视频。这项研究可以改善许多应用，包括建筑规划和行走/飞越；虚拟旅游;沉浸式教育、培训、飞行模拟、娱乐、游戏；以及远程拍摄、摄影、旅游、会议和搜救。改进远程呈现还可以帮助减少出差需求，有利于工作场所的生产力、远程协作和减少环境足迹。该计划建立在使用沉浸式多模态VR研究人类感知，认知和表现的20多年经验的基础上，并将这些知识应用于设计新颖的以人为中心的VR界面。