Hands-Free 2D & 3D Locomotion Interfaces for Virtual Reality and Telepresence

免提 2D

• 批准号: RGPIN-2020-05447
• 负责人: Riecke, Bernhard
• 金额: $ 3.5万
• 依托单位: Simon Fraser University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=717363
• 关键词: Hands; Free; 2D; 3D; Locomotion

Since ancient times, humans have dreamt of flying. Yet, despite technological advances, only a small fraction of humans (such as aircraft pilots) have the opportunity to fly themselves. Even for those few lucky ones however, flight is mediated through an aircraft and controllers. In this research program, I will investigate how we could use the power and increasing affordability of immersive virtual reality (VR) to provide a much wider audience with a truly embodied and compelling first-person locomotion experience, such as flying. Just like a bird or in dreams, VR offers the potential for humans to fly (or drive) unencumbered by any hand-held controllers. However, with current prevailing hand-controller based VR systems, users frequently experience motion sickness (35-95%), disorientation, high cognitive load, and reduced performance compared to natural walking. This critically impairs user experience and commercial success. The goal of my research program is to tackle these critical challenges, by designing motion sickness mitigation techniques and improved low-cost flying and driving interfaces. Specifically, we will expand our recent research on the innovative design, evaluation and examination of novel and highly efficient “leaning-based” interfaces where one can simply lean in the direction one wishes to travel in (similar to controlling a Segway), without the distraction of gamepads or other controllers. These interfaces will be designed to be accessible and easy to use for flying or driving through virtual environments, while reducing motion sickness and cognitive overload. Further, this program will investigate the most effective adaptation of these hands-free interfaces for usage with remote-controlled “telepresence robots”, such as camera-equipped flying quadcopter drones or driving conference robots (e.g., “Skype on wheels” increasingly used in workplaces). This unprecedented research will provide an opportunity for users to “be” somewhere else (“(tele)presence”) while having their hands free for other tasks. For instance, a user may sit/stand comfortably while wearing a head-mounted display showing an immersive view from the perspective of their flying drone. Simply by leaning, they can fly in any direction they desire, while having their hands free to zoom in and capture a stunning video. This research can improve numerous applications including architectural planning and walk/flythroughs; virtual tourism; immersive education, training, flight simulation, entertainment and gaming; and telepresent filming, photography, tourism, conferencing, and search-and-rescue. Improving telepresence can also help reduce needs to travel, benefiting workplace productivity, remote collaboration, and reducing environmental footprint. This program builds on more than 20 years of experience in using immersive multi-modal VR to study human perception, cognition, and performance, and applying this knowledge to design novel human-centred VR interfaces.

自古以来，人类就梦想着飞行。然而，尽管技术进步，只有一小部分人(如飞机飞行员)有机会自己飞行。然而，即使是对那些少数幸运儿来说，飞行也是通过飞机和管制员进行调解的。 在这个研究项目中，我将研究如何利用沉浸式虚拟现实(VR)的强大功能和日益增长的可负担性，为更广泛的受众提供真正体现和引人注目的第一人称移动体验，例如飞行。就像鸟或梦中的鸟一样，VR为人类提供了在不受任何手持控制器阻碍的情况下飞行(或驾驶)的潜力。然而，目前流行的基于手控制器的VR系统，与自然行走相比，用户经常经历晕车(35%-95%)、定向障碍、高认知负荷和性能下降。这严重损害了用户体验和商业成功。我的研究计划的目标是通过设计缓解晕动病的技术和改进低成本的飞行和驾驶界面来应对这些关键挑战。 具体地说，我们将扩大我们最近对创新设计、评估和检查新颖高效的“基于学习的”界面的研究，在这种界面中，人们可以简单地倾斜到希望移动的方向(类似于控制Segway)，而不会被游戏手柄或其他控制器分心。这些界面将被设计为易于访问和使用，用于在虚拟环境中飞行或驾车，同时减少晕车和认知过载。此外，该项目将研究如何最有效地调整这些免提界面，以用于远程控制的“远程呈现机器人”，例如配备摄像头的飞行四轴飞行器或驾驶会议机器人(例如，越来越多地在工作场所使用的“轮上Skype”)。这项史无前例的研究将为用户提供一个机会，让他们在其他地方“出现”(“(远程)呈现”)，同时腾出手来做其他任务。例如，用户可以舒适地坐/站，同时佩戴头盔显示器，从他们飞行的无人机的角度显示身临其境的景色。只需倾斜，它们就可以飞向任何他们想要的方向，同时腾出手来放大并捕捉令人惊叹的视频。 这项研究可以改进许多应用，包括建筑规划和漫游/飞行；虚拟旅游；身临其境的教育、培训、飞行模拟、娱乐和游戏；以及远程呈现拍摄、摄影、旅游、会议和搜救。改进网真还有助于减少出差需求，从而提高工作场所的工作效率、远程协作并减少对环境的影响。该项目基于20多年来使用沉浸式多模式VR研究人类感知、认知和性能的经验，并将这些知识应用于设计以人为中心的新型VR界面。