Enabling effective human spatial orientation and behaviour in virtual environments

目标：调查是什么构成了有效的、稳健的和直观的人类空间定向和行为。这些基本知识将被应用于设计新颖、更有效的人机界面和交互范例，使类似的过程能够在虚拟现实(VR)和多媒体等计算机中介环境中进行。动机：虽然现代虚拟现实模拟可以拥有令人惊叹的照片真实感，但它们通常无法提供在模拟世界中穿行的逼真和令人信服的感觉，从而限制了感知的真实感、行为有效性、用户接受度和商业成功。方法：我建议调查和利用自我运动错觉可能是一种简单而优雅的方式来克服这些缺点，并在计算机中介的环境中提供真正的“移动体验”。多模式、自然主义和身临其境的虚拟现实提供了一个独特的机会，在一个封闭的动作-感知回路中，在可重复、明确定义和可控制的实验条件下研究人类的感知和行为。短期/中期目标：在VR中对天真的人类参与者进行实验，以调查和优化多模式和更高水平的贡献和交互作用，以实现空间定向和自我运动感知，同时将参照系冲突降至最低。长期目标：研究如何在虚拟现实中最好地利用自我运动错觉，使虚拟现实中的空间定向和行为更逼真、健壮和毫不费力。意义：这项研究将导致对人类感知和行为的更深入理解，使我们能够设计更有效的人机界面和交互范式。特别是，应用研究将确定感知/行动的基本参数，并指出使我们能够在模拟虚拟现实时欺骗大脑的“盲点”。这将为许多应用创造更好、更具成本效益的虚拟解决方案，如驾驶/飞行模拟、太空探索、教育、游戏、工程、娱乐、紧急培训、视频会议、微创手术和远程医疗。

GOAL: To investigate what constitutes effective, robust, and intuitive human spatial orientation and behaviour. This fundamental knowledge will be applied to design novel, more effective human-computer interfaces and interaction paradigms that enable similar processes in computer-mediated environments like virtual reality (VR) and multi-media. MOTIVATION: While modern VR simulations can have stunning photorealism, they are typically unable to provide a life-like and compelling sensation of moving through the simulated world, thus limiting perceived realism, behavioural effectiveness, user acceptance, and commercial success. APPROACH: I propose that investigating and exploiting self-motion illusions might be a lean and elegant way to overcome such shortcomings and provide a truly "moving experience" in computer-mediated environments. Multi-modal, naturalistic and immersive VR provides a unique opportunity to study human perception and behaviour in reproducible, clearly defined and controllable experimental conditions in a closed action-perception loop. SHORT/MID-TERM GOALS: To perform experiments with naïve human participants in VR to investigate and optimize multi-modal and higher-level contributions and interactions for spatial orientation and self-motion perception, while minimizing reference frame conflicts. LONG-TERM GOALS: To investigate how we can best employ self-motion illusion in VR to enable life-like, robust and effortless spatial orientation and behaviour in VR. SIGNIFICANCE: This research will lead to a deeper understanding of human perception and behavior that enables us to design more effective human-computer interfaces and interaction paradigms. In particular, applied research will identify the essential parameters of perception/action and pin-point the "blind spots" that will enable us to trick the brain when simulating VR. This will enable the creation of better, cost-effective, virtual solutions for numerous applications, such as driving/flight simulation, space exploration, education, gaming, engineering, recreation, emergency training, video conferencing, minimally invasive surgery, and telemedicine.