Enabling effective human spatial orientation and behaviour in virtual environments

目标：研究什么构成了有效的、健壮的和直观的人类空间定向和行为。这些基础知识将被应用于设计新颖的，更有效的人机界面和交互范例，使类似的过程在计算机介导的环境，如虚拟现实（VR）和多媒体。动机：虽然现代VR模拟可以具有令人惊叹的照片真实感，但它们通常无法提供在模拟世界中移动的逼真和令人信服的感觉，从而限制了感知的真实性，行为有效性，用户接受度和商业成功。方法：我认为，研究和利用自我运动错觉可能是克服这些缺点并在计算机介导的环境中提供真正“移动体验”的一种精简而优雅的方法。多模态、自然主义和沉浸式VR提供了一个独特的机会，可以在封闭的动作感知循环中，在可重复、定义明确和可控的实验条件下研究人类的感知和行为。 短期/中期目标：在虚拟现实中与天真的人类参与者进行实验，以研究和优化空间方向和自我运动感知的多模态和更高层次的贡献和交互，同时最大限度地减少参考框架冲突。长期目标：研究如何在VR中最好地利用自运动错觉，以在VR中实现逼真，强大和轻松的空间定位和行为。重要性：这项研究将使我们更深入地了解人类的感知和行为，使我们能够设计更有效的人机界面和交互模式。特别是，应用研究将确定感知/动作的基本参数，并指出“盲点”，使我们能够在模拟VR时欺骗大脑。 这将为众多应用创造更好、更具成本效益的虚拟解决方案，例如驾驶/飞行模拟、太空探索、教育、游戏、工程、娱乐、紧急培训、视频会议、微创手术和远程医疗。

GOAL: To investigate what constitutes effective, robust, and intuitive human spatial orientation and behaviour. This fundamental knowledge will be applied to design novel, more effective human-computer interfaces and interaction paradigms that enable similar processes in computer-mediated environments like virtual reality (VR) and multi-media. MOTIVATION: While modern VR simulations can have stunning photorealism, they are typically unable to provide a life-like and compelling sensation of moving through the simulated world, thus limiting perceived realism, behavioural effectiveness, user acceptance, and commercial success. APPROACH: I propose that investigating and exploiting self-motion illusions might be a lean and elegant way to overcome such shortcomings and provide a truly "moving experience" in computer-mediated environments. Multi-modal, naturalistic and immersive VR provides a unique opportunity to study human perception and behaviour in reproducible, clearly defined and controllable experimental conditions in a closed action-perception loop. SHORT/MID-TERM GOALS: To perform experiments with naïve human participants in VR to investigate and optimize multi-modal and higher-level contributions and interactions for spatial orientation and self-motion perception, while minimizing reference frame conflicts. LONG-TERM GOALS: To investigate how we can best employ self-motion illusion in VR to enable life-like, robust and effortless spatial orientation and behaviour in VR. SIGNIFICANCE: This research will lead to a deeper understanding of human perception and behavior that enables us to design more effective human-computer interfaces and interaction paradigms. In particular, applied research will identify the essential parameters of perception/action and pin-point the "blind spots" that will enable us to trick the brain when simulating VR. This will enable the creation of better, cost-effective, virtual solutions for numerous applications, such as driving/flight simulation, space exploration, education, gaming, engineering, recreation, emergency training, video conferencing, minimally invasive surgery, and telemedicine.