Enabling effective human spatial orientation and behaviour in virtual environments

点击翻译按钮获取中文摘要

GOAL: To investigate what constitutes effective, robust, and intuitive human spatial orientation and behaviour. This fundamental knowledge will be applied to design novel, more effective human-computer interfaces and interaction paradigms that enable similar processes in computer-mediated environments like virtual reality (VR) and multi-media. MOTIVATION: While modern VR simulations can have stunning photorealism, they are typically unable to provide a life-like and compelling sensation of moving through the simulated world, thus limiting perceived realism, behavioural effectiveness, user acceptance, and commercial success. APPROACH: I propose that investigating and exploiting self-motion illusions might be a lean and elegant way to overcome such shortcomings and provide a truly "moving experience" in computer-mediated environments. Multi-modal, naturalistic and immersive VR provides a unique opportunity to study human perception and behaviour in reproducible, clearly defined and controllable experimental conditions in a closed action-perception loop. SHORT/MID-TERM GOALS: To perform experiments with naïve human participants in VR to investigate and optimize multi-modal and higher-level contributions and interactions for spatial orientation and self-motion perception, while minimizing reference frame conflicts. LONG-TERM GOALS: To investigate how we can best employ self-motion illusion in VR to enable life-like, robust and effortless spatial orientation and behaviour in VR. SIGNIFICANCE: This research will lead to a deeper understanding of human perception and behavior that enables us to design more effective human-computer interfaces and interaction paradigms. In particular, applied research will identify the essential parameters of perception/action and pin-point the "blind spots" that will enable us to trick the brain when simulating VR. This will enable the creation of better, cost-effective, virtual solutions for numerous applications, such as driving/flight simulation, space exploration, education, gaming, engineering, recreation, emergency training, video conferencing, minimally invasive surgery, and telemedicine.