Interactive Locomotion User Interfaces for Real Walking through Virtual Worlds - From Perception to Application

ILUI项目的主要目标是允许用户通过在有限的物理空间中行走来无限制地探索IVE，以便获得与现实世界中的自然行走相同的空间感知好处。该项目将直接建立在我们之前的LOCUI项目的结果之上。从我们在上一个项目中开发的技术的局限性中，我们发现了在结合新颖的感知启发方法以实现在虚拟世界中自然行走的目标方面的重要挑战和巨大潜力。ILUI将用户放在方法的中心，专注于他适应IVE作为自然环境的能力，他使用眼球运动进行视觉探索的策略，以及将他的身体视为虚拟体验的一部分。特别是，为了实现iLUI项目的目标和贡献，我们将：1.分析自适应，通过降低RDW技术对操作的敏感度，增加RDW的增益操作范围。我们将确定适应的时间进程和强度，以及使用户适应特定增益范围的可能性，并将测试是否保留了跨会话的适应效果。2.开发基于凝视的RDW技术，将周边视觉滤光片与用户的凝视相结合，并评估基于凝视的新操作，如扫视抑制、运动模糊和景深。这将进一步扩大检测阈值，人类可以沿着与视觉刺激相比产生不同感觉和运动信号的物理轨迹在不知不觉中被引导到这个阈值。3.开发基于脚的RDW技术以掩盖可能由RDW技术引起的视觉失配，其中虚拟相机被操纵，但用户的身体不被操纵。由于新型大视场HMD的兴起，与小视场的设置相比，地板和脚之间的这种不匹配更容易被看到。我们将评估通过操纵虚拟位置和/或关键身体部位周围的显示来屏蔽相互冲突的身体反馈的方法。我们相信，有了这些新颖的方法，我们将能够显著降低RDW的空间需求，从而使在任意VE中进行虚拟全方位行走成为可能，即使只有很小的物理步行空间可用，例如在洞穴或较小的实验室环境中。4.实现RDW的自适应控制器和算法，以结合iLUI项目中提出的新方法，并提供一个模拟器软件环境来支持不同算法的测试和比较。这些扩展将被集成到V-R-GO库中。

The main objective of the iLUI project is to allow users to unlimitedly explore an IVE by walking in a confined physical space in order to receive the same benefits for spatial perception known from natural walking in the real world. The project will directly build upon results from our previous LOCUI project. From the limitations of the techniques, which we developed during the previous project, we identified important challenges and enormous potentials to incorporate novel perceptually-inspired methods to achieve the goal of natural walking through virtual worlds. iLUI puts the user in the focus of the approach, concentrating on his ability to adapt to the IVE as a naturalistic situation, his strategies for visual exploration using eye movements, and the view of his body as part of the virtual experience. In particular, to achieve the goals and contribution of the iLUI project, we will: 1. Analyze adaptation to increase the range of gain manipulations for RDW by reducing the sensitivity to manipulations caused by RDW techniques. We will determine the time course and strength of adaptation and the possibility to adapt users to a specific gain range and we will test for any retainment of adaptation effects across sessions. 2. Develop gaze-based RDW techniques by coupling peripheral visual filters to the gaze of the user and evaluate novel gaze-based manipulation such as saccadic suppression, motion blur and depth of field. These will further extend detection thresholds up to which humans can be guided imperceptibly along physical trajectories that produce different sensory and motor signals in comparison to the visual stimuli. 3. Develop feet-based RDW techniques to mask visual mismatches that may result from RDW techniques in which the virtual camera is manipulated, but the body of the user is not. Due to the rise of novel large field of view HMDs, such mismatches between floor and feet get visible much more often compared to setups with smaller fields of view. We will evaluate approaches to mask conflicting body feedback by either manipulating the virtual position and/or the display around critical body parts. We are confident that with the novel approaches we will be able to significantly decrease the space requirements of RDW such that virtual omni-directional walking through arbitrary VEs becomes possible, even if only a small physical walking space is available, such as in a CAVE or in smaller lab environments. 4. Implement adaptive controllers and algorithms for RDW in order to incorporate the novel approaches addressed in the iLUI project and supply a simulator software environment to support testing and comparing of different algorithms. These extensions will be integrated into the V-R-GO library.