Distortions in virtual and augmented environments: impact on performance and well-being

人类大脑已经进化出一种令人印象深刻的能力，能够将视觉信息与来自多个感觉系统(如前庭、听觉)的输入相结合。结果，我们似乎毫不费力地与我们的环境互动，并在其中导航。我们自然而然地适应了这些输入之间的关系的一些变化，例如随着身体的发育，也适应了感觉信息之间的对应关系的更暂时的变化。长期以来，感觉统合的研究一直是科学研究的重点，使用的是精心控制的刺激。然而，很难在更自然的环境中将这些结果推断为视觉。*虚拟现实(VR)和增强现实(AR)内容和显示器的快速扩展为以受控方式评估感觉整合提供了机会，但具有更复杂的自然刺激。此外，行为实验有可能对感知扭曲对用户幸福感和虚拟环境中的任务表现的影响提供重要的见解。*与高通加拿大公司合作，我们将在以下情况下使用严格的行为评估方法系统地评估虚拟环境中感觉不和谐的影响：a)被动整合冲突的视觉空间和几何信息，b)主动整合冲突的视觉深度/位置线索，c)基于视觉、听觉和前庭线索主动解释自我运动信息。*在所有情况下，我们将使用心理物理方法、有效问卷和人为因素协议相结合的方法来评估感觉扭曲的影响。因此，拟议的实验结果将使我们了解在自然观看场景下人类视觉处理的理解，以及在高级头盔显示器(HMD)中的用户体验。

The human brain has evolved an impressive ability to integrate visual information with input from multiple sensory systems (e.g. vestibular, auditory). As a result, we seemingly effortlessly interact with, and navigate within, our environment. We naturally adapt to some changes in the relation between these inputs, for instance as the body grows, and also to more temporary changes in the correspondence between sensory information. The study of sensory integration has long been a focus of scientific study, using carefully controlled stimuli. However, it is difficult to extrapolate these results to vision in more natural environments.** **The rapid expansion of virtual reality (VR) and augmented reality (AR) content and displays provides opportunities to assess sensory integration in a controlled manner, but with more complex naturalistic stimuli. In addition, behavioural experiments have the potential to provide important insights into the impact of sensory distortions on user well-being and for task performance in virtual environments. ****In collaboration with Qualcomm Canada Inc., we will systematically evaluate the effects of sensory discord in virtual environments using rigorous behavioural assessment methods when users a) passively integrate conflicting visual spatial and geometric information, b) actively integrate conflicting visual depth/location cues and c) actively interpret self-motion information based on visual, auditory and vestibular cues.****In all cases, we will use a combination of psychophysical methods, validated questionnaires and human factors protocols to evaluate the impact of the sensory distortions. Thus, the results of the proposed experiments will inform both our understanding of human visual processing under naturalistic viewing scenarios, and the user experience in advanced head-mounted displays (HMD).**********