Distortions in virtual and augmented environments: impact on performance and well-being

人类大脑已经进化出一种令人印象深刻的能力，可以将视觉信息与来自多个感觉系统（例如前庭、听觉）的输入整合起来。因此，我们似乎毫不费力地与环境互动，并在环境中导航。我们自然地适应这些输入之间关系的一些变化，例如随着身体的生长，以及感觉信息之间对应的更临时的变化。长期以来，感觉统合的研究一直是科学研究的焦点，使用仔细控制的刺激。然而，很难将这些结果外推到更自然环境中的视觉。** **虚拟现实（VR）和增强现实（AR）内容和显示的快速发展为以受控的方式评估感觉整合提供了机会，但有更复杂的自然刺激。此外，行为实验有可能为感知扭曲对用户幸福感和虚拟环境中的任务表现的影响提供重要见解。****与加拿大高通公司合作，我们将使用严格的行为评估方法系统评估虚拟环境中感官不和谐的影响，当用户a)被动地整合冲突的视觉空间和几何信息，b)主动地整合冲突的视觉深度/位置线索，以及c)基于视觉、听觉和前庭线索主动解释自我运动信息时。****在所有情况下，我们将结合使用心理物理方法，有效的问卷调查和人为因素协议来评估感觉扭曲的影响。因此，所提出的实验结果将告知我们在自然观看场景下对人类视觉处理的理解，以及高级头戴式显示器（HMD）的用户体验。**********

The human brain has evolved an impressive ability to integrate visual information with input from multiple sensory systems (e.g. vestibular, auditory). As a result, we seemingly effortlessly interact with, and navigate within, our environment. We naturally adapt to some changes in the relation between these inputs, for instance as the body grows, and also to more temporary changes in the correspondence between sensory information. The study of sensory integration has long been a focus of scientific study, using carefully controlled stimuli. However, it is difficult to extrapolate these results to vision in more natural environments.** **The rapid expansion of virtual reality (VR) and augmented reality (AR) content and displays provides opportunities to assess sensory integration in a controlled manner, but with more complex naturalistic stimuli. In addition, behavioural experiments have the potential to provide important insights into the impact of sensory distortions on user well-being and for task performance in virtual environments. ****In collaboration with Qualcomm Canada Inc., we will systematically evaluate the effects of sensory discord in virtual environments using rigorous behavioural assessment methods when users a) passively integrate conflicting visual spatial and geometric information, b) actively integrate conflicting visual depth/location cues and c) actively interpret self-motion information based on visual, auditory and vestibular cues.****In all cases, we will use a combination of psychophysical methods, validated questionnaires and human factors protocols to evaluate the impact of the sensory distortions. Thus, the results of the proposed experiments will inform both our understanding of human visual processing under naturalistic viewing scenarios, and the user experience in advanced head-mounted displays (HMD).**********