Role of stereopsis in locomotion and navigation: Interaction and interfaces

本研究计划的总体主题和长期目标是开发立体表面感知模型及其在视觉引导行动中的作用。立体深度或立体视觉产生于对双眼图像之间的差异或“视差”的处理，并且对于表面形状、环境布局和材料特性的感知是重要的。这样的信息反过来对于规划和执行视觉引导的运动（包括运动）是重要的。目前的建议的重点是提供一个更好的理解人类使用的感知线索，使他们的环境，支持他们的运动的判断。然后，我们应用这些知识来帮助评估和开发更有效的3D用户界面。最近的研究（来自我们的实验室和其他人）和轶事报告表明，双目视觉和立体视觉可以在与运动的时刻到时刻控制相关的距离上提供实质性的感知益处。在目前的建议中，我解决了立体视觉在真实的和计算机介导的环境中引导运动的作用，这些短期目标是：*1）调查立体视觉在感知决策中的作用，包括在感知我们的自我运动和我们移动的世界的布局。*2）了解这些感知如何影响运动，路径规划和导航的控制和指导。3)评估信息显示以及辅助虚拟现实（VR）和增强现实（AR）运动的影响。我们将开发设计规则，指导方针和技术，用于生成支持AR运动的立体图像。鉴于立体视觉在移动，定向和导航中的作用还没有得到很好的研究，在一系列的基础实验中，我们将把我们的工作扩展到场景感知到运动动作的控制。特别是，我们将研究的作用，双目视觉在执行真实的世界的任务，如坡道行走和崎岖的地形上行走。这些实验将通过提供最先进的设施来实现，例如我们独特的宽视场立体显示器。这项基础研究将为开发有效的3D用户界面提供见解，特别是在VR和AR中。我们将扩展我们的工作立体线索的自我运动和认知映射的感知在真实的世界中的作用，并将其应用到抽象和自然的三维运动。基于这些实验，我们将推荐增强真实的和虚拟环境以支持和扩展这些功能的方法。该研究将为低视力辅助设备、车载显示器和其他应用提供更安全、更有效、更自然的用户界面。高素质的研究人员将接受加拿大工业界高度追捧的人机交互和可视化技能培训。

The overall theme and long-term goal of this research program is to develop a model of stereoscopic surface perception and its role in visually guided action. Stereoscopic depth or stereopsis arises from processing of the differences or `disparities' between the images in the two eyes and is important for the perception of surface shape, environmental layout and material properties. Such information is, in turn, important for the planning and execution of visually-guided movements including locomotion. The focus of the current proposal is to provide a better understanding of the perceptual cues humans use to make judgements of their environment that support their locomotion. We then apply this knowledge to help evaluate and develop more effective 3D user interfaces.***Recent studies (from our lab and others) and anecdotal reports demonstrate that binocular vision and stereopsis can provide substantial perceptual benefits at distances relevant to the moment-to-moment control of locomotion. In the current proposal I address the role of stereopsis in guidance of locomotion in real and computer-mediated environments with these short-term objectives: ***1) Investigating the role of stereoscopic vision in perceptual decision making including in the perception of our self motion and of the layout of the world through which we move. ***2) Understanding how these perceptions affect the control and guidance of locomotion, path planning and navigating.***3) Assessing the implications in information display and for aiding virtual reality (VR) and augmented reality (AR) locomotion. We will develop design rules, guidelines and techniques for generation of stereoscopic imagery to support AR locomotion.***Given that the role of stereopsis in locomoting, orienting and navigating has not been well studied, in a series of foundational experiments we will extend our work on scene perception to the control of locomotor action. In particular we will examine the role that binocular vision plays in performing real world tasks such as ramp walking and walking on rough terrain. These experiments will be enabled by availability of state-of the art facilities such as our unique wide-field stereoscopic display.***This basic research will provide insight for developing effective 3D user interfaces, particularly in VR and AR. We will extend our work on the role of stereoscopic cues in the perception of self-motion and cognitive mapping in the real world and apply it to abstract and naturalistic 3D locomotion. Based on these experiments, we will recommend ways to augment real and virtual environments to support and extend these capabilities. The research will enable safer, more effective and more natural user interfaces for low vision aids, vehicular displays and other applications. Highly-qualified researchers will be trained on skills in human-computer interaction and visualization that are highly sought after by Canadian industry.