Role of stereopsis in locomotion and navigation: Interaction and interfaces

本研究计划的总体主题和长期目标是建立立体表面知觉模型及其在视觉引导行动中的作用。立体深度或立体视觉产生于对两眼图像之间的差异或“差异”的处理，对表面形状、环境布局和材料特性的感知很重要。反过来，这些信息对于包括移动在内的视觉引导运动的规划和执行很重要。目前的建议的重点是提供一个更好的理解感知线索，人类用来判断他们的环境，支持他们的运动。然后我们应用这些知识来帮助评估和开发更有效的3D用户界面。***最近的研究（来自我们的实验室和其他人）和轶事报告表明，双目视觉和立体视觉可以在与运动的即时控制相关的距离上提供实质性的感知益处。在当前的提案中，我解决了立体视觉在现实和计算机媒介环境中指导运动中的作用，这些短期目标是：***1)研究立体视觉在感知决策中的作用，包括感知我们的自我运动和我们移动的世界的布局。***2)理解这些感知如何影响运动、路径规划和导航的控制和引导。***3)评估信息显示和辅助虚拟现实（VR）和增强现实（AR）运动的影响。我们将开发设计规则，指导方针和技术，以生成立体图像，以支持AR运动。***鉴于立体视觉在运动、定向和导航中的作用尚未得到很好的研究，在一系列基础实验中，我们将把我们在场景感知方面的工作扩展到运动动作的控制。特别是，我们将研究双目视觉在执行现实世界任务中所起的作用，例如斜坡行走和在崎岖地形上行走。这些实验将通过最先进的设备如我们独特的宽视场立体显示器来实现。***这项基础研究将为开发有效的3D用户界面，特别是在VR和AR中提供见解。我们将扩展我们在现实世界中自我运动感知和认知映射中的立体线索作用的工作，并将其应用于抽象和自然的3D运动。基于这些实验，我们将推荐增强真实和虚拟环境的方法，以支持和扩展这些功能。这项研究将为低视力辅助设备、车载显示器和其他应用提供更安全、更有效和更自然的用户界面。高素质的研究人员将接受人机交互和可视化技能方面的培训，这些技能受到加拿大工业界的高度追捧。

The overall theme and long-term goal of this research program is to develop a model of stereoscopic surface perception and its role in visually guided action. Stereoscopic depth or stereopsis arises from processing of the differences or `disparities' between the images in the two eyes and is important for the perception of surface shape, environmental layout and material properties. Such information is, in turn, important for the planning and execution of visually-guided movements including locomotion. The focus of the current proposal is to provide a better understanding of the perceptual cues humans use to make judgements of their environment that support their locomotion. We then apply this knowledge to help evaluate and develop more effective 3D user interfaces.***Recent studies (from our lab and others) and anecdotal reports demonstrate that binocular vision and stereopsis can provide substantial perceptual benefits at distances relevant to the moment-to-moment control of locomotion. In the current proposal I address the role of stereopsis in guidance of locomotion in real and computer-mediated environments with these short-term objectives: ***1) Investigating the role of stereoscopic vision in perceptual decision making including in the perception of our self motion and of the layout of the world through which we move. ***2) Understanding how these perceptions affect the control and guidance of locomotion, path planning and navigating.***3) Assessing the implications in information display and for aiding virtual reality (VR) and augmented reality (AR) locomotion. We will develop design rules, guidelines and techniques for generation of stereoscopic imagery to support AR locomotion.***Given that the role of stereopsis in locomoting, orienting and navigating has not been well studied, in a series of foundational experiments we will extend our work on scene perception to the control of locomotor action. In particular we will examine the role that binocular vision plays in performing real world tasks such as ramp walking and walking on rough terrain. These experiments will be enabled by availability of state-of the art facilities such as our unique wide-field stereoscopic display.***This basic research will provide insight for developing effective 3D user interfaces, particularly in VR and AR. We will extend our work on the role of stereoscopic cues in the perception of self-motion and cognitive mapping in the real world and apply it to abstract and naturalistic 3D locomotion. Based on these experiments, we will recommend ways to augment real and virtual environments to support and extend these capabilities. The research will enable safer, more effective and more natural user interfaces for low vision aids, vehicular displays and other applications. Highly-qualified researchers will be trained on skills in human-computer interaction and visualization that are highly sought after by Canadian industry.