Perception of Layout and Motion during Self Motion in Real and Virtual Worlds

真实和虚拟世界中自我运动期间的布局和运动感知

• 批准号: RGPIN-2020-06061
• 负责人: Allison, Robert
• 金额: $ 2.99万
• 依托单位: York University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=752418
• 关键词: Perception; Layout; Motion; during; Self

When moving through the world our two eyes receive a complex pattern of visual input. The local image velocity varies with head motion (planned and perturbations), scene layout and object motion. This complex pattern of relative motion is usually modeled in terms of the optic array (manifold of visual directions) and the optic flow describes changes in the position of features in the optic array with time. While complex, this optic flow can be decomposed into flow arising from one's self-motion versus flow arising from moving objects. The focus of the current proposal is to better understand the perceptual cues that locomoting humans use to support safe travel in dynamic environments. I will then apply this knowledge to help evaluate and develop more effective 3D user interfaces for virtual reality. Based on computational analyses we will make predictions of the visual information and frames of reference used by humans to make perceptual judgements supporting locomotion. I will then design experimental virtual reality experiments to investigate a number of important questions faced by the moving observer. These include (1) how can an observer separate motion parallax of the rigid environment from the independent motion of an obstacle, locomotion target or distractor, (2) what is the influence of features that are not strictly bound to the surface such as specular highlights and shadows and (3) what is the role of the binocular peripheral visual field in the estimation and control of heading, balance and obstacle avoidance? Some aspects of these issues have been considered with simple stimuli but will be extended to consider naturalistic, binocular virtual and real environments. The proposed research will advance basic science by providing key insights into the role of stereoscopic vision in locomoting, orienting and navigating, a topic that has not been well studied. This proposal will extend our work on scene perception and virtual locomotion by examining the role that binocular vision plays during real world tasks such as target interception or obstacle avoidance. These experiments will be enabled by the availability of state-of the art facilities such as our unique wide-field stereoscopic display, mobile eye tracking and body tracking, all combined with carefully designed behavioural and psychophysical tasks. The work will be grounded in state-of-the-art computational research and could, in turn, inspire biologically motivated solutions for computer vision. Highly-qualified researchers will be trained on skills in human factors, human-computer interaction and visualization that are highly sought after by Canadian industry.

在世界上移动时，我们的两只眼睛会收到复杂的视觉输入模式。本地图像速度随头部运动（计划和扰动），场景布局和对象运动而变化。这种相对运动的复杂模式通常是根据视觉阵列（视觉方向的多种方式）建模的，并且光流描述了随着时间的时间视频阵列中特征位置的变化。虽然复杂，但这种视频流可以分解为由一个人的自我运动而引起的流动，而动作的流动引起的流动。当前建议的重点是更好地理解人类在动态环境中支持安全旅行的感知线索。然后，我将应用这些知识来帮助评估和开发虚拟现实的更有效的3D用户界面。基于计算分析，我们将对人类使用的视觉信息和参考框架进行预测，以进行支持的运动判断。然后，我将设计实验性虚拟现实实验，以研究移动观察者面临的许多重要问题。这些包括（1）观察者如何将刚性环境的运动视差与障碍物的独立运动，运动目标或干扰物的独立运动，（2）（2）不严格绑定到表面的特征的影响是什么，例如镜面亮点和阴影以及（3）双眼外周视野在估计和控制范围内的估算和障碍之间的作用是什么？这些问题的某些方面已通过简单的刺激进行了考虑，但将扩展以考虑自然主义，双眼虚拟和真实的环境。 拟议的研究将通过提供有关立体愿景在机车，定向和导航中的作用的关键见解来推进基础科学，这一主题尚未得到很好的研究。该提案将通过研究在现实世界中的任务（例如目标拦截或避免障碍物）中的双眼视力扮演的角色，从而扩展我们在场景感知和虚拟运动上的工作。这些实验将通过最先进的设施的可用性（例如我们独特的宽场立体显示屏，移动眼镜跟踪和身体跟踪）来启用这些实验，所有这些实验都将与精心设计的行为和心理物理任务相结合。这项工作将基于最先进的计算研究，反过来又可以激发以生物学动机的计算机视觉解决方案。高度合格的研究人员将接受有关人为因素，人类计算机互动和可视化的技能的培训，这些技能受到加拿大工业的备受追捧。