RUI: Cortical Integration of Motion and Stereo Cues for a Moving Observer

一个人在世界上移动，必须判断他或她自己的运动路径，定位移动的物体，并判断这些物体的运动方向。 从理论上讲，大脑可以利用视觉运动信息以及来自双目立体视觉的深度信息来完成这些任务。 然而，不知道这两个信息来源是如何结合起来的。 在这个项目中，神经处理的计算模型将被开发来研究大脑如何结合运动和立体提示来识别移动观察者的移动物体。 同时，实验将研究如何移动观察者使用运动和立体识别和判断一个物体的运动的3D方向。 本研究的结果将提供所需的信息，神经元如何结合联合收割机运动和立体声线索，以定位和判断移动物体的方向，为一个人谁是移动。 这将增加我们对视觉系统基本机制的理解。 这将有助于理解驾驶员如何判断汽车或行人在忙碌街道上行驶时的运动，这可能有助于有关驾驶员和交通规则的政策决策。 此外，由于这项研究将在本科院校进行，其教育影响是巨大的。 本科生将有机会参与前沿科学研究，并执行自己的研究项目。 这将使他们接触到他们在大学期间不会遇到的科学领域。 招聘女大学生和其他代表性不足的少数民族参与这项研究将是一个优先事项。 最后，这项研究的结果和例子将被纳入PI教授的计算视觉课程中，以便将结果传播给没有直接参与该项目的学生。

A person moving through the world must judge his or her own path of motion, locate moving objects and judge the direction of motion of those objects. In theory, the brain can accomplish these tasks using visual motion information as well as the depth information from binocular stereo vision. However, it is not known how these two sources of information are combined. In this project, a computational model of neural processing will be developed to investigate how the brain combines motion and stereo cues to identify moving objects for a moving observer. Concurrently, experiments will examine how moving observers use motion and stereo to identify and judge the 3D direction of motion of an object. The results of this research will provide needed information about how neurons combine motion and stereo cues to locate and judge the direction of moving objects for a person who is moving. This will increase our understanding of fundamental mechanisms of the visual system. It will be useful in understanding how drivers make judgments about the motion of cars or pedestrians as they drive on busy streets, which could aid policy decisions regarding drivers and traffic rules. Additionally, because the research will be conducted at an undergraduate college, its educational impact is substantial. Undergraduates will have an opportunity to participate in leading-edge scientific research and perform their own research projects. This will expose them to fields of scientific endeavor that they would not otherwise encounter during their college years. Recruitment of women undergraduates and other underrepresented minorities to engage in this research will be a priority. Finally, the results and examples from this research will be incorporated in a course in computational vision, taught by the PI, so that the results will be disseminated to students who did not work directly on the project.