RUI: Cortical Integration of Motion and Stereo Cues for a Moving Observer

一个在世界上移动的人必须判断自己的运动路径，定位移动的物体，并判断这些物体的运动方向。从理论上讲，大脑可以利用双目立体视觉的视觉运动信息和深度信息来完成这些任务。然而，目前还不知道这两个信息来源是如何结合在一起的。在这个项目中，将开发一个神经处理的计算模型，以研究大脑如何结合运动和立体提示来识别运动观察者的运动对象。同时，实验将研究移动的观察者如何使用运动和立体来识别和判断物体的3D运动方向。这项研究的结果将提供所需的信息，关于神经元如何结合运动和立体线索来定位和判断正在移动的人移动物体的方向。这将增加我们对视觉系统基本机制的理解。它将有助于理解司机如何在繁忙的街道上驾驶时对汽车或行人的运动做出判断，这可能有助于有关司机和交通规则的政策决策。此外，由于这项研究将在本科学院进行，其教育影响是巨大的。本科生将有机会参与前沿科学研究并完成自己的研究项目。这将使他们接触到他们在大学期间不会遇到的科学努力领域。招募女本科生和其他代表性不足的少数群体从事这项研究将是一个优先事项。最后，这项研究的结果和例子将被纳入一门由PI教授的计算视觉课程，以便将结果传播给没有直接参与该项目的学生。

A person moving through the world must judge his or her own path of motion, locate moving objects and judge the direction of motion of those objects. In theory, the brain can accomplish these tasks using visual motion information as well as the depth information from binocular stereo vision. However, it is not known how these two sources of information are combined. In this project, a computational model of neural processing will be developed to investigate how the brain combines motion and stereo cues to identify moving objects for a moving observer. Concurrently, experiments will examine how moving observers use motion and stereo to identify and judge the 3D direction of motion of an object. The results of this research will provide needed information about how neurons combine motion and stereo cues to locate and judge the direction of moving objects for a person who is moving. This will increase our understanding of fundamental mechanisms of the visual system. It will be useful in understanding how drivers make judgments about the motion of cars or pedestrians as they drive on busy streets, which could aid policy decisions regarding drivers and traffic rules. Additionally, because the research will be conducted at an undergraduate college, its educational impact is substantial. Undergraduates will have an opportunity to participate in leading-edge scientific research and perform their own research projects. This will expose them to fields of scientific endeavor that they would not otherwise encounter during their college years. Recruitment of women undergraduates and other underrepresented minorities to engage in this research will be a priority. Finally, the results and examples from this research will be incorporated in a course in computational vision, taught by the PI, so that the results will be disseminated to students who did not work directly on the project.