BIC: Eye movements and depth perception in primates and machines
BIC: Eye movements and depth perception in primates and machines
批准号:
0432104
负责人:
Michele Rucci
金额:
$0.0万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2004
资助国家:
美国
项目状态:
已结题
起止时间:
2004-10-01 至 2008-09-30
中文摘要
我们的眼睛从来没有休息过。即使我们盯着一个可视的目标,不自主的小眼动持续地干扰视网膜上图像的投射。大量新近的证据表明,这些不自主的眼动是大脑获得和再现视觉信息的重要组成部分。对猴子的神经生理学研究表明,小眼动强烈地影响神经元的反应在视觉系统中。在以前的NSF奖的研究中,(EIA-0130851),e已经表明,注视不稳定性对于识别在自然观看期间出现的短暂持续时间内呈现的刺激至关重要(Rucci和Desbordes,2003),并提高了外侧膝状体核和初级视觉皮层模型中视觉表征的效率(Rucci和Casile,2003 b,2004)。此外,在机器人系统中再现人眼运动表明,外显不稳定性可以提供可靠的距离信息。(Santini和Rucci,2003年)。基于我们以前的结果和最近的神经生理学研究,这一提议是NSF和EIA研究的一部分,0130851.它描述了一个研究项目,重点是提取和整合多个深度线索,以开发一个可靠的视觉场景的3D表示。该项目遵循一个跨学科的方法,将视觉皮层的计算机建模与本研究的长期目标是开发机器视觉系统,通过模拟大脑的计算原理,实现高水平的鲁棒性和效率。本项目的具体目标是:1.开发一个猴子初级视觉皮层模型,根据最近的神经生理学研究结果,在该模型中,不同的神经元群体在小眼睛运动的不同阶段做出反应。(a)当该模型与复制人眼运动的机器人眼动工作站耦合时,分析不同神经元群体传递的相对距离信息;以及(B)将由不同线索提供的深度信息集成到视觉场景的相干3D表示中。3.通过学习来研究模型的自组织,因此深度信息的提取和整合是根据系统的物理和运动特性自主调整的。在这项研究中,人类观察者的眼动将由高分辨率眼动仪测量,然后由机器人系统精确复制(一种带有移动摄像机的头/眼系统),专门设计用于在眼闭行为过程中再现眼睛的视觉输入。用这种方法获得的视觉图像将作为灵长类动物纹状皮层神经元计算模型的输入。智力价值:该项目建立了人类和机器视觉研究之间的直接联系。通过专注于眼动影响视觉处理的计算机制,它有可能为大脑提供新的见解,并为机器视觉新算法的开发开辟道路。更广泛的影响:这项研究的跨学科性质为培训学生提供了新的机会。通过与PI合作,波士顿大学认知和神经系统系的学生,一个重点研究大脑计算模型的部门,将有机会将他们的理论工作与机器视觉系统的发展联合收割机结合起来。
英文摘要
Our eyes are never at rest.Even when e are .xating upon a visual target,small involuntary eyemovements continuously perturb the projection of the image on the retina.A substantial body ofrecent evidence indicates that these .xational eye movements are an important component of theay visual information is acquired and represented in the brain.Neurophysiological studies withmonkeys have sho n that small eye movements strongly a .ect the responses of neurons in the visualsystem.In the research of a previous NSF award (EIA-0130851),e have shown that fixationalinstability is crucial for identifying stimuli presented for the brief durations that occur duringnatural viewing (Rucci and Desbordes,2003),and improves the efficiency of visual representationsin models of the lateral geniculate nucleus and primary visual cortex (Rucci and Casile,2003b,2004).Furthermore,reproduction of human eye movements in a robotic system has sho n that.xational instability may provide reliable information of distance (Santini and Rucci,2003).Building on our previous results and those of recent neurophysiological studies,this proposalcontinues part of the research of NSF a ard EIA-0130851.It describes a program of research thatfocuses on extracting and integrating multiple depth cues to develop a reliable 3D representationof the visual scene.This project follows an interdisciplinary approach that integrates computermodeling of the visual cortex with robotic experiments and measurements of eye movements inhuman subjects.The long-term goal of this research is to develop machine vision systems that,byemulating the computational principles of the brain,achieve high levels of robustness and e .ciency.The specific aims of this project are to:1.Develop a model of the monkey primary visual cortex in which,following recent neurophysi-ological .ndings,distinct populations of neurons respond during di .erent phases of small eyemovements.2.(a)Analyze the information of relative distance transmitted by di .erent neuronal populationswhen the model is coupled with a robotic oculomotor orkstation that replicates human eyemovements;and (b)integrate depth information provided by di .erent cues into a coherent3D representation of the visual scene.3.Investigate the self-organization of the model by means of learning,so that the extractionand integration of depth information is autonomously tuned to the physical and motor char-acteristics of the system.In this research,the eye movements of human observers will be measured by a high-resolutioneye-tracker,and then accurately replicated by a robotic system (a head/eye system with t o mo-bile cameras)that e have speci .cally designed to reproduce the visual inputs to the eyes duringoculomotor behavior.Visual images acquired in this ay will be applied as input to computationalmodels of neurons in the striate cortex of primates.Intellectual merit: This project establishesa direct linkbet een human and machine vision studies.By focusing on the computational mecha-nisms by which eye movements a .ect visual processing,it has the potential of providing new insightson the brain as ell as opening the ay to the development of new algorithms in machine vision.Broader impact: The interdisciplinary nature of this research o .ers new opportunities for train-ing students.By collaborating with the PI,students in the Department of Cognitive and NeuralSystems at Boston University,a department ith an important focus on computational modelingof the brain,will have an opportunity to combine their theoretical orkwith the development ofmachine vision systems.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Center for Vision Science Symposium: Active Vision; Rochester, NY; June 2020
-
批准号:2013317
-
项目类别:Standard Grant
-
资助金额:$4.85万
-
财政年份:2020
-
负责人:Michele Rucci
-
依托单位:
Influence of Head and Eye Movements on Retinal Input and Early Neural Encoding
-
批准号:1836558
-
项目类别:Standard Grant
-
资助金额:$9.19万
-
财政年份:2018
-
负责人:Michele Rucci
-
依托单位:
Influence of Head and Eye Movements on Retinal Input and Early Neural Encoding
-
批准号:1457238
-
项目类别:Standard Grant
-
资助金额:$47.5万
-
财政年份:2015
-
负责人:Michele Rucci
-
依托单位:
The Benefits of Self-Motion for Visual Perception
-
批准号:1420212
-
项目类别:Standard Grant
-
资助金额:$30.0万
-
财政年份:2014
-
负责人:Michele Rucci
-
依托单位:
Influence of Head and Eye Movements on Visual Input Statistics and Early Neural Representations
-
批准号:1127216
-
项目类别:Standard Grant
-
资助金额:$45.6万
-
财政年份:2011
-
负责人:Michele Rucci
-
依托单位:
Collaborative Research: Decorrelation of natural inputs in lateral geniculate nucleus of behaving monkeys
-
批准号:0843304
-
项目类别:Continuing Grant
-
资助金额:$1.36万
-
财政年份:2009
-
负责人:Michele Rucci
-
依托单位:
Influence of Eye Movements on Visual Input Statistics and Early Neural Representations
-
批准号:0719849
-
项目类别:Continuing Grant
-
资助金额:$32.5万
-
财政年份:2007
-
负责人:Michele Rucci
-
依托单位:
Active Depth Perception in Primates and Machines
-
批准号:0726901
-
项目类别:Standard Grant
-
资助金额:$0.0万
-
财政年份:2007
-
负责人:Michele Rucci
-
依托单位:
Biological Information Technology & Systems - BITS: Fixational Eye Movements in Biological and Artificial Vision Systems
-
批准号:0130851
-
项目类别:Continuing Grant
-
资助金额:$30.0万
-
财政年份:2002
-
负责人:Michele Rucci
-
依托单位:
海外基金