Collaborative Research: NCS-FO: Learning Efficient Visual Representations From Realistic Environments Across Time Scales
合作研究:NCS-FO:从跨时间尺度的现实环境中学习高效的视觉表示
基本信息
- 批准号:1631403
- 负责人:
- 金额:$ 51.05万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2016
- 资助国家:美国
- 起止时间:2016-09-01 至 2018-08-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Computer vision algorithms examine images and make sense of what these images depict. Current computer vision algorithms are able to interpret images at the level of a typical middle school student for many image interpretation tasks. Recent advances in computer vision have led to rapid technological advances which are still unfolding but affect not only the technology industry, but education, national security and health care. However, these new algorithms are as yet poorly understood and do not describe how natural learners such as a typical middle school student learn to understand the visual world. This proposal draws together a team of cognitive psychologists, neuroscientists, and computer scientists to develop a new class of algorithms for computer vision inspired by the way people learn. The key insight of this proposal is that human learners, unlike many leading computer vision techniques, make extensive use of the temporal structure of visual experience to extract structure. In the real world the image on the human retina is almost never static. Changes in eye position and movements of the head and body create a rich and complex temporal structure over a range of scales from hundreds of milliseconds up to days and weeks. This proposal a) develops databases of realistic and dynamically changing images in the real world and in immersive virtual reality environments, b) develops computational models for learning visual representations from temporally structured experiences and, c) examines the brain structures supporting representations integrating time and space across scales using fMRI. The algorithms pursued in this project are inspired by recent theoretical work in the neuroscience of scale-invariant memory. However, because the databases will be made publicly available, other researchers will be able to develop other algorithms that exploit temporal and spatial correlations. Taken together, these efforts are intended to catalyze a new generation of techniques for human-like machine learning algorithms with applications in computer vision.
计算机视觉算法检查图像并理解这些图像所描绘的内容。目前的计算机视觉算法能够在许多图像解释任务中达到典型中学生的水平。计算机视觉的最新进展导致了快速的技术进步,这些进步仍在展开,但不仅影响了技术行业,还影响了教育、国家安全和医疗保健。然而,这些新算法还没有被很好地理解,也没有描述自然学习者(如典型的中学生)如何学习理解视觉世界。这个提议吸引了一个由认知心理学家、神经科学家和计算机科学家组成的团队,他们受人类学习方式的启发,为计算机视觉开发了一类新的算法。该建议的关键观点是,与许多领先的计算机视觉技术不同,人类学习者广泛使用视觉经验的时间结构来提取结构。在现实世界中,人类视网膜上的图像几乎从来不是静态的。眼睛位置的变化以及头部和身体的运动创造了丰富而复杂的时间结构,时间跨度从几百毫秒到几天甚至几周不等。本提案a)在现实世界和沉浸式虚拟现实环境中开发现实和动态变化图像的数据库,b)开发用于从时间结构经验中学习视觉表征的计算模型,c)使用功能磁共振成像检查支持跨尺度时空整合表征的大脑结构。在这个项目中所追求的算法受到最近在尺度不变记忆的神经科学理论工作的启发。然而,由于数据库将是公开的,其他研究人员将能够开发利用时间和空间相关性的其他算法。综上所述,这些努力旨在催化新一代的类人机器学习算法技术,并将其应用于计算机视觉。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Per Sederberg其他文献
A Bayesian Joint Model for Risk-Taking and Momentary Mood Reveals the Importance of Subjective, Non-Linear Utility Curves
- DOI:
10.1016/j.biopsych.2020.02.905 - 发表时间:
2020-05-01 - 期刊:
- 影响因子:
- 作者:
Charles Zheng;DIPTA SAHA;Dylan Nielson;Hanna Keren;Francisco Pereira;Argyris Stringaris;Adam Fenton;Per Sederberg - 通讯作者:
Per Sederberg
Per Sederberg的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Per Sederberg', 18)}}的其他基金
Collaborative Research: NCS-FO: Learning Efficient Visual Representations From Realistic Environments Across Time Scales
合作研究:NCS-FO:从跨时间尺度的现实环境中学习高效的视觉表示
- 批准号:
1837827 - 财政年份:2017
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant
相似国自然基金
Research on Quantum Field Theory without a Lagrangian Description
- 批准号:24ZR1403900
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
Cell Research
- 批准号:31224802
- 批准年份:2012
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research
- 批准号:31024804
- 批准年份:2010
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Cell Research (细胞研究)
- 批准号:30824808
- 批准年份:2008
- 资助金额:24.0 万元
- 项目类别:专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
- 批准号:10774081
- 批准年份:2007
- 资助金额:45.0 万元
- 项目类别:面上项目
相似海外基金
Collaborative Research: NCS-FR: Individual variability in auditory learning characterized using multi-scale and multi-modal physiology and neuromodulation
合作研究:NCS-FR:利用多尺度、多模式生理学和神经调节表征听觉学习的个体差异
- 批准号:
2409652 - 财政年份:2024
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant
Collaborative Research: NCS-FR: DEJA-VU: Design of Joint 3D Solid-State Learning Machines for Various Cognitive Use-Cases
合作研究:NCS-FR:DEJA-VU:针对各种认知用例的联合 3D 固态学习机设计
- 批准号:
2319619 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Continuing Grant
Collaborative Research: NCS-FO: Modified two-photon microscope with high-speed electrowetting array for imaging voltage transients in cerebellar molecular layer interneurons
合作研究:NCS-FO:带有高速电润湿阵列的改良双光子显微镜,用于对小脑分子层中间神经元的电压瞬变进行成像
- 批准号:
2319406 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Continuing Grant
Collaborative Research: NCS-FO: Dynamic Brain Graph Mining
合作研究:NCS-FO:动态脑图挖掘
- 批准号:
2319450 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Continuing Grant
Collaborative Research: NCS-FO: Dynamic Brain Graph Mining
合作研究:NCS-FO:动态脑图挖掘
- 批准号:
2319451 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant
Collaborative Research: NCS-FR: Individual variability in auditory learning characterized using multi-scale and multi-modal physiology and neuromodulation
合作研究:NCS-FR:利用多尺度、多模式生理学和神经调节表征听觉学习的个体差异
- 批准号:
2319493 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant
Collaborative Research: NCS-FR: DEJA-VU: Design of Joint 3D Solid-State Learning Machines for Various Cognitive Use-Cases
合作研究:NCS-FR:DEJA-VU:针对各种认知用例的联合 3D 固态学习机设计
- 批准号:
2319617 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant
Collaborative Research: NCS-FO: Dynamic Brain Graph Mining
合作研究:NCS-FO:动态脑图挖掘
- 批准号:
2319449 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant
Collaborative Research: NCS-FR: DEJA-VU: Design of Joint 3D Solid-State Learning Machines for Various Cognitive Use-Cases
合作研究:NCS-FR:DEJA-VU:针对各种认知用例的联合 3D 固态学习机设计
- 批准号:
2319618 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Continuing Grant
Collaborative Research: NCS-FO: A model-based approach to probe the role of spontaneous movements during decision-making
合作研究:NCS-FO:一种基于模型的方法,探讨自发运动在决策过程中的作用
- 批准号:
2350329 - 财政年份:2023
- 资助金额:
$ 51.05万 - 项目类别:
Standard Grant