Collaborative Research: Visual Cortex on Silicon

合作研究:硅上视觉皮层

基本信息

  • 批准号:
    1317470
  • 负责人:
  • 金额:
    $ 60万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2013
  • 资助国家:
    美国
  • 起止时间:
    2013-10-01 至 2019-09-30
  • 项目状态:
    已结题

项目摘要

The human vision system understands and interprets complex scenes for a wide range of visual tasks in real-time while consuming less than 20 Watts of power. This Expeditions-in-Computing project explores holistic design of machine vision systems that have the potential to approach and eventually exceed the capabilities of human vision systems. This will enable the next generation of machine vision systems to not only record images but also understand visual content. Such smart machine vision systems will have a multi-faceted impact on society, including visual aids for visually impaired persons, driver assistance for reducing automotive accidents, and augmented reality for enhanced shopping, travel, and safety. The transformative nature of the research will inspire and train a new generation of students in inter-disciplinary work that spans neuroscience, computing and engineering discipline.While several machine vision systems today can each successfully perform one or a few human tasks ? such as detecting human faces in point-and-shoot cameras ? they are still limited in their ability to perform a wide range of visual tasks, to operate in complex, cluttered environments, and to provide reasoning for their decisions. In contrast, the mammalian visual cortex excels in a broad variety of goal-oriented cognitive tasks, and is at least three orders of magnitude more energy efficient than customized state-of-the-art machine vision systems. The proposed research envisions a holistic design of a machine vision system that will approach the cognitive abilities of the human cortex, by developing a comprehensive solution consisting of vision algorithms, hardware design, human-machine interfaces, and information storage. The project aims to understand the fundamental mechanisms used in the visual cortex to enable the design of new vision algorithms and hardware fabrics that can improve power, speed, flexibility, and recognition accuracies relative to existing machine vision systems. Towards this goal, the project proposes an ambitious inter-disciplinary research agenda that will (i) understand goal-directed visual attention mechanisms in the brain to design task-driven vision algorithms; (ii) develop vision theory and algorithms that scale in performance with increasing complexity of a scene; (iii) integrate complementary approaches in biological and machine vision techniques; (iv) develop a new-genre of computing architectures inspired by advances in both the understanding of the visual cortex and the emergence of electronic devices; and (v) design human-computer interfaces that will effectively assist end-users while preserving privacy and maximizing utility. These advances will allow us to replace current-day cameras with cognitive visual systems that more intelligently analyze and understand complex scenes, and dynamically interact with users.Machine vision systems that understand and interact with their environment in ways similar to humans will enable new transformative applications. The project will develop experimental platforms to: (1) assist visually impaired people; (2) enhance driver attention; and (3) augment reality to provide enhanced experience for retail shopping or a vacation visit, and enhanced safety for critical public infrastructure. This project will result in education and research artifacts that will be disseminated widely through a web portal and via online lecture delivery. The resulting artifacts and prototypes will enhance successful ongoing outreach programs to under-represented minorities and the general public, such as museum exhibits, science fairs, and a summer camp aimed at K-12 students. It will also spur similar new outreach efforts at other partner locations. The project will help identify and develop course material and projects directed at instilling interest in computing fields for students in four-year colleges. Partnerships with two Hispanic serving institutes, industry, national labs and international projects are also planned.
人类视觉系统实时理解和解释各种视觉任务的复杂场景,同时消耗不到20瓦的功率。这个Expeditions-in-Computing项目探索了机器视觉系统的整体设计,这些系统有可能接近并最终超过人类视觉系统的能力。这将使下一代机器视觉系统不仅能够记录图像,还能理解视觉内容。这种智能机器视觉系统将对社会产生多方面的影响,包括为视障人士提供视觉辅助,为减少汽车事故提供驾驶员辅助,以及增强购物,旅行和安全的增强现实。这项研究的变革性质将激励和培养新一代学生从事跨学科的工作,涵盖神经科学、计算和工程学科。虽然今天的几个机器视觉系统每个都可以成功地执行一个或几个人类任务,但它的优点是:比如在傻瓜相机中检测人脸他们在执行广泛的视觉任务、在复杂、杂乱的环境中操作以及为他们的决定提供推理的能力方面仍然受到限制。 相比之下,哺乳动物的视觉皮层在各种目标导向的认知任务中表现出色,并且比定制的最先进的机器视觉系统至少高出三个数量级的能源效率。拟议的研究设想了一个机器视觉系统的整体设计,该系统将通过开发一个由视觉算法、硬件设计、人机界面和信息存储组成的综合解决方案来接近人类大脑皮层的认知能力。该项目旨在了解视觉皮层中使用的基本机制,以设计新的视觉算法和硬件结构,从而相对于现有的机器视觉系统提高功率,速度,灵活性和识别精度。为了实现这一目标,该项目提出了一个雄心勃勃的跨学科研究议程,将(i)了解大脑中目标导向的视觉注意机制,以设计任务驱动的视觉算法;(ii)开发视觉理论和算法,随着场景复杂性的增加而扩展性能;(iii)整合生物和机器视觉技术中的互补方法;(iv)开发视觉理论和算法。(iv)因应对视觉皮层的认识和电子装置的出现,发展一种新的电脑架构;及(v)设计人机界面,既能有效地协助最终用户,又能保障隐私和发挥最大效用。这些进步将使我们能够用认知视觉系统取代当前的摄像头,这些系统能够更智能地分析和理解复杂场景,并与用户动态交互。机器视觉系统能够以类似于人类的方式理解其环境并与之交互,这将使新的变革性应用成为可能。该项目将开发实验平台,以:(1)帮助视力受损的人;(2)提高驾驶员的注意力;(3)增强现实,为零售购物或度假访问提供增强的体验,并增强关键公共基础设施的安全性。该项目将产生教育和研究成果,通过门户网站和在线讲座广泛传播。由此产生的文物和原型将加强成功的正在进行的外展计划,以代表性不足的少数民族和公众,如博物馆展览,科学博览会,并针对K-12学生的夏令营。它还将推动在其他伙伴地点开展类似的新外联工作。该项目将帮助确定和开发课程材料和项目,旨在培养四年制大学学生对计算机领域的兴趣。还计划与两个西班牙裔服务机构、行业、国家实验室和国际项目建立伙伴关系。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Subhasish Mitra其他文献

Dendrite-inspired Computing to Improve Resilience of Neural Networks to Faults in Emerging Memory Technologies
树突启发计算可提高神经网络对新兴内存技术故障的恢复能力
  • DOI:
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    L. K. John;F. M. G. França;Subhasish Mitra;Zachary Susskind;P. M. V. Lima;Igor D. S. Miranda;E. B. John;Diego L. C. Dutra;M. Breternitz
  • 通讯作者:
    M. Breternitz
Segregation of a Phosphorus Rich Phase During Differential Solidification of BOF Slag
Measurement of gas dispersion parameters in a reflux flotation cell
回流浮选槽中气体分散参数的测量
  • DOI:
    10.1016/j.mineng.2025.109526
  • 发表时间:
    2025-10-01
  • 期刊:
  • 影响因子:
    5.000
  • 作者:
    Abdullaziz Glabe Zakari;Raju Chowdhury;Peter Ireland;Geoffrey Evans;Subhasish Mitra
  • 通讯作者:
    Subhasish Mitra
Effect of bubble surface loading on bubble rise velocity
  • DOI:
    10.1016/j.mineng.2021.107252
  • 发表时间:
    2021-12-01
  • 期刊:
  • 影响因子:
  • 作者:
    Ai Wang;Mohammad Mainul Hoque;Roberto Moreno-Atanasio;Elham Doroodchi;Geoffrey Evans;Subhasish Mitra
  • 通讯作者:
    Subhasish Mitra
Cooling future system-on-chips with diamond inter-tiers
使用金刚石中间层冷却未来片上系统
  • DOI:
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    8.9
  • 作者:
    M. Malakoutian;Anna Kasperovich;Dennis Rich;Kelly Woo;Christopher Perez;R. Soman;Devansh Saraswat;Jeong;Maliha Noshin;Michelle Chen;Sam Vaziri;Xinyu Bao;Che Chi Shih;W. Woon;M. Asheghi;Kenneth E. Goodson;S. Liao;Subhasish Mitra;Srabanti Chowdhury
  • 通讯作者:
    Srabanti Chowdhury

Subhasish Mitra的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Subhasish Mitra', 18)}}的其他基金

Collaborative Research: SHF: Small: Quasi Weightless Neural Networks for Energy-Efficient Machine Learning on the Edge
合作研究:SHF:小型:用于边缘节能机器学习的准失重神经网络
  • 批准号:
    2326895
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
FuSe-TG: The Future of Semiconductor Technologies for Computing through Device-Architecture-Application Co-Design
FuSe-TG:通过设备-架构-应用协同设计进行计算的半导体技术的未来
  • 批准号:
    2235329
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
E2CDA: Type I: Collaborative Research: Energy Efficient Learning Machines (ENIGMA)
E2CDA:类型 I:协作研究:节能学习机 (ENIGMA)
  • 批准号:
    1640078
  • 财政年份:
    2016
  • 资助金额:
    $ 60万
  • 项目类别:
    Continuing Grant
Cross-Layer Resilience Exploration
跨层弹性探索
  • 批准号:
    1255821
  • 财政年份:
    2013
  • 资助金额:
    $ 60万
  • 项目类别:
    Continuing Grant
Workshop: Bugs and Defects in Electronic Systems: The Next Frontier
研讨会:电子系统中的错误和缺陷:下一个前沿
  • 批准号:
    1341270
  • 财政年份:
    2013
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
SHF:Medium:Collaborative Research: AgeELESS: Aging Estimation and Lifetime Enhancement in Silicon Systems
SHF:中:合作研究:AgeELESS:硅系统中的老化估计和寿命增强
  • 批准号:
    1161332
  • 财政年份:
    2012
  • 资助金额:
    $ 60万
  • 项目类别:
    Continuing Grant
II-NEW: Robust Carbon Nanotube Technology for Energy-Efficient Computing Systems: A Processing and Design Infrastructure for Emerging Nanotechnologies
II-新:用于节能计算系统的稳健碳纳米管技术:新兴纳米技术的处理和设计基础设施
  • 批准号:
    1059020
  • 财政年份:
    2011
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Variability-Aware Software for Efficient Computing with Nanoscale Devices
协作研究:利用纳米级设备进行高效计算的可变性感知软件
  • 批准号:
    1028831
  • 财政年份:
    2010
  • 资助金额:
    $ 60万
  • 项目类别:
    Continuing Grant
Collaborative Research: Globally Optimized Robust Systems on Multi-Core Hardware
协作研究:多核硬件上的全局优化鲁棒系统
  • 批准号:
    0903459
  • 财政年份:
    2009
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Design, Modeling, Automation and Experimentation of Imperfection Immune Carbon Nanotube Field Effect Transitor Circuits
合作研究:不完美免疫碳纳米管场效应晶体管电路的设计、建模、自动化和实验
  • 批准号:
    0702343
  • 财政年份:
    2007
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant

相似国自然基金

Research on Quantum Field Theory without a Lagrangian Description
  • 批准号:
    24ZR1403900
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
Cell Research
  • 批准号:
    31224802
  • 批准年份:
    2012
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research
  • 批准号:
    31024804
  • 批准年份:
    2010
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research (细胞研究)
  • 批准号:
    30824808
  • 批准年份:
    2008
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
  • 批准号:
    10774081
  • 批准年份:
    2007
  • 资助金额:
    45.0 万元
  • 项目类别:
    面上项目

相似海外基金

Collaborative Research: Using Machine Learning to Improve Visual Problem-Solving in Chemistry Education
协作研究:利用机器学习提高化学教育中的视觉问题解决能力
  • 批准号:
    2235790
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Indigenous Northern Landscapes, Visual Repatriation, and Collaborative Knowledge Exchange
合作研究:北方本土景观、视觉归还和合作知识交流
  • 批准号:
    2330924
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Visual Information about surface curvature from patterns of image shading and contours
合作研究:从图像阴影和轮廓图案中获取有关表面曲率的视觉信息
  • 批准号:
    2238180
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Visual Information about surface curvature from patterns of image shading and contours
合作研究:从图像阴影和轮廓图案中获取有关表面曲率的视觉信息
  • 批准号:
    2238179
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Medium: Modeling and Mitigating Confirmation Bias in Visual Data Analysis
合作研究:HCC:媒介:可视化数据分析中的建模和减轻确认偏差
  • 批准号:
    2311575
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Indigenous Northern Landscapes, Visual Repatriation, and Collaborative Knowledge Exchange
合作研究:北方本土景观、视觉归还和合作知识交流
  • 批准号:
    2330923
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: Indigenous Northern Landscapes, Visual Repatriation, and Collaborative Knowledge Exchange
合作研究:北方本土景观、视觉归还和合作知识交流
  • 批准号:
    2330922
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Continuing Grant
Collaborative Research: Using Machine Learning to Improve Visual Problem-Solving in Chemistry Education
协作研究:利用机器学习提高化学教育中的视觉问题解决能力
  • 批准号:
    2235485
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Medium: Modeling and Mitigating Confirmation Bias in Visual Data Analysis
合作研究:HCC:媒介:可视化数据分析中的建模和减轻确认偏差
  • 批准号:
    2311574
  • 财政年份:
    2023
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
Collaborative Research: SaTC: CORE: Small: Understanding how visual features of misinformation influence credibility perceptions
协作研究:SaTC:核心:小:了解错误信息的视觉特征如何影响可信度认知
  • 批准号:
    2150723
  • 财政年份:
    2022
  • 资助金额:
    $ 60万
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了