权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

RI: Small: Integrating Flexible Normalization Models of Visual Cortex into Deep Neural Networks

RI：小：将视觉皮层的灵活标准化模型集成到深度神经网络中

基本信息

批准号：
1715475
负责人：
Odelia Schwartz
金额：
$ 35万
依托单位：
University of Miami
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2017
资助国家：
美国
起止时间：
2017-09-01 至 2021-08-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1715475&HistoricalAwards=false
关键词：
RI Small Integrating Flexible Normalization

项目摘要

Recent advances in artificial intelligence models of deep neural networks have led to tremendous progress in artificial systems that recognize objects in scenes, and in a host of other applications such as speech recognition, and robotics. Although deep neural networks often incorporate computations inspired by the brain, these have typically been applied in a fairly simple and restrictive manner, rather than based on more principled models of neural processing in the brain. Using vision as a paradigmatic example, this project proposes that artificial systems can benefit from integrating approaches that have been developed in biological models of neural processing of scenes. The biological models make use of contextual flexibility, whereby neurons are influenced in a rich way by the image structure that spatially surrounds a given object or feature. This flexibility is expected to improve task performance in deep neural networks, and to impact development of artificial systems that are more compatible with human cognition. The resulting framework, with its deep architecture spanning multiple layers of processing, will, in turn, make predictions about neural processing in the brain, which will impact the neuroscience and cognitive science communities. This project focuses specifically on normalization, a nonlinear computation that is ubiquitous in the brain, and that has been shown to benefit task performance in deep neural networks. The project will develop more principled strategies for determining normalization in deep convolutional neural networks. The main focus will be on learning a form of flexible normalization based on scene statistics models of visual cortex. In this framework, normalization is recruited only to the degree that a visual input is inferred to contain statistical dependencies across space. Performance will be tested for classification and segmentation on large-scale image databases, and will also target tasks more suited to mid-level vision such as figure/ground judgment. This will result in better understanding of normalization nonlinearities in deep convolutional networks, and the implications of flexible normalization for task performance and generalization compared to other forms of normalization. Biologically, normalization is poorly understood beyond primary visual cortex. The models developed will help shed light on the equivalence of this inference for middle cortical areas, and make predictions about what image structure leads to recruitment of normalization. This project will also include launching of an interdisciplinary Deep Learning Discussion Group.

深度神经网络人工智能模型的最新进展导致了识别场景中对象的人工系统以及语音识别和机器人等许多其他应用的巨大进步。尽管深层神经网络经常包含受大脑启发的计算，但这些计算通常以相当简单和受限的方式应用，而不是基于大脑中更原则性的神经处理模型。以视觉为范例，该项目提出，人工系统可以从整合场景神经处理的生物学模型中开发的方法中受益。生物模型利用了上下文的灵活性，即神经元在空间上受到围绕给定物体或特征的图像结构的丰富影响。这种灵活性有望改善深度神经网络的任务性能，并影响更符合人类认知的人工系统的发展。由此产生的框架，其深层架构跨越多个处理层，反过来将对大脑中的神经处理做出预测，这将影响神经科学和认知科学界。这个项目特别关注归一化，这是一种在大脑中普遍存在的非线性计算，已被证明有助于深层神经网络中的任务表现。该项目将为确定深度卷积神经网络的归一化制定更有原则性的策略。主要的重点将是学习一种基于视觉皮质场景统计模型的灵活归一化形式。在这个框架中，归一化只在视觉输入被推断为包含跨空间的统计相关性的程度上才被招募。性能将在大规模图像数据库上进行分类和分割测试，还将针对更适合中层视觉的任务，如图形/背景判断。这将导致更好地理解深度卷积网络中的归一化非线性，以及与其他形式的归一化相比，灵活归一化对任务性能和泛化的影响。生物学上，对初级视觉皮质以外的正常化知之甚少。开发的模型将有助于阐明这一推论在中皮层区域的等价性，并预测什么图像结构导致招募归一化。该项目还将包括发起一个跨学科的深度学习讨论小组。