RI: Small: Modules for neural computation

RI：小型：神经计算模块

• 批准号: 1910864
• 负责人: Konrad Kording
• 金额: $ 45.27万
• 依托单位: University of Pennsylvania
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1910864&HistoricalAwards=false
• 关键词: RI; Small; Modules; neural; computation

Artificial intelligence need not replicate the human brain, but may constructively take inspiration from it. The brain is organized hierarchically, from large brain structures to smaller regions, cortical columns, all the way down to microcircuits made of a few interacting neurons. These modules may make our brains more efficient by dissecting problems into locally solvable subproblems. This in turn may make us learn faster by figuring out where in the brain a mistake was made and allow us to do better on new problems. Modules may also make the brain more efficient, allowing it to use fewer neurons and synapses. In those areas where brains seem to benefit from modularity, modern deep learning systems appear to be weaker. Building modules into deep neural networks promises to greatly improve generalization, interpretability, credit assignment in learning, computational cost and make them more resilient to adversarial stimuli. The result of this project will be improvements to the performance and understanding of modern artificial intelligence systems. The project will contribute in a broad way to the dissemination of computational results to neuroscience and of neuroscience results to the computational community through a combination of summer schools, teaching, and publishing. To meet these goals, this project enables a broadly interdisciplinary approach both to produce systems with modularity and to dissect their modular aspects. The research aims to build networks that, while learning, dissect training tasks by incrementally developing structural modules. This is done by minimizing cost functions that evaluate the community structure of neuron connectivity. It will design learning algorithms that encourage modularity by performing credit assignment at the level of modules. This is done by gating learning at both the neuron and the module level. Finally, the project team will develop tools for interpreting modular networks. This is done by performing psychophysical experiments with human subjects and by computational analysis. All of these components interrelate, provide a unified picture of how modularity can improve current machine learning approaches, and build a new bridge between neuroscience and deep learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人工智能不需要复制人脑，但可以建设性地从中汲取灵感。大脑是分层组织的，从大的大脑结构到小的区域，皮层柱，一直到由几个相互作用的神经元组成的微电路。这些模块可以通过将问题分解成局部可解决的子问题，使我们的大脑更有效率。反过来，这可能会让我们通过找出大脑中出现错误的地方来更快地学习，并让我们在新问题上做得更好。模块也可能使大脑更有效率，允许它使用更少的神经元和突触。在那些大脑似乎受益于模块化的领域，现代深度学习系统似乎更弱。将模块构建到深度神经网络中有望极大地提高泛化、可解释性、学习中的信用分配、计算成本，并使它们对对抗刺激更具弹性。该项目的结果将是提高现代人工智能系统的性能和理解。该项目将通过暑期学校、教学和出版的结合，广泛传播神经科学的计算结果，并将神经科学的结果传播给计算界。为了达到这些目标，该项目启用了广泛的跨学科方法，既可以产生具有模块化的系统，又可以剖析其模块化方面。这项研究的目的是建立一个网络，在学习的同时，通过逐步开发结构模块来剖析训练任务。这是通过最小化评估神经元连通性社区结构的代价函数来实现的。它将设计学习算法，通过在模块级别执行学分分配来鼓励模块化。这是通过神经元和模块级别的门控学习来完成的。最后，项目团队将开发用于解释模块化网络的工具。这是通过对人类受试者进行心理物理实验和计算分析来完成的。所有这些组件都是相互关联的，为模块化如何改进当前的机器学习方法提供了一个统一的图景，并在神经科学和深度学习之间建立了一座新的桥梁。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。