RI: Small: A Hierarchical Approach to Unsupervised Feature Discovery

RI：小型：无监督特征发现的分层方法

• 批准号: 1219252
• 负责人: Garrison Cottrell
• 金额: $ 40万
• 依托单位: University of California-San Diego
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-01 至 2016-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1219252&HistoricalAwards=false
• 关键词: RI; Small; Hierarchical; Approach; Unsupervised

Contrary to some depictions in popular media, humans are still far better than any computer program at understanding the visual world around them. If we understood how the visual system does this, perhaps better artificial vision systems could be built. The goal of this project is to understand how the brain represents the visual world and why. Following a mantra famously credited to Richard Feynman -- What I cannot create, I do not understand -- this project's approach is to create a computer system that learns from natural input (images, videos), assuming that the visual system operates with the goal of efficiently representing the world. These representations will then be compared to measurements of visual neurons. The long term goal is to understand the functional roles of the early visual processing layers in the human visual pathway.The model is based on the efficient coding hypothesis, in which the early visual pathway serves to capture the statistical structure of its visual inputs by efficiently coding visual information in its outputs. Most computational models following this hypothesis have focused on modeling only one or two visual layers. In this project, Cottrell's group proposes a hierarchical information processing model, which concurs with the efficient coding hypothesis, yet provides the most complete description so far of the early visual processing layers. In this model, the visual inputs are first compressed to reduce noise using Sparse Principal Components Analysis (SPCA), then the data dimensions are expanded to capture the statistical structure of the visual inputs using overcomplete Sparse Coding. A nonlinear activation function then formats the outputs of this layer for the next layer up, and the whole process is repeated. Preliminary work shows that the resulting hierarchical model can learn visual features exhibiting the receptive field properties of neurons in the early visual pathway, including retinal ganglion cells, LGN, V1 simple and complex cells, and V2 cells.

与流行媒体上的一些描述相反，人类在理解周围的视觉世界方面仍然比任何计算机程序都要好得多。如果我们了解视觉系统是如何做到这一点的，或许可以建造更好的人工视觉系统。这个项目的目标是了解大脑如何代表视觉世界以及为什么。根据理查德·费曼的一句名言--我不能创造的，我不明白的--这个项目的方法是创建一个从自然输入(图像、视频)中学习的计算机系统，假设视觉系统的运行目标是有效地代表世界。然后将这些表示与视觉神经元的测量结果进行比较。该模型基于有效编码假说，即早期视觉通路通过对输出中的视觉信息进行有效编码来捕捉其视觉输入的统计结构。大多数遵循这一假设的计算模型都专注于只对一个或两个视觉层进行建模。在这个项目中，Cottrell的小组提出了一个分层的信息处理模型，该模型符合高效编码假设，但提供了迄今为止对早期视觉处理层最完整的描述。在该模型中，首先使用稀疏主成分分析(SPCA)对视觉输入进行压缩以降低噪声，然后使用过完备稀疏编码对数据维度进行扩展以获取视觉输入的统计结构。然后，非线性激活函数将这一层的输出格式化以用于下一层，并且重复整个过程。初步工作表明，所得到的分层模型可以学习表现早期视觉通路中神经元的感受场特性的视觉特征，包括视网膜神经节细胞、LGN、V1简单和复杂细胞以及V2细胞。