Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networks.

Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networks.
复制标题

DOI:
10.1016/j.neuroimage.2016.03.063
复制
发表时间:
2017-06
期刊:
影响因子:
5.7
通讯作者:
Oliva A
Oliva A
中科院分区:
医学1区
文献类型:
--
作者:
Martin Cichy R;Khosla A;Pantazis D;Oliva A

文献摘要

参考文献

被引文献

相似文献

人类场景识别是一个快速的多步骤的过程,随着时间的推移,从单一的场景图像的空间布局处理。我们使用多变量模式分析脑磁图(MEG)数据解开这个皮层过程的时间过程。在~100 ms的单个场景的较低级别视觉分析的早期信号之后,我们发现了真实世界场景大小的标记,即空间布局处理,在~250 ms索引神经表征对不相关场景属性和观看条件的变化具有鲁棒性。对于场景大小表示如何在大脑中出现的定量模型,我们将MEG数据与在场景分类上训练的深度神经网络模型进行了比较。场景大小的表征在模型中内在地出现,并解决了新兴的神经场景大小表征。我们的数据一起提供了人类布局处理的电生理信号的第一个描述,并表明深度神经网络是研究空间布局表示如何在人脑中出现的一个有前途的框架。
Human scene recognition is a rapid multistep process evolving over time from single scene image to spatial layout processing. We used multivariate pattern analyses on magnetoencephalography (MEG) data to unravel the time course of this cortical process. Following an early signal for lower-level visual analysis of single scenes at ~100 ms, we found a marker of real-world scene size, i.e. spatial layout processing, at ~250 ms indexing neural representations robust to changes in unrelated scene properties and viewing conditions. For a quantitative model of how scene size representations may arise in the brain, we compared MEG data to a deep neural network model trained on scene classification. Representations of scene size emerged intrinsically in the model, and resolved emerging neural scene size representation. Together our data provide a first description of an electrophysiological signal for layout processing in humans, and suggest that deep neural networks are a promising framework to investigate how spatial layout representations emerge in the human brain.
DOI: 10.1038/33402
发表时间: 1998-04-09
期刊: NATURE
影响因子: 64.8
作者:
Epstein, R;Kanwisher, N
通讯作者: Kanwisher, N
DOI: 10.1523/jneurosci.0723-10.2010
发表时间: 2010-09-01
影响因子: 5.3
作者:
Bird, Chris M.;Capponi, Corinne;Burgess, Neil
通讯作者: Burgess, Neil
DOI: 10.1038/nn.3466
发表时间: 2013-09
影响因子: 25
作者:
Jacobs, Joshua;Weidemann, Christoph T.;Miller, Jonathan F.;Solway, Alec;Burke, John F.;Wei, Xue-Xin;Suthana, Nanthia;Sperling, Michael R.;Sharan, Ashwini D.;Fried, Itzhak;Kahana, Michael J.
通讯作者: Kahana, Michael J.
DOI: 10.1523/jneurosci.2828-13.2014
发表时间: 2014-04-02
影响因子: 5.3
作者:
Clarke, Alex;Tyler, Lorraine K.
通讯作者: Tyler, Lorraine K.
DOI: 10.1016/j.neuroimage.2015.07.011
发表时间: 2015-11-01
期刊: NEUROIMAGE
影响因子: 5.7
作者:
Cichy, Radoslaw Martin;Ramirez, Fernando Mario;Pantazis, Dimitrios
通讯作者: Pantazis, Dimitrios