Neural portraits of perception: reconstructing face images from evoked brain activity.
Neural portraits of perception: reconstructing face images from evoked brain activity.
复制标题
DOI：
10.1016/j.neuroimage.2014.03.018
复制
发表时间：
2014-07-01
期刊：
影响因子：
5.7
通讯作者：
Kuhl BA
中科院分区：
文献类型：
--
作者：
Cowen AS;Chun MM;Kuhl BA
最近神经影像学的进步使得视觉体验可以从大脑活动的模式中重建出来。虽然神经重建的复杂程度不等，但它们几乎完全依赖于视觉输入和早期视觉皮层活动之间的视网膜定位映射。然而，主观感知信息与尚未被用作神经重建的主要基础的更高级别的皮层区域联系更紧密。此外，迄今为止，没有重建研究报告的面部图像，激活高度分布的皮层网络的重建。因此，我们研究了（a）是否可以从神经活动的分布模式中准确地重建个体面部图像，以及（B）即使排除枕叶皮层内的活动，是否也可以实现这一点。我们的方法包括四个步骤。(1)主成分分析（PCA）被用来识别组件，有效地代表了一组训练的面孔。(2)然后，使用机器学习算法将识别出的组件映射到在观看训练面部时收集的fMRI活动。(3)基于一组新的测试面孔引发的活动，该算法预测了相关的组成部分得分。(4)最后，将这些分数转换为重建图像。使用客观和主观的验证措施，我们表明，我们的方法产生惊人的准确的神经重建的脸，即使不包括枕叶皮层。这种方法不仅代表了一种新的和有前途的方法来调查脸的知觉，但也建议重建“离线”的视觉经验，包括梦，记忆和幻想，这主要是在更高层次的皮层区域表示的途径。
Recent neuroimaging advances have allowed visual experience to be reconstructed from patterns of brain activity. While neural reconstructions have ranged in complexity, they have relied almost exclusively on retinotopic mappings between visual input and activity in early visual cortex. However, subjective perceptual information is tied more closely to higher-level cortical regions that have not yet been used as the primary basis for neural reconstructions. Furthermore, no reconstruction studies to date have reported reconstructions of face images, which activate a highly distributed cortical network. Thus, we investigated (a) whether individual face images could be accurately reconstructed from distributed patterns of neural activity, and (b) whether this could be achieved even when excluding activity within occipital cortex. Our approach involved four steps. (1) Principal component analysis (PCA) was used to identify components that efficiently represented a set of training faces. (2) The identified components were then mapped, using a machine learning algorithm, to fMRI activity collected during viewing of the training faces. (3) Based on activity elicited by a new set of test faces, the algorithm predicted associated component scores. (4) Finally, these scores were transformed into reconstructed images. Using both objective and subjective validation measures, we show that our methods yield strikingly accurate neural reconstructions of faces even when excluding occipital cortex. This methodology not only represents a novel and promising approach for investigating face perception, but also suggests avenues for reconstructing ‘offline’ visual experiences—including dreams, memories, and imagination—which are chiefly represented in higher-level cortical areas.
登录
查看更多内容
影响因子：
9.2
作者：
Nishimoto, Shinji;Vu, An T.;Naselaris, Thomas;Benjamini, Yuval;Yu, Bin;Gallant, Jack L.
通讯作者：
Gallant, Jack L.
影响因子：
4.8
作者：
Fox, Christopher J.;Iaria, Giuseppe;Barton, Jason J. S.
通讯作者：
Barton, Jason J. S.
影响因子：
3.2
作者：
Gauthier, I;Tarr, MJ;Anderson, AW
通讯作者：
Anderson, AW
影响因子：
2.6
作者：
Gobbini, M. Ida;Haxby, James V.
通讯作者：
Haxby, James V.
DOI：
10.1073/pnas.1102433108
发表时间：
2011-06-14
影响因子：
11.1
作者：
Nestor, Adrian;Plaut, David C.;Behrmann, Marlene
通讯作者：
Behrmann, Marlene