Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders
Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders
复制标题
DOI：
10.1016/j.neuron.2008.11.004
复制
发表时间：
2008-12-11
期刊：
影响因子：
16.2
通讯作者：
Kamitani, Yukiyasu
中科院分区：
文献类型：
--
作者：
Miyawaki, Yoichi;Uchida, Hajime;Kamitani, Yukiyasu
知觉经验由大量可能的状态组成。以前的功能磁共振成像研究通过将大脑活动分类到预先指定的类别来预测感知状态。无约束的视觉图像重建更具挑战性，因为为所有可能的图像指定大脑活动是不切实际的。在这项研究中，我们通过结合多个尺度的局部图像基来重建视觉图像，这些图像基的对比度通过自动选择相关体素并利用它们的相关模式从fMRI活动中独立解码。二元对比，10 × 10个补丁图像（2100种可能的状态）在没有任何图像的情况下，通过测量几百张随机图像的大脑活动，在单次试验或体积基础上精确重建。重建还用于在数百万候选图像中识别呈现的图像。结果表明，我们的方法提供了一种有效的方法，可以从大脑活动中读出复杂的感知状态，同时发现多体素模式的信息表示。
Perceptual experience consists of an enormous number of possible states. Previous fMRI studies have predicted a perceptual state by classifying brain activity into prespecified categories. Constraint-free visual image reconstruction is more challenging, as it is impractical to specify brain activity for all possible images. In this study, we reconstructed visual images by combining local image bases of multiple scales, whose contrasts were independently decoded from fMRI activity by automatically selecting relevant voxels and exploiting their correlated patterns. Binary-contrast, 10 x 10-patch images (2100 possible states) were accurately reconstructed without any image prior on a single trial or volume basis by measuring brain activity only for several hundred random images. Reconstruction was also used to identify the presented image among millions of candidates.,The results suggest that our approach provides an effective means to read out complex perceptual states from brain activity while discovering information representation in multivoxel patterns.