Photorealistic Reconstruction of Visual Texture From EEG Signals.
Photorealistic Reconstruction of Visual Texture From EEG Signals.
复制标题
DOI：
10.3389/fncom.2021.754587
复制
发表时间：
2021
影响因子：
3.2
通讯作者：
Motoyoshi I
中科院分区：
文献类型：
--
作者：
Wakita S;Orima T;Motoyoshi I
大脑解码的最新进展使得根据神经活动对图像类别进行分类成为可能。越来越多的研究进一步尝试重建图像本身。然而，由于物体和场景的图像本质上涉及空间布局信息，因此重建通常需要具有高空间分辨率的视网膜局部组织的神经数据，例如功能磁共振成像信号。相比之下，空间布局对于“纹理”的感知并不重要，众所周知，“纹理”在视觉皮层中表示为空间全局图像统计数据。 “纹理”的这种特性使我们能够从空间分辨率较低的脑电图信号中重建感知图像。在这里，我们提出了一种基于 MVAE 的方法，用于根据观察者观察自然纹理（例如各种表面和物体集合的纹理）测量的视觉诱发电位来重建纹理图像。这种方法使我们能够重建在感知上类似于原始纹理且具有摄影外观的图像。本方法可以用作解码来自大脑活动的感官刺激的高度详细的“印象”的方法。
Recent advances in brain decoding have made it possible to classify image categories based on neural activity. Increasing numbers of studies have further attempted to reconstruct the image itself. However, because images of objects and scenes inherently involve spatial layout information, the reconstruction usually requires retinotopically organized neural data with high spatial resolution, such as fMRI signals. In contrast, spatial layout does not matter in the perception of “texture,” which is known to be represented as spatially global image statistics in the visual cortex. This property of “texture” enables us to reconstruct the perceived image from EEG signals, which have a low spatial resolution. Here, we propose an MVAE-based approach for reconstructing texture images from visual evoked potentials measured from observers viewing natural textures such as the textures of various surfaces and object ensembles. This approach allowed us to reconstruct images that perceptually resemble the original textures with a photographic appearance. The present approach can be used as a method for decoding the highly detailed “impression” of sensory stimuli from brain activity.
登录
查看更多内容
影响因子：
9.2
作者：
Nishimoto, Shinji;Vu, An T.;Naselaris, Thomas;Benjamini, Yuval;Yu, Bin;Gallant, Jack L.
通讯作者：
Gallant, Jack L.
影响因子：
64.8
作者：
Motoyoshi, Isamu;Nishida, Shin'ya;Adelson, Edward H.
通讯作者：
Adelson, Edward H.
影响因子：
25
作者：
Kamitani, Y;Tong, F
通讯作者：
Tong, F
影响因子：
25
作者：
Freeman, Jeremy;Ziemba, Corey M.;Heeger, David J.;Simoncelli, Eero P.;Movshon, Anthony
通讯作者：
Movshon, Anthony
影响因子：
3
作者：
JULESZ, B
通讯作者：
JULESZ, B