Dynamic Electrode-to-Image (DETI) mapping reveals the human brain's spatiotemporal code of visual information.
Dynamic Electrode-to-Image (DETI) mapping reveals the human brain's spatiotemporal code of visual information.
复制标题
动态电极到图像（DETI）映射揭示了人脑视觉信息的时空编码。
DOI：
10.1371/journal.pcbi.1009456
复制
发表时间：
2021-09
影响因子：
4.3
通讯作者：
Field DJ
中科院分区：
文献类型：
--
作者：
Hansen BC;Greene MR;Field DJ
许多神经成像技术已经被用来理解视觉信息是如何沿着视觉通路转换的。尽管每种技术都有空间和时间上的限制，但它们都可以为可视化代码提供重要的见解。虽然fMRI的BOLD信号可以提供相当多的信息，但视觉代码不是静态的，这可能会被fMRI较差的时间分辨率所掩盖。在这项研究中，我们利用脑电图的高时间分辨率来开发一种基于真实世界场景产生的响应分布的编码技术。这种方法将神经信号映射到给定图像中的每个像素，并揭示视觉代码的特定位置转换，为每个电极上的图像提供时空特征。我们对映射结果的分析表明，随着时间的推移，场景经历了一系列不均匀的转换，在场景的不同区域优先考虑不同的空间频率。这种映射技术为未来探索动态前馈和循环过程如何告知和改进我们视觉世界的高级表示提供了潜在的途径。我们从环境中采集的视觉信息经历了一系列的神经修饰，每一种修饰状态（或视觉代码）都由沿着视觉通路的神经元的独特反应分布组成。然而，目前的非侵入性神经成像技术提供了一个关于时间或空间的粗糙代码的描述。在这里，我们提出了动态电极到图像（DETI）映射，这是一种分析技术，利用脑电图的高时间分辨率将神经信号映射到给定图像中的每个像素，以揭示视觉代码的特定位置修改。DETI技术揭示了在每个像素和每个时间点与神经信号相关的特征图。DETI映射表明，现实世界的场景在空间和时间上经历了一系列不均匀的变化。具体来说，我们发现视觉编码以特定位置的方式变化，可能反映了神经处理随着时间的推移在不同图像位置优先处理不同的特征。因此，DETI映射为未来的研究提供了一个潜在的途径，以探索每种修改状态如何通知和精炼我们视觉世界的概念意义。
A number of neuroimaging techniques have been employed to understand how visual information is transformed along the visual pathway. Although each technique has spatial and temporal limitations, they can each provide important insights into the visual code. While the BOLD signal of fMRI can be quite informative, the visual code is not static and this can be obscured by fMRI’s poor temporal resolution. In this study, we leveraged the high temporal resolution of EEG to develop an encoding technique based on the distribution of responses generated by a population of real-world scenes. This approach maps neural signals to each pixel within a given image and reveals location-specific transformations of the visual code, providing a spatiotemporal signature for the image at each electrode. Our analyses of the mapping results revealed that scenes undergo a series of nonuniform transformations that prioritize different spatial frequencies at different regions of scenes over time. This mapping technique offers a potential avenue for future studies to explore how dynamic feedforward and recurrent processes inform and refine high-level representations of our visual world. The visual information that we sample from our environment undergoes a series of neural modifications, with each modification state (or visual code) consisting of a unique distribution of responses across neurons along the visual pathway. However, current noninvasive neuroimaging techniques provide an account of that code that is coarse with respect to time or space. Here, we present dynamic electrode-to-image (DETI) mapping, an analysis technique that capitalizes on the high temporal resolution of EEG to map neural signals to each pixel within a given image to reveal location-specific modifications of the visual code. The DETI technique reveals maps of features that are associated with the neural signal at each pixel and at each time point. DETI mapping shows that real-world scenes undergo a series of nonuniform modifications over both space and time. Specifically, we find that the visual code varies in a location-specific manner, likely reflecting that neural processing prioritizes different features at different image locations over time. DETI mapping therefore offers a potential avenue for future studies to explore how each modification state informs and refines the conceptual meaning of our visual world.
登录
查看更多内容
影响因子：
3.7
作者：
Berman D;Golomb JD;Walther DB
通讯作者：
Walther DB
影响因子：
1.8
作者：
Gosselin, F;Schyns, PG
通讯作者：
Schyns, PG
影响因子：
1.8
作者：
BAUMAN, LA;BONDS, AB
通讯作者：
BONDS, AB
影响因子：
5.3
作者：
Bastin, Julien;Vidal, Juan R.;Epstein, Russell A.
通讯作者：
Epstein, Russell A.
影响因子：
8.2
作者：
Greene MR;Oliva A
通讯作者：
Oliva A