Mapping multidimensional content representations to neural and behavioral expressions of episodic memory.
Mapping multidimensional content representations to neural and behavioral expressions of episodic memory.
复制标题
DOI：
10.1016/j.neuroimage.2023.120222
复制
发表时间：
2023-08-15
期刊：
影响因子：
5.7
通讯作者：
Kuhl, Brice A.
中科院分区：
文献类型：
--
作者：
Wang, Yingying;Lee, Hongmi;Kuhl, Brice A.
人类神经成像研究表明，情景记忆的内容以神经活动的分布模式表现出来。然而，这些研究大多局限于解码刺激的简单、单维特性。相比之下，语义编码模型提供了一种描述包含情景记忆的丰富、多维信息的方法。在这里，我们广泛取样了四名人类fMRI受试者建立语义编码模型，然后应用这些模型从自然场景图像中重建内容，因为他们被观看和从记忆中回忆。首先，我们发现，在观看场景和从记忆中回忆场景时，多维语义信息成功地从视觉和侧顶叶皮层的活动模式中重建出来。第二，虽然视觉皮层重建在观看图像时比从记忆中回想图像时更准确，但侧顶叶重建在视觉感知和记忆中同样准确。第三，通过将自然语言处理方法应用于言语回忆数据，我们发现基于fmri的重建能够可靠地匹配受试者对其记忆的言语描述。事实上，从腹侧颞叶皮层重建的图像与被试自己的言语记忆比其他被试对相同图像的言语记忆更吻合。第四，编码模型可靠地跨被试转移：使用完全独立的被试数据训练的编码模型成功重建记忆。总之，这些发现为多维和特异记忆表征的成功重建提供了证据，并突出了视觉皮层和侧顶叶区域对来自外部视觉环境的信息与内部产生的记忆的不同敏感性。
Human neuroimaging studies have shown that the contents of episodic memories are represented in distributed patterns of neural activity. However, these studies have mostly been limited to decoding simple, unidimensional properties of stimuli. Semantic encoding models, in contrast, offer a means for characterizing the rich, multidimensional information that comprises episodic memories. Here, we extensively sampled four human fMRI subjects to build semantic encoding models and then applied these models to reconstruct content from natural scene images as they were viewed and recalled from memory. First, we found that multidimensional semantic information was successfully reconstructed from activity patterns across visual and lateral parietal cortices, both when viewing scenes and when recalling them from memory. Second, whereas visual cortical reconstructions were much more accurate when images were viewed versus recalled from memory, lateral parietal reconstructions were comparably accurate across visual perception and memory. Third, by applying natural language processing methods to verbal recall data, we showed that fMRI-based reconstructions reliably matched subjects’ verbal descriptions of their memories. In fact, reconstructions from ventral temporal cortex more closely matched subjects’ own verbal recall than other subjects’ verbal recall of the same images. Fourth, encoding models reliably transferred across subjects: memories were successfully reconstructed using encoding models trained on data from entirely independent subjects. Together, these findings provide evidence for successful reconstructions of multidimensional and idiosyncratic memory representations and highlight the differential sensitivity of visual cortical and lateral parietal regions to information derived from the external visual environment versus internally-generated memories.
登录
查看更多内容
影响因子：
5.7
作者：
Cowen AS;Chun MM;Kuhl BA
通讯作者：
Kuhl BA
影响因子：
15.9
作者：
Favila SE;Lee H;Kuhl BA
通讯作者：
Kuhl BA
影响因子：
16.6
作者：
Bone, Michael B.;Ahmad, Fahad;Buchsbaum, Bradley R.
通讯作者：
Buchsbaum, Bradley R.
影响因子：
3.7
作者：
Esteban, Oscar;Birman, Daniel;Gorgolewski, Krzysztof J.
通讯作者：
Gorgolewski, Krzysztof J.
影响因子：
3.2
作者：
Kok, Peter;Rait, Lindsay I.;Turk-Browne, Nicholas B.
通讯作者：
Turk-Browne, Nicholas B.