Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses.
Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses.
复制标题
DOI：
10.1523/eneuro.0203-16.2016
复制
发表时间：
2016-11
期刊：
影响因子：
3.4
通讯作者：
Parra LC
中科院分区：
文献类型：
--
作者：
Cohen SS;Parra LC
我们的大脑整合了各种感官形式的信息，以产生感知体验并形成记忆。然而，很难确定在何种条件下，多感官刺激将有利于或阻碍日常经验的检索。我们假设，决定因素是信息处理的可靠性，在刺激呈现，这可以通过刺激诱发活动的主体间相关性来衡量。因此，我们提出了传记听觉叙事和视觉动画72人受试者视觉，coursorily，或组合，而神经活动记录使用脑电图。3周后，测试听觉流中所包含的叙述信息的记忆。虽然单独的视觉刺激不会导致有意义的提取，但当它与故事相结合时，这种相关刺激会改善记忆，即使它与音频在时间上不一致。此外，具有更好的后续记忆的个体在编码过程中引起的神经反应与同龄人的相关性更高。令人惊讶的是，无论刺激的感觉方式如何，这种预测性同步活动的部分都存在。这些数据表明，感觉和超模态活动的强度是3周后的记忆表现的预测，神经同步可以解释这些现实世界的刺激所观察到的功能上无信息的视觉环境的记忆益处。
Our brains integrate information across sensory modalities to generate perceptual experiences and form memories. However, it is difficult to determine the conditions under which multisensory stimulation will benefit or hinder the retrieval of everyday experiences. We hypothesized that the determining factor is the reliability of information processing during stimulus presentation, which can be measured through intersubject correlation of stimulus-evoked activity. We therefore presented biographical auditory narratives and visual animations to 72 human subjects visually, auditorily, or combined, while neural activity was recorded using electroencephalography. Memory for the narrated information, contained in the auditory stream, was tested 3 weeks later. While the visual stimulus alone led to no meaningful retrieval, this related stimulus improved memory when it was combined with the story, even when it was temporally incongruent with the audio. Further, individuals with better subsequent memory elicited neural responses during encoding that were more correlated with their peers. Surprisingly, portions of this predictive synchronized activity were present regardless of the sensory modality of the stimulus. These data suggest that the strength of sensory and supramodal activity is predictive of memory performance after 3 weeks, and that neural synchrony may explain the mnemonic benefit of the functionally uninformative visual context observed for these real-world stimuli.