A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence
A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence
复制标题
DOI：
10.1038/s41593-021-00962-x
复制
发表时间：
2021-12-16
影响因子：
25
通讯作者：
Kay, Kendrick
中科院分区：
文献类型：
--
作者：
Allen, Emily J.;St-Yves, Ghislain;Kay, Kendrick
在丰富的认知现象中对神经活动进行广泛的采样对于深入了解大脑功能至关重要。在这里，我们提出了自然场景数据集（NSD），其中高分辨率的功能磁共振成像响应数以万计的丰富注释的自然场景进行了测量，而参与者进行了连续的识别任务。为了优化数据质量，我们开发并应用了新的估计和去噪技术。简单的视觉检查的NSD数据揭示了明确的代表性的转变沿着腹侧视觉通路。为了进一步说明数据集的推理能力，我们使用NSD来构建和训练深度神经网络模型，这些模型比计算机视觉的最先进模型更准确地预测大脑活动。NSD还包括大量的静息状态和扩散数据，使网络神经科学的观点，以约束和增强感知和记忆的模型。鉴于其前所未有的规模，质量和广度，NSD开辟了认知神经科学和人工智能研究的新途径。作者测量了八个人的高分辨率fMRI活动，这些人在一年内看到并记住了数千张带注释的自然图像。这个庞大的数据集为认知神经科学和人工智能提供了新的探索路径。
Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in which high-resolution functional magnetic resonance imaging responses to tens of thousands of richly annotated natural scenes were measured while participants performed a continuous recognition task. To optimize data quality, we developed and applied novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear representational transformations along the ventral visual pathway. Further exemplifying the inferential power of the dataset, we used NSD to build and train deep neural network models that predict brain activity more accurately than state-of-the-art models from computer vision. NSD also includes substantial resting-state and diffusion data, enabling network neuroscience perspectives to constrain and enhance models of perception and memory. Given its unprecedented scale, quality and breadth, NSD opens new avenues of inquiry in cognitive neuroscience and artificial intelligence.The authors measured high-resolution fMRI activity from eight individuals who saw and memorized thousands of annotated natural images over 1 year. This massive dataset enables new paths of inquiry in cognitive neuroscience and artificial intelligence.