Long short-term memory-based neural decoding of object categories evoked by natural images.
Long short-term memory-based neural decoding of object categories evoked by natural images.
复制标题
对自然图像引起的对象类别进行基于长短期记忆的神经解码
DOI：
10.1002/hbm.25136
复制
发表时间：
2020-10-15
影响因子：
4.8
通讯作者：
Chen H
中科院分区：
文献类型：
--
作者：
Huang W;Yan H;Wang C;Li J;Yang X;Li L;Zuo Z;Zhang J;Chen H
视知觉解码是认知神经科学研究的重要课题之一。建立视觉反应信号与视觉内容之间的映射模型是解码的关键。大多数先前的研究使用峰值响应信号来解码对象类别。然而，功能磁共振成像测量的大脑活动是一个具有时间依赖性的动态过程，因此峰值信号不能完全代表整个过程，这可能会影响解码的性能。在这里，我们提出了一个基于长短期记忆（LSTM）网络的解码模型，用于从自然图像诱发的多时间响应信号中解码五个对象类别。实验结果表明，使用多时间（2- 6s）响应信号的平均解码准确率为0.540，这是显着高于使用峰值信号（6s;准确率：0.492; p <0.05）。此外，本文还从不同时长、不同方法和不同视觉区域的角度，对五类客体的解码性能进行了深入而全面的探讨。对不同时长和解码方法的分析表明，具有序列模拟能力的基于LSTM的解码模型能够拟合多时间视觉响应信号的时间依赖性，从而获得更高的解码性能。不同视区的对比分析表明，高级视皮层（VC）比低级视皮层包含更多的视觉解码所需的语义类别信息。视知觉解码是认知神经科学研究的重要课题之一。建立视觉反应信号与视觉内容之间的映射模型是解码的关键。
Visual perceptual decoding is one of the important and challenging topics in cognitive neuroscience. Building a mapping model between visual response signals and visual contents is the key point of decoding. Most previous studies used peak response signals to decode object categories. However, brain activities measured by functional magnetic resonance imaging are a dynamic process with time dependence, so peak signals cannot fully represent the whole process, which may affect the performance of decoding. Here, we propose a decoding model based on long short‐term memory (LSTM) network to decode five object categories from multitime response signals evoked by natural images. Experimental results show that the average decoding accuracy using the multitime (2–6 s) response signals is 0.540 from the five subjects, which is significantly higher than that using the peak ones (6 s; accuracy: 0.492; p < .05). In addition, from the perspective of different durations, methods and visual areas, the decoding performances of the five object categories are deeply and comprehensively explored. The analysis of different durations and decoding methods reveals that the LSTM‐based decoding model with sequence simulation ability can fit the time dependence of the multitime visual response signals to achieve higher decoding performance. The comparative analysis of different visual areas demonstrates that the higher visual cortex (VC) contains more semantic category information needed for visual perceptual decoding than lower VC. Visual perceptual decoding is one of the important and challenging topics in cognitive neuroscience. Building a mapping model between visual response signals and visual contents is the key point of decoding.
登录
查看更多内容
影响因子：
3.3
作者：
Auerbach, Edward J.;Xu, Junqian;Yacoub, Essa;Moeller, Steen;Ugurbil, Kamil
通讯作者：
Ugurbil, Kamil
影响因子：
3.2
作者：
Carlson, TA;Schrater, P;He, S
通讯作者：
He, S
影响因子：
2.6
作者：
Contini, Erika W.;Wardle, Susan G.;Carlson, Thomas A.
通讯作者：
Carlson, Thomas A.
影响因子：
3.2
作者：
Behroozi, Mehdi;Daliri, Mohammad Reza;Shekarchi, Babak
通讯作者：
Shekarchi, Babak
影响因子：
56.9
作者：
Horikawa, T.;Tamaki, M.;Kamitani, Y.
通讯作者：
Kamitani, Y.