A neural model of the frontal eye fields with. reward-based learning

A neural model of the frontal eye fields with. reward-based learning
复制标题

额眼区域的神经模型。

DOI:
10.1016/j.neunet.2016.05.001
复制
发表时间:
2016
期刊:
影响因子:
7.8
通讯作者:
Yu Yuguo
Yu Yuguo
中科院分区:
计算机科学1区
文献类型:
--
作者:
Ye Weijie;Liu Shenquan;Liu Xuanliang;Yu Yuguo

文献摘要

被引文献

相似文献

决策是一个依赖于各种信息积累的灵活过程,然而,相应的神经机制还很不清楚。我们扩展了一个分层模型的额叶眼场的学习为基础的模型,使用计算机模拟来解释选择任务的认知过程。这个扩展模型的核心有三个方面:方向偏好群体,将具有相同方向偏好的神经元聚集在一起;规则模块,控制不同的规则依赖活动;以及基于奖励的突触可塑性,调节连接,根据任务需求灵活地改变决策。在多次试验中反复尝试后,该网络成功地模拟了三个决策选择任务:反扫视任务,禁止任务和联想任务。我们发现,突触可塑性可以通过抑制错误的选择,同时增强正确的选择(奖励)来调节选择的竞争。此外,训练的模型捕捉到了动物和人体实验中表现出的一些特性,例如反扫视的反应时间分布的延迟,用于取消反射性扫视的停止信号机制,以及延迟到半最大选择性的变化。此外,训练后的模型能够再现再学习过程时切换任务和逆转线索眼跳协会。
Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue-saccade association.