Positive and negative reward coding by serotonin, acetylcholine, and dopamine network.

血清素、乙酰胆碱和多巴胺网络的正向和负向奖励编码。

• 批准号: 20300139
• 负责人: NAKAMURA Kae
• 金额: $ 6.74万
• 依托单位: Kansai Medical University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2008
• 资助国家: 日本
• 起止时间: 2008 至 2011
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-20300139/
• 关键词: ドパミン; セロトニン; アセチルコリン; 強化学習; 報酬; 脚橋被蓋核; 縫線核; 霊長類; モノアミン神経伝達物質; 嫌悪; 眼球運動; サル; reinforcement learning

The strength of firing of midbrain dopaminergic neurons has been revealed that it carries reward prediction error signal in the framework of reinforcement learning where an agent chooses actions to maximize rewards. The dopamine neurons receive inputs from the pedunculopontine tegmental nucleus(PPTN), where many cholinergic neurons exist, and the dorsal raphe nucleus(DRN), where many serotonergic neurons exist. Thus we measured single neuronal activity of PPTN and DRN while monkeys performed eye movement tasks to obtain reward of different values and the Pavlovian conditioning task in which appetitive and aversive events were imposed. We found that while different PPTN neurons encoded predicted reward and actual rewards separately, DRN neurons often carried predicted and actual rewards by single neurons. Such different reward signals may be fed and integrated in the dopamine neurons to compute reward prediction error signal, which is used for the control of action and decision making.

中脑多巴胺能神经元发射的强度已表明，它在强化学习框架中带有奖励预测误差信号，而代理商选择了最大程度地提高奖励的行动。多巴胺神经元从存在许多胆碱能神经元的pedunculopontine temental核（PPTN）中接收输入，并且存在许多血清素能神经元的背侧Raphe核（DRN）。因此，我们测量了PPTN和DRN的单个神经元活性，而猴子执行了眼动任务以获得不同值的奖励，并且施加了食欲和厌恶事件的Pavlovian调节任务。我们发现，尽管不同的PPTN神经元编码了预测的奖励和实际奖励，但DRN神经元经常通过单个神经元进行预测和实际奖励。可以将这种不同的奖励信号馈送并整合到多巴胺神经元中，以计算奖励预测误差信号，该信号用于控制动作和决策。

项目成果

Reward prediction error computation in the pedunculopontine tegmental nucleus neurons

• DOI: 10.1196/annals.1390.003
• 发表时间: 2007-01-01
• 期刊: REWARD AND DECISION MAKING IN CORTICOBASAL GANGLIA NETWORKS
• 作者: Kobayashi, Yasushi;Okada, Ken-Chi
• 通讯作者: Okada, Ken-Chi

The pedunculopontine tegmental nucleus neurons encode predicted reward signal by tonic regular firing and given reward signal phasically

脚桥被盖核神经元通过强直规律放电和阶段性给予奖励信号来编码预测奖励信号

• 发表时间: 2011
• 作者: Kobayashi;Y. and Okada;K
• 通讯作者: K

Reward-dependent modulation of neuronal activity in the primate ventral striatum

灵长类腹侧纹状体神经元活动的奖赏依赖性调节

• 发表时间: 2009
• 作者: Nakamura;K.;Nakao;K.;Matsuzaki;R.
• 通讯作者: R.

Saccadic eye movements as a neural correlate measure of preparatory set in children with ADHD

扫视眼球运动作为 ADHD 儿童准备组的神经相关测量

• 发表时间: 2010
• 作者: Yuri Kitamura;Yuka Matsuo;Masako Taniike;Ikuko Mohri;Yasushi Kobayashi;Kanehisa Morimoto
• 通讯作者: Kanehisa Morimoto

Pedunculopontine Tegmental Nucleus Neurons Signal Predicted and Actual Reward for Reinforcement Learning

桥脚被盖核神经元信号预测和强化学习的实际奖励

• 发表时间: 2008
• 作者: Ken-ichi Okada;Yasushi Kobayashi;芳賀洋一;Yasushi Kobayashi
• 通讯作者: Yasushi Kobayashi