Involvement of dopamine system and orbito frontal cortex in update and memory of value signals

多巴胺系统和眶额皮质参与价值信号的更新和记忆

• 批准号: 20240040
• 负责人: KIMURA Minoru
• 金额: $ 32.12万
• 依托单位: Tamagawa University (2010)Kyoto Prefectural University of Medicine (2008-2009)
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2008
• 资助国家: 日本
• 起止时间: 2008 至 2010
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-20240040/
• 关键词: ドーパミンニューロン; 線条体; 価値判断; 報酬予測; 報酬予測誤差; 試行錯誤; 目標・ゴール; 教科学習; 強化学習; システム神経生理; ニューロインフォマティクス

We examined whether the midbrain dopamine neurons encode signals of long-term reward prediction and its error. Three Japanese monkeys performed multi-step choices for 3 rewards. Anticipatory licking during the task performance showed that monkey's expectation did not reflect reward probability of individual trials but precisely reflected reward value (probability x volume) of expected total rewards with future rewards discounted, value function of reinforcement learning. Remarkably, dopamine neuron activity encoded the long-term reward prediction rather than reward value of individual trials. The results suggested that the dopamine signals of long-term reward prediction may play critical roles in update of value signals for directing future goals in the target structures such as the striatum.

我们研究了中脑多巴胺神经元是否编码长期奖励预测信号及其误差。3只日本猴子为获得3种奖励而进行多步选择。任务执行过程中的预期舔食表明，猴子的期望并不反映单个试验的奖励概率，而是准确反映了预期总奖励的奖励值（概率x体积），即对未来奖励进行贴现的强化学习的价值函数。值得注意的是，多巴胺神经元活动编码了长期奖励预测，而不是单个试验的奖励值。结果表明，长期奖励预测的多巴胺信号可能在纹状体等目标结构中对指导未来目标的价值信号更新起关键作用。

项目成果

Inactivation of the putamen selectively impairs reward history-based action selection.

• DOI: 10.1007/s00221-011-2545-y
• 发表时间: 2011-03
• 期刊: EXPERIMENTAL BRAIN RESEARCH
• 影响因子: 2
• 作者: Muranishi, Manabu;Inokawa, Hitoshi;Yamada, Hiroshi;Ueda, Yasumasa;Matsumoto, Naoyuki;Nakagawa, Masanori;Kimura, Minoru
• 通讯作者: Kimura, Minoru

Encyclopedia of Neuroscience. (Sensorimotor Learning and the Basal Ganglia)

神经科学百科全书。

• 发表时间: 2009
• 作者: Kimura M.;Ueda Y.
• 通讯作者: Ueda Y.

Neuroeconomics : Decision Making and the Brain. (The basal ganglia and the encoding of value.)

神经经济学：决策和大脑。

• 发表时间: 2008
• 作者: Doya K.;Kimura M.
• 通讯作者: Kimura M.

Involvement of the basal ganglia in valuation and selection of actions.

基底神经节参与行动的评估和选择。

• 发表时间: 2009
• 作者: Kimura M;Yamada H;Enomoto K;Matsumoto N;Hori Y;Ueda Y.;Yamanaka K.
• 通讯作者: Yamanaka K.

Neuroeconomics : Decision Making and the Brain

神经经济学：决策和大脑

• 发表时间: 2009
• 作者: Kimura M.;Ueda Y.;Doya K. & Kimura M.
• 通讯作者: Doya K. & Kimura M.