In search of the neural circuits of intrinsic motivation.
In search of the neural circuits of intrinsic motivation.
复制标题
DOI：
10.3389/neuro.01.1.1.017.2007
复制
发表时间：
2007-11
影响因子：
4.3
通讯作者：
Oudeyer PY
中科院分区：
文献类型：
--
作者：
Kaplan F;Oudeyer PY
孩子们似乎在以一种持续和开放的方式获得新的诀窍。在这篇文章中，我们假设，学习进步的内在动机是儿童发展轨迹显著结构的根源。在这个观点中，孩子们从事探索性和游戏性的活动是为了他们自己，而不是作为迈向其他外在目标的步骤。本文的中心假设是，从本质上讲，激励活动与预测误差的预期减少相对应。这种动机系统促使婴儿避免可预测和不可预测的情况，以便专注于那些有望最大限度地提高学习进度的情况。基于一个计算模型和一系列机器人实验，我们展示了这一原理如何导致在人类中观察到的几种行为和发育模式的特征的日益复杂的有组织的行为序列。然后，我们讨论了大脑中这种内在动机系统背后的假定电路，并提出了两个新的假设。第一，强效多巴胺起到了学习进步信号的作用。第二，这一进展信号是通过一系列既充当预测系统又充当元预测系统的微皮质电路直接计算出来的。
Children seem to acquire new know-how in a continuous and open-ended manner. In this paper, we hypothesize that an intrinsic motivation to progress in learning is at the origins of the remarkable structure of children's developmental trajectories. In this view, children engage in exploratory and playful activities for their own sake, not as steps toward other extrinsic goals. The central hypothesis of this paper is that intrinsically motivating activities correspond to expected decrease in prediction error. This motivation system pushes the infant to avoid both predictable and unpredictable situations in order to focus on the ones that are expected to maximize progress in learning. Based on a computational model and a series of robotic experiments, we show how this principle can lead to organized sequences of behavior of increasing complexity characteristic of several behavioral and developmental patterns observed in humans. We then discuss the putative circuitry underlying such an intrinsic motivation system in the brain and formulate two novel hypotheses. The first one is that tonic dopamine acts as a learning progress signal. The second is that this progress signal is directly computed through a hierarchy of microcortical circuits that act both as prediction and metaprediction systems.
登录
查看更多内容
影响因子：
3.3
作者：
CARBONI, E;IMPERATO, A;DICHIARA, G
通讯作者：
DICHIARA, G
影响因子：
2.9
作者：
Doya, K;Samejima, K;Kawato, M
通讯作者：
Kawato, M
影响因子：
7.5
作者：
Dayan, P;Sejnowski, TJ
通讯作者：
Sejnowski, TJ
影响因子：
4.4
作者：
BERNHEIMER, H;BIRKMAYER, W;SEITELBERGER, F
通讯作者：
SEITELBERGER, F
影响因子：
5.3
作者：
Deneve, Sophie;Duhamel, Jean-Rene;Pouget, Alexandre
通讯作者：
Pouget, Alexandre