Multiplicity of control in the basal ganglia: computational roles of striatal subregions.

Multiplicity of control in the basal ganglia: computational roles of striatal subregions.
复制标题

基底神经节中控制的多样性:纹状体子区域的计算作用。

DOI:
10.1016/j.conb.2011.02.009
复制
发表时间:
2011-06
影响因子:
5.7
通讯作者:
Daw ND
Daw ND
中科院分区:
医学2区
文献类型:
--
作者:
Bornstein AM;Daw ND

文献摘要

参考文献

被引文献

相似文献

基底节,尤其是纹状体,是行为控制理论的核心,通常被认为是行为选择的场所。强化学习(RL)模型--它推动了该区域最近的实验工作--将纹状体作为一个动态控制器,整合感觉和动机信息来构建有效和丰富的行为策略。与这一信息中心角色相匹配的是,BG位于突触投射的多个解剖“环”的连接处,连接着广泛的皮质和皮质下结构。在过去的几十年里,许多开创性的解剖学研究已经仔细地对这些环路进行了分类,并根据连接区域的推断功能对它们进行了标记。这些投射的特定终末高度定位于纹状体的几个不同的亚区,这表明这些亚区发挥着互补但不同的功能。然而,直到最近,占主导地位的计算框架只概述了纹状体的两部分,背侧/腹侧分裂。我们回顾了最近的计算和实验进展,这些进展证明了更精细的划分。特别是,实验数据为背内侧纹状体(DMS)的独特功能提供了广泛的见解。这些功能似乎很好地符合“基于模型的”RL亚单位的理论,也可能有助于揭示腹侧纹状体的亚组织。最后,我们讨论了这些想法的局限性,以及它们如何为纹状体功能的神经计算理论的未来改进指明了方向,使它们与计算理论的其他领域和大脑的其他区域接触。
The Basal Ganglia, in particular the striatum, are central to theories of behavioral control, and often identified as a seat of action selection. Reinforcement Learning (RL) models - which have driven much recent experimental work on this region - cast striatum as a dynamic controller, integrating sensory and motivational information to construct efficient and enriching behavioral policies. Befitting this informationally central role, the BG sit at the nexus of multiple anatomical “loops” of synaptic projections, connecting a wide range of cortical and sub-cortical structures. Numerous pioneering anatomical studies conducted over the past several decades have meticulously catalogued these loops, and labeled them according to the inferred functions of the connected regions. The specific cotermina of the projections are highly localized to several different subregions of the striatum, leading to the suggestion that these subregions perform complementary but distinct functions. However, until recently, the dominant computational framework outlined only a bipartite, dorsal/ventral, division of striatum. We review recent computational and experimental advances that argue for a more finely fractionated delineation. In particular, experimental data provides extensive insight on unique functions subserved by the dorsomedial striatum (DMS). These functions appear to correspond well to theories of a “model-based” RL subunit, and may also shed light on the suborganization of ventral striatum. Finally, we discuss the limitations of these ideas and how they point the way toward future refinements of neurocomputational theories of striatal function, bringing them into contact with other areas of computational theory and other regions of the brain.
DOI: 10.1016/b978-0-12-374176-9.00024-5
发表时间: 2009-01-01
期刊: NEUROECONOMICS: DECISION MAKING AND THE BRAIN
影响因子: --
作者:
Balleine, Bernard W.;Daw, Nathaniel D.;O'Doherty, John P.
通讯作者: O'Doherty, John P.
DOI: 10.1016/j.neuron.2008.09.021
发表时间: 2008-12-26
期刊: Neuron
影响因子: 16.2
作者:
Beck JM;Ma WJ;Kiani R;Hanks T;Churchland AK;Roitman J;Shadlen MN;Latham PE;Pouget A
通讯作者: Pouget A
DOI: 10.1080/14640748108400816
发表时间: 1981-01-01
期刊: QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY
影响因子: --
作者:
ADAMS, CD;DICKINSON, A
通讯作者: DICKINSON, A
在行动中构建学习。
DOI: 10.1016/j.bbr.2009.08.031
发表时间: 2010-01-20
影响因子: 2.7
作者:
Braun, Daniel A.;Mehring, Carsten;Wolpert, Daniel M.
通讯作者: Wolpert, Daniel M.
DOI: 10.1016/j.cognition.2008.08.011
发表时间: 2009-12
期刊: Cognition
影响因子: 3.4
作者:
Botvinick MM;Niv Y;Barto AG
通讯作者: Barto AG