Learning the microstructure of successful behavior.
Learning the microstructure of successful behavior.
复制标题
DOI：
10.1038/nn.2748
复制
发表时间：
2011-03
影响因子：
25
通讯作者：
Brainard, Michael S.
中科院分区：
文献类型：
--
作者：
Charlesworth, Jonathan D.;Tumer, Evren C.;Warren, Timothy L.;Brainard, Michael S.
已知表明成功或失败的强化信号会改变在不同行为之间进行选择的概率。然而，许多运动技能的成功表现，如说话清晰，也需要学习随时间不断变化的行为轨迹。在这里，我们研究了时间离散的强化信号如何塑造连续的行为轨迹，即成年孟加拉雀鸣叫的基本频率。我们只在歌曲的某一点上根据基频的表现提供了强化。学习到的基频变化在这一点上是最大的，但在基频轨迹的早期和后期也会扩展。一个简单的原理预测了学习的详细结构；鸟类学会了产生与成功结果相关的行为轨迹的平均值。这条学习规则准确地预测了毫秒级的学习结构，表明神经系统记录了成功行为的细粒度细节，并利用这些信息来指导学习。
Reinforcement signals indicating success or failure are known to alter the probability of selecting between distinct actions. However, successful performance of many motor skills, such as speech articulation, also requires learning behavioral trajectories that vary continuously over time. Here, we investigated how temporally discrete reinforcement signals shape a continuous behavioral trajectory, the fundamental frequency of adult Bengalese finch song. We provided reinforcement contingent on fundamental frequency performance only at one point in song. Learned changes to fundamental frequency were maximal at this point, but also extended both earlier and later in the fundamental frequency trajectory. A simple principle predicted the detailed structure of learning; birds learn to produce the average of the behavioral trajectories associated with successful outcomes. This learning rule accurately predicts the structure of learning at a millisecond time scale, demonstrating that the nervous system records fine-grained details of successful behavior and uses this information to guide learning.
登录
查看更多内容
DOI：
10.1196/annals.1390.006
发表时间：
2007-01-01
期刊：
REWARD AND DECISION MAKING IN CORTICOBASAL GANGLIA NETWORKS
影响因子：
--
作者：
Balleine, Bernard W.;Ostlund, Sean B.
通讯作者：
Ostlund, Sean B.
DOI：
10.1098/rstb.2007.2098
发表时间：
2007-05-29
影响因子：
6.3
作者：
Cohen, Jonathan D.;McClure, Samuel M.;Yu, Angela J.
通讯作者：
Yu, Angela J.
影响因子：
56.9
作者：
Aronov, Dmitriy;Andalman, Aaron S.;Fee, Michale S.
通讯作者：
Fee, Michale S.
影响因子：
25
作者：
Hessler, NA;Doupe, AJ
通讯作者：
Doupe, AJ
DOI：
10.1073/pnas.0903214106
发表时间：
2009-07-28
影响因子：
11.1
作者：
Andalman, Aaron S.;Fee, Michale S.
通讯作者：
Fee, Michale S.