Learning from sensory and reward prediction errors during motor adaptation.
Learning from sensory and reward prediction errors during motor adaptation.
复制标题
DOI：
10.1371/journal.pcbi.1002012
复制
发表时间：
2011-03
影响因子：
4.3
通讯作者：
Shadmehr R
中科院分区：
文献类型：
--
作者：
Izawa J;Shadmehr R
自主运动指令产生两种结果。最初，感觉结果是根据我们的初级感觉器官的活动来观察的（例如，视觉、本体感觉）。随后，大脑评估感觉反馈并产生运动命令的效用或有用性的主观测量（例如，奖励）。因此，预测和观察到的结果之间的比较电机命令产生两种形式的预测误差。这些错误如何导致运动指令的变化？在这里，我们认为达到适应协议，并发现，当高质量的感觉反馈，适应运动命令几乎完全由感官预测错误。这种形式的学习有一个独特的特征：随着运动指令的适应，受试者改变了他们对运动指令的感觉后果的预测，并将这种学习广泛地推广到邻近的运动指令。相反，随着感觉反馈质量的下降，运动指令的适应变得更加依赖于奖励预测错误。奖励预测错误产生了可比的变化，在运动命令，但没有产生变化，在运动命令的预测感官后果，并仅在局部推广。因为我们发现，有一个主题内的相关性之间的泛化模式和感官重新映射，这是合理的，在适应过程中，个人的相对依赖感官与奖励预测错误可以推断。我们认为，虽然运动命令的变化，因为感官和奖励预测错误，只有感官预测错误产生的神经系统，预测运动命令的感官后果的变化。据认为，运动适应依赖于感觉预测误差，以形成估计的扰动。在这里，我们提出的证据表明，运动适应可以由感官和奖励预测错误驱动。我们发现，从感觉预测错误中学习改变了运动命令的预测结果，留下了感觉重新映射，而从奖励预测错误中学习产生了运动命令的可比变化，但没有产生感觉重新映射。从感官和奖励预测错误中学习的神经基础可能是不同的，因为它们产生不同的泛化模式。
Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands. It is thought that motor adaptation relies on sensory prediction errors to form an estimate of the perturbation. Here, we present evidence that motor adaptation can be driven by both sensory and reward prediction errors. We found that learning from sensory prediction error altered the predicted consequences of motor commands, leaving behind a sensory remapping, whereas learning from reward prediction error produced comparable change in motor commands, but did not produce a sensory remapping. It is possible that the neural basis of learning from sensory and reward prediction errors are distinct because they produce different generalization patterns.
登录
查看更多内容
影响因子：
2.5
作者：
Criscimagna-Hemminger, Sarah E.;Bastian, Amy J.;Shadmehr, Reza
通讯作者：
Shadmehr, Reza
影响因子：
1.9
作者：
Izawa, J;Kondo, T;Ito, K
通讯作者：
Ito, K
影响因子：
2.5
作者：
Jones, KE;Hamilton, AFD;Wolpert, DM
通讯作者：
Wolpert, DM
影响因子：
64.8
作者：
Barnes, TD;Kubota, Y;Graybiel, AM
通讯作者：
Graybiel, AM
影响因子：
64.8
作者：
Harris, CM;Wolpert, DM
通讯作者：
Wolpert, DM