Still at the choice-point - Action selection and initiation in instrumental conditioning

Still at the choice-point - Action selection and initiation in instrumental conditioning
复制标题

DOI:
10.1196/annals.1390.006
复制
发表时间:
2007-01-01
期刊:
REWARD AND DECISION MAKING IN CORTICOBASAL GANGLIA NETWORKS
影响因子:
--
通讯作者:
Ostlund, Sean B.
Ostlund, Sean B.
中科院分区:
其他
文献类型:
--
作者:
Balleine, Bernard W.;Ostlund, Sean B.

文献摘要

被引文献

相似文献

与经典的刺激-反应(S-R)理论相反,最近的证据表明,在工具性条件反射中,大鼠对它们的行为与这些行为产生的特定后果之间的关系进行编码。然而,目前还不清楚编码这种关系如何控制工具性能。虽然S-R理论能够清楚地解释学习如何转化为绩效,但工具性学习构成了“反应R导致结果O”形式的信息获取的论点并不直接暗示特定的绩效规则或策略;这些信息既可以用于执行R,也可以用于避免执行R。对这个问题的认识迫使人们开发了允许O和预测O的刺激的账户(即,S-O)在特定Rs的起始中起作用。在最近的实验中,我们使用了各种行为程序,试图隔离的过程,有助于工具性能,包括结果贬值,恢复,和巴甫洛夫工具转移。我们的研究结果,特别是从实验评估结果选择性恢复,表明“前馈”(O-R)和“反馈”(R-O)协会是至关重要的,虽然前者似乎是重要的反应选择,后者与过程,确定结果值介导的反应启动。我们讨论了一个概念模型,整合这些过程及其神经实现。
Contrary to classic stimulus-response (S-R) theory, recent evidence suggests that, in instrumental conditioning, rats encode the relationship between their actions and the specific consequences that these actions produce. It has remained unclear, however, how encoding this relationship acts to control instrumental performance. Although S-R theories were able to give a clear account of how learning translates into performance, the argument that instrumental learning constitutes the acquisition of information of the form "response R leads to outcome O" does not directly imply a particular performance rule or policy; this information can be used both to perform R and to avoid performing R. Recognition of this problem has forced the development of accounts that allow the O and stimuli that predict the O (i.e., S-O) to play a role in the initiation of specific Rs. In recent experiments, we have used a variety of behavioral procedures in an attempt to isolate the processes that contribute to instrumental performance, including outcome devaluation, reinstatement, and Pavlovian-instrumental transfer. Our results, particularly from experiments assessing outcome-selective reinstatement, suggest that both "feed-forward" (O-R) and "feed-back" (R-O) associations are critical and that although the former appear to be important to response selection, the latter-together with processes that determine outcome value-mediate response initiation. We discuss a conceptual model that integrates these processes and its neural implementation.