Vicarious reinforcement in rhesus macaques (macaca mulatta).
Vicarious reinforcement in rhesus macaques (macaca mulatta).
复制标题
DOI：
10.3389/fnins.2011.00027
复制
发表时间：
2011
影响因子：
4.3
通讯作者：
Platt ML
中科院分区：
文献类型：
--
作者：
Chang SW;Winecoff AA;Platt ML
发生在别人身上的事情深刻地影响着我们自己的行为。这种与他人相关的结果可以推动观察学习，也可以激发合作、慈善、同理心，甚至是怨恨。替代强化可能是中介他人相关结果对群体行为和决策影响的关键机制之一。在这里，我们表明恒河猴自发地从观察给另一只猴子的奖励中获得替代强化，这种强化可以激励它们随后向其他动物提供或拒绝奖励。我们利用巴甫洛夫条件反射和工具条件反射，将对自己的奖励（M1）和/或对另一只猴子的奖励（M2）与视觉线索联系起来。在工具试验中，当线索预测给M2奖励时M1犯的错误比当线索预测给M1奖励时犯的错误更多，但当线索预测不给任何人奖励时，M1犯的错误更多。在随后的条件线索对偏好测试中，m1对有奖励的条件线索的偏好高于对没有奖励的条件线索的偏好。相比之下，m1更喜欢给自己奖励的线索，而不是同时给两只猴子奖励的线索。对M2的注意率能很好地预测替代强化的强度和效价。这些行为模式在非社会控制试验中不存在，与基于对观察到的或反事实的结果的敏感性的替代强化相一致。在恒河猴中，替代奖励可能在塑造合作与竞争，以及激发观察学习和群体协调方面发挥着关键作用，就像在人类中一样。我们提出替代强化信号通过参与强化学习和决策的同源神经回路调节这些行为。
What happens to others profoundly influences our own behavior. Such other-regarding outcomes can drive observational learning, as well as motivate cooperation, charity, empathy, and even spite. Vicarious reinforcement may serve as one of the critical mechanisms mediating the influence of other-regarding outcomes on behavior and decision-making in groups. Here we show that rhesus macaques spontaneously derive vicarious reinforcement from observing rewards given to another monkey, and that this reinforcement can motivate them to subsequently deliver or withhold rewards from the other animal. We exploited Pavlovian and instrumental conditioning to associate rewards to self (M1) and/or rewards to another monkey (M2) with visual cues. M1s made more errors in the instrumental trials when cues predicted reward to M2 compared to when cues predicted reward to M1, but made even more errors when cues predicted reward to no one. In subsequent preference tests between pairs of conditioned cues, M1s preferred cues paired with reward to M2 over cues paired with reward to no one. By contrast, M1s preferred cues paired with reward to self over cues paired with reward to both monkeys simultaneously. Rates of attention to M2 strongly predicted the strength and valence of vicarious reinforcement. These patterns of behavior, which were absent in non-social control trials, are consistent with vicarious reinforcement based upon sensitivity to observed, or counterfactual, outcomes with respect to another individual. Vicarious reward may play a critical role in shaping cooperation and competition, as well as motivating observational learning and group coordination in rhesus macaques, much as it does in humans. We propose that vicarious reinforcement signals mediate these behaviors via homologous neural circuits involved in reinforcement learning and decision-making.
登录
查看更多内容
DOI：
10.1126/science.1168488
发表时间：
2009-05-15
期刊：
Science (New York, N.Y.)
影响因子：
--
作者：
Hayden BY;Pearson JM;Platt ML
通讯作者：
Platt ML
影响因子：
5.4
作者：
BERGER, SM
通讯作者：
BERGER, SM
DOI：
10.1073/pnas.0608842104
发表时间：
2007-05-29
影响因子：
11.1
作者：
Lohrenz, Terry;McCabe, Kevin;Montague, P. Read
通讯作者：
Montague, P. Read
影响因子：
4.6
作者：
BANDURA, A;MCDONALD, FJ
通讯作者：
MCDONALD, FJ
影响因子：
2.2
作者：
ANDERSON, CO;MASON, WA
通讯作者：
MASON, WA