Reinforcement learning accounts for moody conditional cooperation behavior: experimental results.
Reinforcement learning accounts for moody conditional cooperation behavior: experimental results.
复制标题
强化学习是情绪低落的有条件合作行为：实验结果。
DOI：
10.1038/srep39275
复制
发表时间：
2017-01-10
影响因子：
4.6
通讯作者：
Masuda N
中科院分区：
文献类型：
--
作者：
Horita Y;Takezawa M;Inukai K;Kita T;Masuda N
在社会困境博弈中，人类参与者通常会表现出条件合作（CC）行为或其变体，称为穆迪条件合作（MCC），当许多其他同伴先前合作时，他们基本上倾向于合作。最近的计算研究表明，CC和MCC行为模式可以通过强化学习来解释。在本研究中，我们使用一个重复的多人囚徒困境游戏和重复的公共产品游戏，由人类参与者来研究MCC是否在不同类型的游戏中被观察到，以及强化学习解释观察到的行为的可能性。我们在两个游戏中都观察到了MCC的行为，但我们观察到的MCC与过去实验中观察到的不同。在本研究中，无论是焦点参与者合作先前影响的整体水平的合作，而不是改变合作的趋势，以应对其他参与者在前一个时间步的合作。我们发现，在不同条件下，强化学习模型在描述实验结果方面与MCC模型大致相同。与以前的计算研究一致，目前的研究结果表明，强化学习可能是一个主要的近似机制管理MCC的行为。
In social dilemma games, human participants often show conditional cooperation (CC) behavior or its variant called moody conditional cooperation (MCC), with which they basically tend to cooperate when many other peers have previously cooperated. Recent computational studies showed that CC and MCC behavioral patterns could be explained by reinforcement learning. In the present study, we use a repeated multiplayer prisoner’s dilemma game and the repeated public goods game played by human participants to examine whether MCC is observed across different types of game and the possibility that reinforcement learning explains observed behavior. We observed MCC behavior in both games, but the MCC that we observed was different from that observed in the past experiments. In the present study, whether or not a focal participant cooperated previously affected the overall level of cooperation, instead of changing the tendency of cooperation in response to cooperation of other participants in the previous time step. We found that, across different conditions, reinforcement learning models were approximately as accurate as a MCC model in describing the experimental results. Consistent with the previous computational studies, the present results suggest that reinforcement learning may be a major proximate mechanism governing MCC behavior.