Cortical Signals for Rewarded Actions and Strategic Exploration
Cortical Signals for Rewarded Actions and Strategic Exploration
复制标题
DOI：
10.1016/j.neuron.2013.07.040
复制
发表时间：
2013-10-02
期刊：
影响因子：
16.2
通讯作者：
Lee, Daeyeol
中科院分区：
文献类型：
--
作者：
Donahue, Christopher H.;Seo, Hyojung;Lee, Daeyeol
在稳定的环境中，决策者可以利用他们之前学到的策略来获得最佳结果，而在不稳定的环境中，探索可能会带来更好的选择。在这里，为了研究皮质对探索行为的贡献，我们分析了执行匹配便士任务和视觉搜索任务的猴子的四个不同皮质区域记录的单神经元活动，这分别鼓励和阻止探索。我们发现，额叶和顶叶皮层多个区域的神经元倾向于比未奖励的行为更可靠地编码与先前奖励的行为相关的信号。此外，在视觉搜索任务期间，辅助视野中奖励选择的信号被减弱，并且与匹配便士任务期间切换选择的趋势相关。这些结果表明，补充眼野可能在鼓励动物探索替代决策策略方面发挥独特的作用。
In stable environments, decision makers can exploit their previously learned strategies for optimal outcomes, while exploration might lead to better options in unstable environments. Here, to investigate the cortical contributions to exploratory behavior, we analyzed single-neuron activity recorded from four different cortical areas of monkeys performing a matching-pennies task and a visual search task, which encouraged and discouraged exploration, respectively. We found that neurons in multiple regions in the frontal and parietal cortex tended to encode signals related to previously rewarded actions more reliably than unrewarded actions. In addition, signals for rewarded choices in the supplementary eye field were attenuated during the visual search task and were correlated with the tendency to switch choices during the matching-pennies task. These results suggest that the supplementary eye field might play a unique role in encouraging animals to explore alternative decision-making strategies.