Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex
Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex
复制标题
内侧前额叶皮层中解决开发-探索困境的神经机制
DOI：
10.1126/science.abb0184
复制
发表时间：
2020-08-28
期刊：
影响因子：
56.9
通讯作者：
Koechlin, Etienne
中科院分区：
文献类型：
--
作者：
Domenech, Philippe;Rheims, Sylvain;Koechlin, Etienne
日常生活常常需要在追求持续的行动计划（可能会进行调整）与探索新的行动计划之间进行仲裁。解决这种所谓的利用-探索困境涉及内侧前额叶皮层（mPFC）。使用人类颅内电生理记录，我们发现腹侧 mPFC 中的神经活动推断并跟踪正在进行的计划的可靠性，以主动将即将到来的行动结果编码为学习信号或探索新计划的潜在触发器。相比之下，背侧 mPFC 对行动结果表现出神经反应，从而导致改进或放弃正在进行的计划。因此，mPFC 通过两个阶段的预测编码过程解决了利用-探索困境：主动腹内侧阶段构建即将到来的行动结果的功能意义，反应性背内侧阶段指导行为以响应行动结果。
Everyday life often requires arbitrating between pursuing an ongoing action plan by possibly adjusting it versus exploring a new action plan instead. Resolving this so-called exploitation-exploration dilemma involves the medial prefrontal cortex (mPFC). Using human intracranial electrophysiological recordings, we discovered that neural activity in the ventral mPFC infers and tracks the reliability of the ongoing plan to proactively encode upcoming action outcomes as either learning signals or potential triggers to explore new plans. By contrast, the dorsal mPFC exhibits neural responses to action outcomes, which results in either improving or abandoning the ongoing plan. Thus, the mPFC resolves the exploitation-exploration dilemma through a two-stage, predictive coding process: a proactive ventromedial stage that constructs the functional signification of upcoming action outcomes and a reactive dorsomedial stage that guides behavior in response to action outcomes.