Do not Bet on the Unknown Versus Try to Find Out More: Estimation Uncertainty and "Unexpected Uncertainty" Both Modulate Exploration.

Do not Bet on the Unknown Versus Try to Find Out More: Estimation Uncertainty and "Unexpected Uncertainty" Both Modulate Exploration.
复制标题

DOI:
10.3389/fnins.2012.00150
复制
发表时间:
2012
影响因子:
4.3
通讯作者:
Bossaerts P
Bossaerts P
中科院分区:
医学2区
文献类型:
--
作者:
Payzan-Lenestour E;Bossaerts P

文献摘要

参考文献

被引文献

相似文献

人们对人类如何解决开发/探索的权衡知之甚少。特别是,不确定性驱动的勘探证据好坏参半。目前的研究提出了一种新的探索假设,有助于调和先前的发现,这些发现最初可能看起来相互矛盾。根据这一假设,不确定性驱动的探索涉及两种动机之间的困境:(i)加速学习未知,这可能会产生新的奖励机会;(ii)避免未知,因为它是潜在的危险。我们使用行为和模拟数据为我们的假设提供证据,并简要指出最近的证据表明,大脑区分这两种动机。
Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel hypothesis of exploration that helps reconcile prior findings that may seem contradictory at first. According to this hypothesis, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our hypothesis using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
DOI: 10.1038/nature04766
发表时间: 2006-06-15
期刊: NATURE
影响因子: 64.8
作者:
Daw, Nathaniel D.;O'Doherty, John P.;Dayan, Peter;Seymour, Ben;Dolan, Raymond J.
通讯作者: Dolan, Raymond J.
DOI: 10.1098/rstb.2007.2098
发表时间: 2007-05-29
影响因子: 6.3
作者:
Cohen, Jonathan D.;McClure, Samuel M.;Yu, Angela J.
通讯作者: Yu, Angela J.
DOI: 10.1016/j.neunet.2004.06.006
发表时间: 2004-12-01
期刊: NEURAL NETWORKS
影响因子: 7.8
作者:
Hirayama, J;Yoshimoto, J;Ishii, S
通讯作者: Ishii, S
DOI: 10.1002/acs.949
发表时间: 2007-12-01
影响因子: 3.1
作者:
Quinn, A.;Karny, M.
通讯作者: Karny, M.
DOI: 10.1371/journal.pcbi.1001048
发表时间: 2011-01-20
影响因子: 4.3
作者:
Payzan-LeNestour E;Bossaerts P
通讯作者: Bossaerts P