Cognitive effort and decision-making: integrating computational, behavioral, and psychophysiological approaches

日常经历是由决定决定的，从决定午餐吃什么到做出职业选择，但并不是所有的决定都是以同样的方式做出的：有些决定是努力做出的，速度很慢，而另一些决定更容易，做出得更快。这项拟议的研究旨在阐明，当努力的过程被部署为回报最大化的服务时。这一目标将通过解决三个基本问题来实现：1)人们如何计算和平衡认知努力的相对成本和收益；2)这些成本和收益的心理生理标志是什么，这些信号如何影响认知努力的支出，如行为所证明的；以及3)认知能力的个体差异如何影响这种成本-收益计算？ 虽然人们何时以及为什么决定牺牲或停止认知努力的问题最近得到了理论上的处理，但在理解任务环境或个体层面的因素如何影响这种努力过程的分配方面，几乎没有取得什么实验进展。拟议的研究利用强化学习(RL)的计算框架，了解我们如何学习选择行动，以最大化回报的服务，以精确的计算，支持我们的努力-回报权衡的谈判。 一种基于RL的有影响力的描述认为，时间的机会成本应该决定反应速度或“活力”：当延迟行动的代价更高时，行动应该更快采取。我们应该相应地改变对认知要求高的策略的依赖：当时间昂贵时，我们应该采用认知上不昂贵的策略来做决定。为了测试这个想法，我将使用一个实验设计，它实现了机会成本的波动--操作为每秒的平均回报率，以仔细地分离成本。这一操作将用于几个具有良好特征的认知任务，从而理解成本和收益如何决定认知努力支出的试验到试验调整。在这组将表征认知努力调节的实验之后，我们将使用加工负荷的生理标记物puplometrya来阐明这些假定的成本和收益是如何在内部表示的。与认知能力的行为基线测量相结合，这些生物标记物将提供对时刻认知努力的量化，以及对认知成本敏感度的个体差异。

Everyday experiences are defined by decisions, from deciding what to eat for lunch to making career choices, but not all of our decisions come about the same way: some decisions are made with effort and are slow, while other decisions are easier and made quickly. The proposed research aims to elucidate when effortful processes are deployed the service of maximizing rewards. This aim will be met by addressing three fundamental questions: 1) how do people calculate and balance the relative costs and benefits of cognitive effort, 2) what are the psychophysiological markers of these costs and benefits and how do these signals influence the expenditure of cognitive effort as evidenced by behavior, and 3) how do individual differences in cognitive ability influence this cost-benefit calculus? While the question of when and why people decide to expendor withholdcognitive effort has received recent theoretical treatment, little experimental progress has been made in understanding how either the task environment or factors at the level of the individual affects the allocation of such effortful processes. The proposed research leverages Reinforcement Learning (RL)a computational framework for understanding how we learn to select actions in the service of maximizing rewardsto pinpoint computations that underpin our negotiation of the effort-reward tradeoff. One influential RL-based account posits that the opportunity cost of time should dictate response speed or “vigor”: when delayed action is more expensive, actions should be made more quickly. Our reliance upon cognitively demanding strategies should shift accordingly: when time is expensive, we should employ cognitively inexpensive' strategies to make decisions. To test this idea, I will use an experimental design that implements fluctuations in opportunity costsoperationalized as the average rate of reward per secondto carefully isolate the cost' . This manipulation will be used with several well-characterized cognitive tasks, yielding an understanding of how costs and benefits dictate trial-to-trial adjustments of cognitive effort expenditure. Following this set of experiments that will characterize cognitive effort modulation, we will use pupillometrya physiological marker of processing loadto elucidate how these putative costs and benefits are represented internally. In conjunction with behavioral baseline measures of cognitive ability, these biomarkers will afford quantification of moment-to-moment cognitive effort as well as individual variation in sensitivity to cognitive costs.