Calibration of cognitive tests to address the reliability paradox for decision-conflict tasks.
Calibration of cognitive tests to address the reliability paradox for decision-conflict tasks.
复制标题
DOI：
10.1038/s41467-023-37777-2
复制
发表时间：
2023-04-19
影响因子：
16.6
通讯作者：
Heathcote, Andrew
中科院分区：
文献类型：
--
作者：
Kucina, Talira;Wells, Lindsay;Lewis, Ian;de Salas, Kristy;Kohl, Amelia;Palmer, Matthew A.;Sauer, James D.;Matzke, Dora;Aidman, Eugene;Heathcote, Andrew
标准的、完善的认知任务在群体比较中产生可靠的效果，但在评估个体差异时也会导致不可靠的测量。这种可靠性悖论已经在决策冲突任务中得到了证明，例如西蒙、侧翼和斯特鲁普任务，这些任务衡量认知控制的各个方面。我们的目标是通过实施仔细校准的标准测试版本来解决这一悖论，并进行额外的操作以鼓励处理冲突信息以及标准任务的组合。通过五个实验，我们表明，Flanker 任务以及带有额外操作的 Simon 和 Stroop 组合任务在每个任务的 100 次试验中产生了对个体差异的可靠估计，这提高了基准 Flanker、Simon 和 Stroop 数据中看到的可靠性。我们免费提供这些任务，并讨论如何进行个体差异认知测试的理论和应用意义。典型的认知任务可以产生强大的实验效果，但不能可靠地测量个体差异。在这里，作者使用分层贝叶斯分析来开发和校准可以有效实现良好可靠性的任务。
Standard, well-established cognitive tasks that produce reliable effects in group comparisons also lead to unreliable measurement when assessing individual differences. This reliability paradox has been demonstrated in decision-conflict tasks such as the Simon, Flanker, and Stroop tasks, which measure various aspects of cognitive control. We aim to address this paradox by implementing carefully calibrated versions of the standard tests with an additional manipulation to encourage processing of conflicting information, as well as combinations of standard tasks. Over five experiments, we show that a Flanker task and a combined Simon and Stroop task with the additional manipulation produced reliable estimates of individual differences in under 100 trials per task, which improves on the reliability seen in benchmark Flanker, Simon, and Stroop data. We make these tasks freely available and discuss both theoretical and applied implications regarding how the cognitive testing of individual differences is carried out. Typical cognitive tasks can produce robust experimental effects yet not measure individual differences reliably. Here the authors use hierarchical Bayesian analysis to develop and calibrate tasks that can efficiently achieve good reliability.
登录
查看更多内容
策略和处理速度会在冲突任务中控制能力的个体差异。
DOI：
10.1037/xlm0001028
发表时间：
2022-10
影响因子：
2.6
作者：
Hedge, Craig;Powell, Georgina;Bompas, Aline;Sumner, Petroc
通讯作者：
Sumner, Petroc
影响因子：
2.5
作者：
Behseta, Sam;Berdyyeva, Tamara;Kass, Robert E.
通讯作者：
Kass, Robert E.
影响因子：
16.4
作者：
CRONBACH, LJ
通讯作者：
CRONBACH, LJ
影响因子：
5.7
作者：
Egner, Tobias;Delano, Margaret;Hirsch, Joy
通讯作者：
Hirsch, Joy
影响因子：
3.4
作者：
Boag, Russell J.;Strickland, Luke;Heathcote, Andrew
通讯作者：
Heathcote, Andrew