Measuring memory is harder than you think: How to avoid problematic measurement practices in memory research.
Measuring memory is harder than you think: How to avoid problematic measurement practices in memory research.
复制标题
DOI：
10.3758/s13423-022-02179-w
复制
发表时间：
2023-04
影响因子：
3.5
通讯作者：
Wixted JT
中科院分区：
文献类型：
--
作者：
Brady TF;Robinson MM;Williams JR;Wixted JT
我们认为记忆研究的关键领域依赖于有问题的测量实践，并提供了改善这种情况的具体建议。特别是，我们强调使用任务（例如“旧/新”任务：“你以前见过这个项目吗？是/否”）的记忆研究的普遍性，其中量化表现很大程度上依赖于反事实推理，而反事实推理取决于底层记忆信号的（不可知的）分布。由于这一困难，记忆研究中的不同文献（例如，视觉工作记忆、目击者识别、图片记忆等）已经采用了各种根本不同的指标来从这些任务中获得性能测量（例如，A'、校正命中率、正确百分比、d'、诊断率、K值等），尽管这些指标对潜在记忆信号的分布做出了不同的、相互矛盾的假设，尽管它们的所有假设常常都是错误的。我们建议，为了使记忆心理学和神经科学成为一门更具累积性、理论驱动的科学，必须更多地关注测量问题。我们提出一个具体的建议：对于那些只对性能感兴趣的人，默认的记忆任务应该从旧/新（“你看到这个项目了吗？”）更改为两个选择的强制选择（“你看到这两个项目中的哪一个？”）。在首选旧/新变体的情况下（例如，目击者识别；记忆信号性质的理论研究），应该执行接收器操作特性（ROC）分析，而不是二进制旧/新任务。
We argue that critical areas of memory research rely on problematic measurement practices and provide concrete suggestions to improve the situation. In particular, we highlight the prevalence of memory studies that use tasks (like the “old/new” task: “have you seen this item before? yes/no”) where quantifying performance is deeply dependent on counterfactual reasoning that depends on the (unknowable) distribution of underlying memory signals. As a result of this difficulty, different literatures in memory research (e.g., visual working memory, eyewitness identification, picture memory, etc.) have settled on a variety of fundamentally different metrics to get performance measures from such tasks (e.g., A′, corrected hit rate, percent correct, d′, diagnosticity ratios, K values, etc.), even though these metrics make different, contradictory assumptions about the distribution of latent memory signals, and even though all of their assumptions are frequently incorrect. We suggest that in order for the psychology and neuroscience of memory to become a more cumulative, theory-driven science, more attention must be given to measurement issues. We make a concrete suggestion: The default memory task for those simply interested in performance should change from old/new (“did you see this item’?”) to two-alternative forced-choice (“which of these two items did you see?”). In situations where old/new variants are preferred (e.g., eyewitness identification; theoretical investigations of the nature of memory signals), receiver operating characteristic (ROC) analysis should be performed rather than a binary old/new task.
登录
查看更多内容
影响因子：
1.8
作者：
Bays PM;Catalao RF;Husain M
通讯作者：
Husain M
影响因子：
1.8
作者：
Chunharas, Chaipat;Rademaker, Rosanne L.;Serences, John T.
通讯作者：
Serences, John T.
DOI：
10.1037/xlm0000824
发表时间：
2020-08-01
影响因子：
2.6
作者：
Bowman, Caitlin R.;Zeithamova, Dagmar
通讯作者：
Zeithamova, Dagmar
影响因子：
2.4
作者：
Chubala, Chrissy M.;Guitard, Dominic;Surprenant, Aimee M.
通讯作者：
Surprenant, Aimee M.
DOI：
10.1073/pnas.1520027113
发表时间：
2016-07-05
影响因子：
11.1
作者：
Brady, Timothy F.;Stormer, Viola S.;Alvarez, George A.
通讯作者：
Alvarez, George A.