Preregistration in diverse contexts: a preregistration template for the application of cognitive models.

Preregistration in diverse contexts: a preregistration template for the application of cognitive models.
复制标题

DOI:
10.1098/rsos.210155
复制
发表时间:
2021-10
影响因子:
3.5
通讯作者:
Evans NJ
Evans NJ
中科院分区:
综合性期刊3区
文献类型:
--
作者:
Crüwell S;Evans NJ

文献摘要

参考文献

被引文献

相似文献

近年来,开放科学实践在心理学和相关科学中变得越来越流行。这些做法旨在提高科学的严谨性和透明度,作为应对复制危机带来的挑战的潜在应对措施。其中许多改革(包括越来越多地使用的预注册)都是为纯粹的实验工作而设计的,这些工作通过标准的推论统计分析来测试简单的假设,例如评估实验操作是否对感兴趣​​的变量有影响。但心理学是一个多元化的研究领域。围绕预注册和模板的普遍讨论的焦点有些狭窄,引发了关于这些改革是否适合具有更多样化假设和更复杂分析方法的研究领域(例如数学心理学中的认知建模研究)的争论。我们的文章试图弥合开放科学和数学心理学之间的差距,重点关注 Crüwell 等人的认知模型类型。 (Crüwell S, Stefan AM, Evans NJ. 2019 Robust criteria ingnitive science.Comput.Brain Behav.2, 255–265) 标记模型应用,研究人员应用认知模型作为测量工具来测试有关认知模型参数的假设。具体来说,我们(i)讨论模型应用程序中几个潜在的研究人员自由度,(ii)提供模型应用程序的第一个预注册模板,以及(iii)提供使用我们的预注册模板的预注册模型应用程序的示例。更广泛地说,我们希望我们的讨论和具体建议能够建设性地推进当前围绕认知建模中预注册的最抽象的争论,并为如何在其他多样化或复杂的研究环境中开发预注册模板提供指南。
In recent years, open science practices have become increasingly popular in psychology and related sciences. These practices aim to increase rigour and transparency in science as a potential response to the challenges posed by the replication crisis. Many of these reforms—including the increasingly used preregistration—have been designed for purely experimental work that tests straightforward hypotheses with standard inferential statistical analyses, such as assessing whether an experimental manipulation has an effect on a variable of interest. But psychology is a diverse field of research. The somewhat narrow focus of the prevalent discussions surrounding and templates for preregistration has led to debates on how appropriate these reforms are for areas of research with more diverse hypotheses and more intricate methods of analysis, such as cognitive modelling research within mathematical psychology. Our article attempts to bridge the gap between open science and mathematical psychology, focusing on the type of cognitive modelling that Crüwell et al. (Crüwell S, Stefan AM, Evans NJ. 2019 Robust standards in cognitive science. Comput. Brain Behav. 2, 255–265) labelled model application, where researchers apply a cognitive model as a measurement tool to test hypotheses about parameters of the cognitive model. Specifically, we (i) discuss several potential researcher degrees of freedom within model application, (ii) provide the first preregistration template for model application and (iii) provide an example of a preregistered model application using our preregistration template. More broadly, we hope that our discussions and concrete proposals constructively advance the mostly abstract current debate surrounding preregistration in cognitive modelling, and provide a guide for how preregistration templates may be developed in other diverse or intricate research contexts.
DOI: 10.1016/j.cogsys.2013.05.001
发表时间: 2014-03-01
影响因子: 3.9
作者:
Cooper, Richard P.;Guest, Olivia
通讯作者: Guest, Olivia
DOI: 10.1109/tac.1974.1100705
发表时间: 1974-01-01
影响因子: 6.8
作者:
AKAIKE, H
通讯作者: AKAIKE, H
DOI: 10.1027/1618-3169/a000442
发表时间: 2019-05-01
影响因子: 1.3
作者:
Arnold, Nina R.;Heck, Daniel W.;Boywitt, C. Dennis
通讯作者: Boywitt, C. Dennis
DOI: 10.3758/s13423-010-0022-4
发表时间: 2011-02-01
影响因子: 3.5
作者:
Donkin, Chris;Brown, Scott;Wagenmakers, Eric-Jan
通讯作者: Wagenmakers, Eric-Jan
DOI: 10.3758/s13423-016-1135-1
发表时间: 2017-04-01
影响因子: 3.5
作者:
Evans, Nathan J.;Brown, Scott D.
通讯作者: Brown, Scott D.