Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies.

Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies.
复制标题

DOI:
10.1098/rsos.211037
复制
发表时间:
2021-10
影响因子:
3.5
通讯作者:
Vanpaemel W
Vanpaemel W
中科院分区:
综合性期刊3区
文献类型:
--
作者:
Claesen A;Gomes S;Tuerlinckx F;Vanpaemel W

文献摘要

参考文献

被引文献

相似文献

预注册是一种在任何数据影响之前将研究决策记录在公共第三方存储库中以提高研究透明度的方法。它在心理学的所有子领域和其他领域越来越受欢迎。遵守预登记计划可能并不总是可行的,甚至不一定是可取的,但如果不披露偏差,没有仔细查阅预登记计划的读者可能会产生错误的印象,认为研究完全按照计划进行和报告。在本文中,我们调查了2015年2月至2017年11月期间在《心理科学》杂志上发表的所有带有预注册徽章的文章的依从性和偏差披露情况,并与通讯作者分享了我们的发现以获得反馈。27项预登记研究中有2项未偏离预登记计划。在一项研究中,所有的偏差都被披露。9项研究没有发现任何偏差。我们主要观察(未)披露的偏离计划的报告样本量、排除标准和统计分析。本文对第一代预注册的详细研究揭示了预注册研究报告可能存在的障碍,并为未来的报告指南提供了输入。我们讨论结果和可能的解释,并为预注册研究提供建议。
Preregistration is a method to increase research transparency by documenting research decisions on a public, third-party repository prior to any influence by data. It is becoming increasingly popular in all subfields of psychology and beyond. Adherence to the preregistration plan may not always be feasible and even is not necessarily desirable, but without disclosure of deviations, readers who do not carefully consult the preregistration plan might get the incorrect impression that the study was exactly conducted and reported as planned. In this paper, we have investigated adherence and disclosure of deviations for all articles published with the Preregistered badge in Psychological Science between February 2015 and November 2017 and shared our findings with the corresponding authors for feedback. Two out of 27 preregistered studies contained no deviations from the preregistration plan. In one study, all deviations were disclosed. Nine studies disclosed none of the deviations. We mainly observed (un)disclosed deviations from the plan regarding the reported sample size, exclusion criteria and statistical analysis. This closer look at preregistrations of the first generation reveals possible hurdles for reporting preregistered studies and provides input for future reporting guidelines. We discuss the results and possible explanations, and provide recommendations for preregistered research.
DOI: 10.1177/1745691612459058
发表时间: 2012-11
期刊: Perspectives on psychological science : a journal of the Association for Psychological Science
影响因子: --
作者:
Nosek BA;Spies JR;Motyl M
通讯作者: Motyl M
DOI: 10.1177/0956797611417632
发表时间: 2011-11-01
影响因子: 8.2
作者:
Simmons, Joseph P.;Nelson, Leif D.;Simonsohn, Uri
通讯作者: Simonsohn, Uri
DOI: 10.1371/journal.pmed.0020124
发表时间: 2005-08-01
期刊: PLOS MEDICINE
影响因子: 15.8
作者:
Ioannidis, JPA
通讯作者: Ioannidis, JPA
DOI: 10.1016/j.jesp.2016.03.004
发表时间: 2016-11-01
影响因子: 3.5
作者:
van 't Veer, Anna Elisabeth;Giner-Sorolla, Roger
通讯作者: Giner-Sorolla, Roger
DOI: 10.1177/2515245918787489
发表时间: 2018-09-01
影响因子: 13.6
作者:
LeBel, Etienne P.;McCarthy, Randy J.;Vanpaemel, Wolf
通讯作者: Vanpaemel, Wolf