Metastudies for robust tests of theory
Metastudies for robust tests of theory
复制标题
DOI：
10.1073/pnas.1708285114
复制
发表时间：
2018-03-13
影响因子：
11.1
通讯作者：
Vandekerckhove, Joachim
中科院分区：
文献类型：
--
作者：
Baribault, Beth;Donkin, Chris;Vandekerckhove, Joachim
我们描述并展示了一种用于发现和复制心理科学中的经验效应的经验策略。该方法涉及元研究的设计，其中许多独立的实验变量（可能是经验效应的调节因素）被不加区别地随机化。激进的随机化产生了丰富的数据集，可用于测试一些实验方案的变幻莫测和特质的经验主张的鲁棒性，并增强了这些主张的普遍性。该策略是可行的分层贝叶斯建模，允许不同的实验和设计的信息池的进步，并在这里提出了作为复制研究和探索性研究的黄金标准。该策略的实际可行性证明与复制的阈下启动的研究。
We describe and demonstrate an empirical strategy useful for discovering and replicating empirical effects in psychological science. The method involves the design of a metastudy, in which many independent experimental variables-that may be moderators of an empirical effect-are indiscriminately randomized. Radical randomization yields rich datasets that can be used to test the robustness of an empirical claim to some of the vagaries and idiosyncrasies of experimental protocols and enhances the generalizability of these claims. The strategy is made feasible by advances in hierarchical Bayesian modeling that allow for the pooling of information across unlike experiments and designs and is proposed here as a gold standard for replication research and exploratory research. The practical feasibility of the strategy is demonstrated with a replication of a study on subliminal priming.