Making Research Evaluation More Transparent: Aligning Research Philosophy, Institutional Values, and Reporting
Making Research Evaluation More Transparent: Aligning Research Philosophy, Institutional Values, and Reporting
复制标题
DOI：
10.1177/1745691618810693
复制
发表时间：
2019-05-01
影响因子：
12.6
通讯作者：
Grand, James A.
中科院分区：
文献类型：
--
作者：
Dougherty, Michael R.;Slevc, L. Robert;Grand, James A.
人们越来越有兴趣改变心理学文化，以提高我们的科学质量。这种兴趣的根源是对关键发现的可重复性的关注。各种大规模的复制尝试表明，以前发表的几种效果无法复制，而其他分析表明，已发表的文献中充斥着动力不足的研究和发表偏倚。这些发现表明，现在是时候改变心理科学的开展方式，并增加报告的透明度。我们认为，在机构采用新的程序来评估学术活动之前，变化将是缓慢的。我们认为，个人和部门可以采取三种行动，以促进整个心理科学的变化：个性化的研究哲学声明的发展，创建一个注释的简历，以提高学术报告的透明度，并使用一个正式的评估系统，明确捕捉行为，支持可重复性。我们的建议建立在开放科学的建议之上，使研究人员能够表达他们希望如何评价他们的工作的意见，并提供一种更详细和透明的学术活动报告机制。
There is a growing interest in changing the culture of psychology to improve the quality of our science. At the root of this interest is concern over the reproducibility of key findings. A variety of large-scale replication attempts have revealed that several previously published effects cannot be reproduced, whereas other analyses indicate that the published literature is rife with underpowered studies and publication bias. These revelations suggest that it is time to change how psychological science is carried out and increase the transparency of reporting. We argue that change will be slow until institutions adopt new procedures for evaluating scholarly activity. We consider three actions that individuals and departments can take to facilitate change throughout psychological science: the development of individualized research-philosophy statements, the creation of an annotated curriculum vitae to improve the transparency of scholarly reporting, and the use of a formal evaluative system that explicitly captures behaviors that support reproducibility. Our recommendations build on proposals for open science by enabling researchers to have a voice in articulating (and contextualizing) how they would like their work to be evaluated and by providing a mechanism for more detailed and transparent reporting of scholarly activities.