RR: Collaborative Research: Tracking Scientific Progress in Social Psychology

科学方法的一个基本原则是，科学家应该根据新的证据更新他们的理论。事实上，对科学的公共投资被认为会产生理论上的进步，从而导致现实世界的变化，如更好的医疗保健、更高效的技术以及对人类行为的更深入理解。然而，最近的发现引发了人们对科学研究的稳健性和可靠性的担忧。一些已发表的发现无法被其他研究人员复制，因此无法达到基本的科学价值标准。为了解决这些担忧，科学界需要(1)收集新的证据，测试和重新测试现有的理论，以及(2)根据这些证据更新理论。心理科学在启动第一步方面一直处于领先地位，多个大规模复制项目正在进行中，以测试现有理论的稳健性。目前的项目对这些努力进行了补充，对第二步进行了现实世界的测试，检查科学家是否根据新的证据调整了他们的理论。记录科学家对新证据的反应是确立研究价值的基础。这项研究追踪了心理学科学家在两个大规模复制项目：许多实验室5(ML5)和注册复制报告(RRR)发布结果之前和之后对心理学理论的信念。这些项目提供的证据达到了科学严谨性的最高标准：研究人员提前承诺采用方法学和数据分析策略，向公众提供数据，无论结果如何，都会公布结果。如果心理科学取得了应有的进展，这些高质量的证据应该会引导研究人员更新他们的理论。如果这种更新没有发生，这个项目将有助于确定为什么会出现这种情况，以及一些研究人员是否可能在更新他们的理论方面比其他研究人员更好。通过确定促进科学进步的因素和阻碍科学进步的因素，该项目应该广泛地为提高所有科学领域研究的稳健性和可靠性做出贡献。

A basic principle of the scientific method is that scientists are expected to update their theories in light of new evidence. Indeed, public investment in science is assumed to produce theoretical advances that lead to real-world changes such as better health care, more efficient technology, and a deeper understanding of human behavior. Recent findings, however, raise concerns about the robustness and reliability of scientific research. Some published findings cannot be replicated by other researchers, and thus fail to meet basic standards of scientific value. To address these concerns, the scientific community needs to (1) collect new evidence, testing and re-testing existing theories, and (2) update theories in response to this evidence. Psychological science has been a leader in initiating the first step, with multiple large-scale replication projects underway to test the robustness of existing theories. The current project complements these efforts by providing a real-world test of the second step, examining whether scientists adjust their theories in response to new evidence. Documenting how scientists respond to new evidence is fundamental to establishing the value of research.This research tracks psychological scientists' beliefs in psychological theories before and after the release of results from two large-scale replication projects: Many Labs 5 (ML5) and Registered Replication Reports (RRRs). These projects offer evidence that reaches the highest standards of scientific rigor: researchers commit to methodology and data analysis strategy ahead of time, data are made available to the public, and results are published regardless of outcome. If psychological science is progressing as it should, this high-quality evidence should lead researchers to update their theories. If such updating is not happening, this project will help to determine why this might be the case and whether some researchers might be better than others in updating their theories. By identifying factors that promote scientific progress, and those that stand in the way, this project should contribute broadly to improving the robustness and reliability of research across all fields of science.