RR: Collaborative Research: Tracking Scientific Progress in Social Psychology

RR：合作研究：追踪社会心理学的科学进展

• 批准号: 1728469
• 负责人: Mijke Rhemtulla
• 金额: $ 10.09万
• 依托单位: University of California-Davis
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-08-01 至 2021-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1728469&HistoricalAwards=false
• 关键词: RR; Collaborative; Research; Tracking; Scientific

A basic principle of the scientific method is that scientists are expected to update their theories in light of new evidence. Indeed, public investment in science is assumed to produce theoretical advances that lead to real-world changes such as better health care, more efficient technology, and a deeper understanding of human behavior. Recent findings, however, raise concerns about the robustness and reliability of scientific research. Some published findings cannot be replicated by other researchers, and thus fail to meet basic standards of scientific value. To address these concerns, the scientific community needs to (1) collect new evidence, testing and re-testing existing theories, and (2) update theories in response to this evidence. Psychological science has been a leader in initiating the first step, with multiple large-scale replication projects underway to test the robustness of existing theories. The current project complements these efforts by providing a real-world test of the second step, examining whether scientists adjust their theories in response to new evidence. Documenting how scientists respond to new evidence is fundamental to establishing the value of research.This research tracks psychological scientists' beliefs in psychological theories before and after the release of results from two large-scale replication projects: Many Labs 5 (ML5) and Registered Replication Reports (RRRs). These projects offer evidence that reaches the highest standards of scientific rigor: researchers commit to methodology and data analysis strategy ahead of time, data are made available to the public, and results are published regardless of outcome. If psychological science is progressing as it should, this high-quality evidence should lead researchers to update their theories. If such updating is not happening, this project will help to determine why this might be the case and whether some researchers might be better than others in updating their theories. By identifying factors that promote scientific progress, and those that stand in the way, this project should contribute broadly to improving the robustness and reliability of research across all fields of science.

科学方法的一个基本原则是，科学家应该根据新的证据更新他们的理论。事实上，科学上的公共投资被认为会产生理论上的进步，从而导致现实世界的变化，如更好的医疗保健，更有效的技术，以及对人类行为的更深入的理解。然而，最近的研究结果引起了人们对科学研究的稳健性和可靠性的关注。一些已发表的研究结果无法被其他研究人员复制，因此不符合科学价值的基本标准。为了解决这些问题，科学界需要（1）收集新的证据，测试和重新测试现有的理论，（2）更新理论以应对这些证据。心理科学已经率先迈出了第一步，多个大规模的复制项目正在进行中，以测试现有理论的稳健性。目前的项目通过提供第二步的真实世界测试来补充这些努力，检查科学家是否根据新证据调整他们的理论。记录科学家对新证据的反应是确立研究价值的基础。这项研究追踪了心理科学家在两个大规模复制项目结果发布前后对心理学理论的信念：许多实验室5（ML5）和注册复制报告（RRRs）。这些项目提供的证据达到了科学严谨性的最高标准：研究人员提前承诺方法和数据分析策略，向公众提供数据，无论结果如何，结果都会公布。如果心理科学正在取得应有的进展，那么这些高质量的证据应该会引导研究人员更新他们的理论。如果这种更新没有发生，这个项目将有助于确定为什么会出现这种情况，以及是否有些研究人员可能比其他人更好地更新他们的理论。通过确定促进科学进步的因素和阻碍科学进步的因素，该项目应广泛有助于提高所有科学领域研究的稳健性和可靠性。