Reproducibility and Replicability in Science

本提案旨在研究已发表的科学和工程研究中不可重复性和缺乏可重复性的性质、流行程度和影响，以及发生的原因。获奖者将召集一组具有广泛科学和工程领域知识的专家，并熟悉与再现性和复制相关的问题。研究委员会将探讨可再现性和重复性问题，并编写一份书面报告。该报告将描述良好做法的例子，确定知识差距，并考虑研究人员、专业学会、期刊、大学、其他研究机构和资助者在促进可再现性和复制方面的作用。该报告将包括提高研究可重复性和重复性的建议。这项研究的范围不包括生物医学研究。当得出结论时，该研究将为科学和工程界的许多利益相关者阐明涉及可重复性和可复制性的问题。这项研究包括社区参与和投入的机会。这项研究及其建议可能会导致更强有力的科学实践，并为各种利益相关者提高对科学如何运作的认识奠定基础。额外的智力价值包括有可能促进对团队科学的理解，并进一步了解目前在美国如何进行科学探究。该项目的主要潜在的更广泛影响是提高研究界进行可重复和可复制的研究的能力。与研究结果的传播相关的潜在附带好处是，非科学家更清楚地了解科学和工程研究的性质、它如何向前发展以及科学知识如何演变。该项目将促进不同科学和工程领域之间的对话，包括比较研究实践的方法、降低可靠性的弱点和成功的解决方案。预计委员会最后报告中的调查结果和一般建议将有助于颁布最佳做法。

This proposal is to conduct a study of the nature, prevalence and impacts of, and reasons for the occurrence of, irreproducibility and lack of replicability in published scientific and engineering research. The awardee will convene a group of experts with knowledge of a broad range of science and engineering domains and familiarity with issues associated with reproducibility and replication. The study committee will explore issues of reproducibility and replication and produce a written report. The report will describe examples of good practices, identify gaps in knowledge, and consider the roles of researchers, professional societies, journals, universities, other research institutions, and funders in advancing reproducibility and replication. The report will include recommendations for advancing reproducibility and replication in research. The scope of the study does not include biomedical research.When concluded, the study will illuminate the issues involved in reproducibility and replicability for the many stakeholders in the science and engineering community. The study includes opportunities for community engagement and input. The study and its recommendations will likely lead to stronger scientific practice as well as set the stage for a greater awareness among various stakeholder of how science works. Additional intellectual merit includes the potential to advance the understanding of team science and to further the understanding of how scientific inquiry is currently conducted in the United States.The primary potential broader impacts of the project are improvements in the ability of the research community to conduct research that is reproducible and replicable. A potential ancillary benefit associated with the dissemination of the results of the study is a clearer understanding by non-scientists of the nature of science and engineering research, how it moves forward, and how scientific knowledge evolves. The project will promote dialogue between different scientific and engineering fields that involves comparing approaches to the practice of research, weaknesses that reduce reliability, and successful solutions. The findings and general recommendations in the committee's final report are expected to help promulgate best practices.