Conferences on Reproducibility and Replicability in Economics and the Social Sciences (CRRESS)

经济学和社会科学的再现性和可重复性会议（CRRESS）

• 批准号: 2217493
• 负责人: Lars Vilhuber
• 金额: $ 5万
• 依托单位: Cornell University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-08-01 至 2024-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2217493&HistoricalAwards=false
• 关键词: Conferences; Reproducibility; Replicability; Economics; Social

This award provides partial support for a series of virtual and in-person conferences on the topics of reproducibility, replicability, and transparency in the social sciences. The purpose of scientific publishing is the dissemination of robust research findings, exposing them to the scrutiny of peers and other interested parties. Scientific articles should accurately and completely provide information on the origin and provenance of data and on the analytical and computational methods used. Yet in recent years, doubts about the adequacy of the information provided in scientific articles and their addenda have been voiced. This has been called the replication crisis. The conferences will address the following topics: the initiation of research, the conduct of research, the preparation of research for publication, and the scrutiny after publication. The products of these meetings will be available to any non-participant through videos, presentations materials, and manuscripts. Undergraduates, graduate students, and career researchers will be able to learn about best practices for transparent, reproducible, and scientifically sound research in the social sciences. Research that follows the best practices discussed in the various meetings will be more verifiable, and thus more credible. These qualities are especially important for policy makers that wish to implement evidence-based policymaking, and a public that wishes to understand the foundations of such policies.Scientific practices throughout the conduct of the research, during peer review, and after the dissemination of results all interact to enable a discourse about the veracity of scientific claims. The investigators will organize a sequence of conferences discussing educational and procedural barriers slowing down adoption of best practices, whether journals should be the verifiers of reproducibility, whether (and how) scientists' work can be made to be reproducible at every stage of the research process, and implications thereof for funding, technical infrastructure, and the training of undergraduate and graduate students. The topics chosen for the series are not usually part of disciplinary seminars or conferences and will be brought to a broader audience here for the first time. Most sessions will be held virtually (online), but others will be co-located with or submitted as complete sessions to professional meetings. The availability of permanent artifacts (presentations, recordings, manuscripts) after the conferences will allow this to be a resource with persistent impacts.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该奖项为一系列关于社会科学可再现性、可复制性和透明度主题的虚拟和面对面会议提供部分支持。科学出版的目的是传播可靠的研究成果，使其受到同行和其他相关方的审查。科学文章应准确和完整地提供关于数据的来源和来源以及所使用的分析和计算方法的信息。然而，近年来，人们对科学文章及其附录中提供的信息的充分性提出了质疑。这被称为复制危机。这些会议将讨论以下主题：研究的开始、研究的进行、研究发表的准备以及发表后的审查。这些会议的成果将通过视频、演示材料和手稿的形式提供给任何非与会者。本科生、研究生和职业研究人员将能够了解透明、可重复和科学合理的社会科学研究的最佳实践。遵循各种会议上讨论的最佳实践的研究将更加可验证，从而更加可信。对于希望实施循证决策的决策者和希望了解此类政策基础的公众来说，这些品质尤为重要。在整个研究过程中，在同行评审期间，以及在结果传播之后，科学实践都是相互作用的，从而能够对科学主张的真实性进行论述。研究人员将组织一系列会议，讨论阻碍最佳实践采用的教育和程序障碍，期刊是否应该是可重复性的验证者，科学家的工作是否（以及如何）可以在研究过程的每个阶段都是可重复性的，以及其对资金、技术基础设施和本科生和研究生培训的影响。本系列所选择的主题通常不是学科研讨会或会议的一部分，而是第一次将其带给更广泛的受众。大多数会议将虚拟（在线）举行，但其他会议将与专业会议在同一地点或作为完整的会议提交。会议后永久文物（演示文稿、录音、手稿）的可用性将使其成为具有持久影响的资源。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Data Citations and Reproducibility in the Undergraduate Curriculum

本科课程中的数据引用和可重复性

• DOI: 10.1162/99608f92.c2835391
• 发表时间: 2023
• 期刊: Harvard Data Science Review
• 作者: Mendez-Carbajo, Diego;Dellachiesa, Alejandro
• 通讯作者: Dellachiesa, Alejandro

Reproducibility in Economics: Status and Update

经济学的可重复性：现状和更新

• DOI: 10.1162/99608f92.80a1b88b
• 发表时间: 2023
• 期刊: Harvard Data Science Review
• 作者: Hoynes, Hilary

Reinforcing Reproducibility and Replicability: An Introduction

增强再现性和可复制性：简介

• DOI: 10.1162/99608f92.9ba2bd43
• 发表时间: 2023
• 期刊: Harvard Data Science Review
• 作者: Vilhuber, Lars;Schmutte, Ian;Michuda, Aleksandr;Connolly, Marie
• 通讯作者: Connolly, Marie

“Yes We Can!”: A Practical Approach to Teaching Reproducibility to Undergraduates

“是的，我们可以！”：向本科生教授再现性的实用方法

• DOI: 10.1162/99608f92.9e002f7b
• 发表时间: 2023
• 期刊: Harvard Data Science Review
• 作者: Ball, Richard

The Case for Data Archives at Journals

期刊数据档案案例

• DOI: 10.1162/99608f92.db2a2554
• 发表时间: 2023
• 期刊: Harvard Data Science Review
• 作者: Salmon, Timothy C.