Popper Pitfalls: Experiences Following a Reproducibility Convention

Popper Pitfalls: Experiences Following a Reproducibility Convention
复制标题

波普陷阱:遵循再现性惯例的经验

DOI:
10.1145/3214239.3214243
复制
发表时间:
2018
期刊:
Proceedings of the First International Workshop on Practical Reproducible Evaluation of Computer Systems
影响因子:
--
通讯作者:
C. Maltzahn
C. Maltzahn
中科院分区:
--
文献类型:
--
作者:
Michael Sevilla;C. Maltzahn

文献摘要

被引文献

相似文献

我们描述了我们试图制作可再现的四个出版物,并讨论了每篇论文如何改变我们的工作流,实践和协作政策。基本的见解是,必须从项目的开始就可以使纸质文物重现。当论文(1)已经发表时以及(2)没有考虑可重复性的研究人员撰写的论文时,文物太难使其可再现。在本文中,我们介绍了我们的研究实验室采用的最佳实践,该实验是由我们为Popper公约确定的陷阱所雕刻的。我们以“召唤武器”为重点的“召唤”,致力于增强学术会议,行业环境和国家实验室的可重复性计划。我们希望我们的经验能够为将来的可再现论文奠定最佳实践指南。
We describe the four publications we have tried to make reproducible and discuss how each paper has changed our workflows, practices, and collaboration policies. The fundamental insight is that paper artifacts must be made reproducible from the start of the project; artifacts are too difficult to make reproducible when the papers are (1) already published and (2) authored by researchers that are not thinking about reproducibility. In this paper, we present the best practices adopted by our research laboratory, which was sculpted by the pitfalls we have identified for the Popper convention. We conclude with a "call-to-arms" for the community focused on enhancing reproducibility initiatives for academic conferences, industry environments, and national laboratories. We hope that our experiences will shape a best practices guide for future reproducible papers.