The Popper Convention: Making Reproducible Systems Evaluation Practical
The Popper Convention: Making Reproducible Systems Evaluation Practical
复制标题
波普尔公约：使可重复系统评估变得实用
DOI：
10.1109/ipdpsw.2017.157
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
Remzi H. Arpaci
中科院分区：
文献类型：
--
作者：
I. Jimenez;Michael Sevilla;Noah Watkins;C. Maltzahn;J. Lofstead;K. Mohror;Andrea C. Arpaci;Remzi H. Arpaci
系统研究领域的实验结果的独立验证是一项具有挑战性的任务，主要是由于计算环境中软件和硬件的差异。重新创建一个与原始环境相似的环境既困难又耗时。在本文中，我们介绍了_Popper_，这是一种基于一套现代开源软件 (OSS) 开发原则的约定，用于生成可重复的科学出版物。具体来说，我们论证了将一篇文章视为遵循 DevOps 方法的 OSS 项目，并应用软件工程最佳实践来管理其相关工件并保持其结果的可重复性。 Popper 利用现有的云计算基础设施和 DevOps 工具来编写易于验证和扩展的学术文章。我们提出一个用例来说明这种方法的有用性。我们展示了如何通过遵循 _Popper_ 约定，审稿人和研究人员可以快速获得结果，而无需依赖原作者的干预。
Independent validation of experimental results in the field of systems research is a challenging task, mainly due to differences in software and hardware in computational environments. Recreating an environment that resembles the original is difficult and time-consuming. In this paper we introduce _Popper_, a convention based on a set of modern open source software (OSS) development principles for generating reproducible scientific publications. Concretely, we make the case for treating an article as an OSS project following a DevOps approach and applying software engineering best-practices to manage its associated artifacts and maintain the reproducibility of its findings. Popper leverages existing cloud-computing infrastructure and DevOps tools to produce academic articles that are easy to validate and extend. We present a use case that illustrates the usefulness of this approach. We show how, by following the _Popper_ convention, reviewers and researchers can quickly get to the point of getting results without relying on the original author's intervention.