Automatic Reproduction of Workflows in the Snakemake Workflow Catalog and nf-core Registries

Automatic Reproduction of Workflows in the Snakemake Workflow Catalog and nf-core Registries
复制标题

自动复制 Snakemake 工作流程目录和 nf-core 注册表中的工作流程

DOI:
10.1145/3589806.3600037
复制
发表时间:
2023
期刊:
1st ACM Conference on Reproducibility and Replicability
影响因子:
--
通讯作者:
Milewicz, Reed
Milewicz, Reed
中科院分区:
--
文献类型:
--
作者:
Grayson, Samuel;Marinov, Darko;Katz, Daniel S.;Milewicz, Reed

文献摘要

参考文献

被引文献

相似文献

工作流程使科学家能够更轻松地组装由许多不同组件组成的计算实验。然而,这些不同的组件也增加了计算实验无法重现的可能性。即使软件今天是可重现的,但由于软件运行的软件环境不断变化,在软件本身根本不改变的情况下,明天它也可能变得不可重现。为了减轻不可重现性,工作流引擎与容器引擎集成。此外,围绕工作流引擎涌现的社区开始托管遵循标准的工作流注册表。这些标准减少了使工作流程自动重现所需的工作量。在本文中,我们研究了两个注册表中工作流程的自动重现,重点关注非崩溃执行。实验数据让我们分析工作流引擎可以实现再现性的上限。我们总结了在实践中实现可重复性的经验教训。
Workflows make it easier for scientists to assemble computational experiments consisting of many disparate components. However, those disparate components also increase the probability that the computational experiment fails to be reproducible. Even if software is reproducible today, it may become irreproducible tomorrow without the software itself changing at all, because of the constantly changing software environment in which the software is run.To alleviate irreproducibility, workflow engines integrate with container engines. Additionally, communities that sprung up around workflow engines started to host registries for workflows that follow standards. These standards reduce the effort needed to make workflows automatically reproducible.In this paper, we study automatic reproduction of workflows from two registries, focusing on non-crashing executions. The experimental data lets us analyze the upper bound to which workflow engines could achieve reproducibility. We identify lessons learned in achieving reproducibility in practice.
DOI: 10.1038/s41597-022-01720-9
发表时间: 2022-10-04
期刊: SCIENTIFIC DATA
影响因子: 9.8
作者:
Vallet, Nicolas;Michonneau, David;Tournier, Simon
通讯作者: Tournier, Simon
ProvONE:科学工作流程的起源模型
DOI: --
发表时间: 2020
期刊: WISE
影响因子: --
作者:
Anila Sahar Butt;P. Fitch
通讯作者: P. Fitch
当历史重要时 - 评估科学工作流程重用的可靠性
DOI: 10.1007/978-3-642-41338-4_6
发表时间: 2013
期刊: Scientific Data
影响因子: 9.8
作者:
José Manuél Gómez;Esteban García;Aleix Garrido;J. E. Ruiz;Jun Zhao;G. Klyne
通讯作者: G. Klyne
传递信用和 JSON-LD
DOI: 10.5334/jors.by
发表时间: 2015
影响因子: --
作者:
D. Katz;Arfon M. Smith
通讯作者: Arfon M. Smith
增加获得联邦资助科学研究成果的机会
DOI: 10.18260/1-2--25374
发表时间: 2016
期刊: 2016 ERC Proceedings
影响因子: --
作者:
K. Koizumi
通讯作者: K. Koizumi