Using rapid prototyping to choose a bioinformatics workflow management system
Using rapid prototyping to choose a bioinformatics workflow management system
复制标题
使用快速原型设计选择生物信息学工作流程管理系统
DOI：
10.1101/2020.08.04.236208
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Jackson M
中科院分区：
文献类型：
--
作者：
Jackson M
工作流管理系统代表、管理和执行多步骤计算分析，并为生物信息学家提供了许多好处。它们为描述分析工作流提供了一种通用语言，有助于再现性和构建可重用组件库。它们既可以支持增量构建，也可以支持重入——在存在额外输入或配置更改的情况下，有选择地重新执行工作流的某些部分，并从工作流先前停止的地方恢复执行。许多工作流管理系统通过支持使用容器、高性能计算（HPC）系统和云来增强可移植性。最重要的是，工作流管理系统允许生物信息学家将他们的工作流如何运行委托给工作流管理系统及其开发人员。这使得生物信息学家可以专注于这些工作流应该做什么，专注于他们的数据分析和他们的科学。RiboViz是一个从核糖体分析数据中提取生物学见解的软件包，有助于提高对蛋白质合成的理解。RiboViz的核心是一个用Python脚本实现的分析工作流。为了符合科学计算的最佳实践（推荐使用构建工具来自动化工作流和重用代码而不是重写它），作者在工作流管理系统中重新实现了这个工作流。为了选择一个工作流管理系统，我们对可用的系统进行了快速调查，并列出了候选系统：Snakemake、cwltool、Toil和Nextflow。通过快速构建RiboViz工作流程的一个子集，对每个候选产品进行了评估，最终选择了Nextflow。选择过程耗时10人日，对于保证Nextflow满足作者的要求来说，这是一个很小的成本。原型的使用可以提供一种低成本的方法，使在项目中使用的软件选择更加明智，而不是仅仅依赖于其他人的评论和建议。
Workflow management systems represent, manage, and execute multistep computational analyses and offer many benefits to bioinformaticians. They provide a common language for describing analysis workflows, contributing to reproducibility and to building libraries of reusable components. They can support both incremental build and re-entrancy—the ability to selectively re-execute parts of a workflow in the presence of additional inputs or changes in configuration and to resume execution from where a workflow previously stopped. Many workflow management systems enhance portability by supporting the use of containers, high-performance computing (HPC) systems, and clouds. Most importantly, workflow management systems allow bioinformaticians to delegate how their workflows are run to the workflow management system and its developers. This frees the bioinformaticians to focus on what these workflows should do, on their data analyses, and on their science.RiboViz is a package to extract biological insight from ribosome profiling data to help advance understanding of protein synthesis. At the heart of RiboViz is an analysis workflow, implemented in a Python script. To conform to best practices for scientific computing which recommend the use of build tools to automate workflows and to reuse code instead of rewriting it, the authors reimplemented this workflow within a workflow management system. To select a workflow management system, a rapid survey of available systems was undertaken, and candidates were shortlisted: Snakemake, cwltool, Toil, and Nextflow. Each candidate was evaluated by quickly prototyping a subset of the RiboViz workflow, and Nextflow was chosen. The selection process took 10 person-days, a small cost for the assurance that Nextflow satisfied the authors’ requirements. The use of prototyping can offer a low-cost way of making a more informed selection of software to use within projects, rather than relying solely upon reviews and recommendations by others.
语言物理 2016
DOI：
--
发表时间：
--
期刊：
影响因子：
--
作者：
通讯作者：
--
影响因子：
9.2
作者：
Reiter T;Brooks PT;Irber L;Joslin SEK;Reid CM;Scott C;Brown CT;Pierce-Ward NT
通讯作者：
Pierce-Ward NT
影响因子：
9.8
作者：
Wilson G;Aruliah DA;Brown CT;Chue Hong NP;Davis M;Guy RT;Haddock SH;Huff KD;Mitchell IM;Plumbley MD;Waugh B;White EP;Wilson P
通讯作者：
Wilson P