The Evolution of the Pegasus Workflow Management Software

The Evolution of the Pegasus Workflow Management Software
复制标题

DOI:
10.1109/mcse.2019.2919690
复制
发表时间:
2019-07-01
影响因子:
2.1
通讯作者:
Livny, Miron
Livny, Miron
中科院分区:
计算机科学4区
文献类型:
--
作者:
Deelman, Ewa;Vahi, Karan;Livny, Miron

文献摘要

被引文献

相似文献

自2001年以来,Pegasus工作流管理系统已经发展成为一个强大的和可扩展的系统,自动执行许多复杂的应用程序运行在各种异构的,分布式的高吞吐量和高性能的计算环境。Pegasus基于工作流描述和工作流执行分离的原则,提供了基于目标执行环境的工作流移植和适配能力。通过用户驱动的研究和开发,它适应了许多科学界的需求,利用和开发新的算法和软件工程解决方案。本文描述了飞马座随着时间的推移的演变,并提供了设计决策背后的动机。报告最后介绍了一些经验教训。
Since 2001, the Pegasus Workflow Management System has evolved into a robust and scalable system that automates the execution of a number of complex applications running on a variety of heterogeneous, distributed high-throughput, and high-performance computing environments. Pegasus was built on the principle of separation between the workflow description and workflow execution, providing the ability to port and adapt the workflow based on the target execution environment. Through its user-driven research and development, it has adapted to the needs of a number of scientific communities, utilizing and developing novel algorithms and software engineering solutions. This paper describes the evolution of Pegasus over time and provides motivations behind the design decisions. It concludes with selected lessons learned.