Introducing Parsl: A Python Parallel Scripting Library
Introducing Parsl: A Python Parallel Scripting Library
复制标题
Parsl 简介：Python 并行脚本库
DOI：
--
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
J. Wozniak
中科院分区：
文献类型：
--
作者：
Y. Babuji;A. Brizius;K. Chard;Ian T Foster;Daniel S. Katz;M. Wilde;J. Wozniak
研究人员经常依靠大规模和特定领域的工作流来进行科学研究。这些工作流程可以集成各种独立的软件功能和外部应用程序。然而，开发和执行这些工作流程可能很困难，需要对应用程序和数据进行复杂的编排和管理，以及针对特定执行环境进行定制。Parsl（并行脚本库）是一个用于并行编程和执行面向数据的工作流的Python库，它解决了这些问题。开发人员只需使用Parsl指令注释Python脚本; Parsl管理脚本在集群、云、网格和其他资源上的执行。Parsl协调所需的数据移动，并并行管理Python函数和外部应用程序的执行。在这个摘要中，我们描述了Parsl的架构，并强调了它已被使用的两个领域。
—Researchers frequently rely on large-scale and domain-specific workflows to conduct their science. These workflows may integrate a variety of independent software functions and external applications. However, developing and executing such workflows can be difficult, requiring complex orchestration and management of applications and data as well as customiza-tion for specific execution environments. Parsl (Parallel Scripting Library), a Python library for programming and executing data-oriented workflows in parallel, addresses these problems. Developers simply annotate a Python script with Parsl directives; Parsl manages the execution of the script on clusters, clouds, grids, and other resources. Parsl orchestrates required data movement and manages the execution of Python functions and external applications in parallel. In this abstract we describe Parsl’s architecture and highlight two domains in which it has been used.