BeeFlow: A Workflow Management System for In Situ Processing across HPC and Cloud Systems

BeeFlow: A Workflow Management System for In Situ Processing across HPC and Cloud Systems
复制标题

BeeFlow:跨 HPC 和云系统进行原位处理的工作流管理系统

DOI:
--
复制
发表时间:
2018
期刊:
IEEE International Conference on Distributed Computing Systems
影响因子:
--
通讯作者:
J. Ahrens
J. Ahrens
中科院分区:
--
文献类型:
--
作者:
Jieyang Chen;Qiang Guan;Zhao Zhang;Xin Liang;L. Vernon;A. McPherson;Li;Patricia A. Grubel;Timothy Randles;Zizhong Chen;J. Ahrens

文献摘要

被引文献

相似文献

在本文中,我们提出了BeeFlow--一个使用Docker Containers的跨平台、支持现场分析的工作流管理系统。BeeFlow既可以支持传统工作流,也可以支持具有现场分析的工作流。BeeFlow利用Docker Containers跨HPC和云平台提供可移植、灵活且可重现的工作流管理系统。我们展示了当前的现场可视化工作流程如何通过能源部生产代码VPIC和Flecsell应用BeeFlow。
In this paper, we propose BeeFlow – an in situ analysis enabled workflow management system across multiple platforms using Docker containers. BeeFlow can support both traditional workflows as well as workflows with in situ analysis. BeeFlow leverages Docker containers to provide a portable, flexible, and reproducible workflow management system across HPC and cloud platforms. We showcase how current in situ visualization workflows can apply BeeFlow with DOE production codes VPIC and Flecsale.