WRENCH: A Framework for Simulating Workflow Management Systems

WRENCH: A Framework for Simulating Workflow Management Systems
复制标题

WRENCH:模拟工作流管理系统的框架

DOI:
10.1109/works.2018.00013
复制
发表时间:
2018
期刊:
13th Workshop on Workflows in Support of Large-Scale Science (WORKS'18
影响因子:
--
通讯作者:
Ferreira da Silva, Rafael
Ferreira da Silva, Rafael
中科院分区:
--
文献类型:
--
作者:
Casanova, Henri;Pandey, Suraj;Oeth, James;Tanaka, Ryan;Suter, Frederic;Ferreira da Silva, Rafael

文献摘要

参考文献

被引文献

相似文献

科学工作流在许多科学领域中经常使用,工作流管理系统(Workflow Management Systems, WMSs)已经被开发出来,用于编排和优化分布式平台上的工作流执行。wms是与复杂软件基础结构交互的复杂软件系统。大多数WMS研究和开发活动依赖于在实际硬件平台上使用成熟的软件栈进行的经验实验。然而,这样的实验仅限于手头的硬件和软件基础设施,并且可能是劳动和/或时间密集型的。因此,仅仅依靠现实世界的实验阻碍了WMS的研究和发展。另一种方法是在模拟中进行实验。在这项工作中,我们提出了扳手,一个WMS仿真框架,其目标是(i)准确和可扩展的模拟;(二)易于仿真软件的开发。通过构建SimGrid框架,扳手实现了它的第一个目标。虽然SimGrid因其仿真模型的准确性和可伸缩性而得到认可,但它只提供低级的仿真抽象,因此在实现复杂系统的仿真器时需要大量的软件开发工作。因此,扳手通过在SimGrid之上提供高层次和直接可重用的仿真抽象实现了它的第二个目标。在描述并给出了扳手的软件架构和api的基本原理之后,我们提出了一个案例研究,其中我们应用扳手来模拟Pegasus生产WMS。我们报告了易于实现、仿真精度和仿真可扩展性,以确定扳手在多大程度上实现了上述两个目标。我们还与先前提出的工作流模拟器进行了定性和定量比较。
Scientific workflows are used routinely in numerous scientific domains, and Workflow Management Systems (WMSs) have been developed to orchestrate and optimize workflow executions on distributed platforms. WMSs are complex software systems that interact with complex software infrastructures. Most WMS research and development activities rely on empirical experiments conducted with full-fledged software stacks on actual hardware platforms. Such experiments, however, are limited to hardware and software infrastructures at hand and can be labor- and/or time-intensive. As a result, relying solely on real-world experiments impedes WMS research and development. An alternative is to conduct experiments in simulation. In this work we present WRENCH, a WMS simulation framework, whose objectives are (i) accurate and scalable simulations; and (ii) easy simulation software development. WRENCH achieves its first objective by building on the SimGrid framework. While SimGrid is recognized for the accuracy and scalability of its simulation models, it only provides low-level simulation abstractions and thus large software development efforts are required when implementing simulators of complex systems. WRENCH thus achieves its second objective by providing high- level and directly re-usable simulation abstractions on top of SimGrid. After describing and giving rationales for WRENCH’s software architecture and APIs, we present a case study in which we apply WRENCH to simulate the Pegasus production WMS. We report on ease of implementation, simulation accuracy, and simulation scalability so as to determine to which extent WRENCH achieves its two above objectives. We also draw both qualitative and quantitative comparisons with a previously proposed workflow simulator.
在科学工作流程管理系统背后的模拟中培养能源意识
DOI: --
发表时间: 2014
期刊: 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing
影响因子: --
作者:
G. Kecskeméti;S. Ostermann;R. Prodan
通讯作者: R. Prodan
一种新型云计算仿真平台的设计
DOI: 10.1007/978-3-642-21931-3_45
发表时间: 2011
期刊: 2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops
影响因子: --
作者:
A. Núñez;J. L. Vázquez;A. Caminero;J. Carretero;I. Llorente
通讯作者: I. Llorente
更好地模拟以太网/TCP 网络上的 MPI 应用
DOI: --
发表时间: 2013
期刊: PMBS@SC
影响因子: --
作者:
Paul Bédaride;A. Degomme;S. Genaud;Arnaud Legrand;George S. Markomanolis;M. Quinson;Mark Stillwell;F. Suter;B. Videau
通讯作者: B. Videau
Pewss:用于工作流调度研究的可扩展工作流模拟服务平台
DOI: --
发表时间: 2018
期刊: Software, Practice & Experience
影响因子: --
作者:
Meng;Kuan;Hsi;Kuan Fu Chen;Kuo
通讯作者: Kuo
向 SimGrid 工具包添加存储模拟功能:概念、模型和 API
DOI: --
发表时间: 2015
期刊: 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
影响因子: --
作者:
A. Lèbre;Arnaud Legrand;F. Suter;Pierre Veyre
通讯作者: Pierre Veyre