Developing accurate and scalable simulators of production workflow management systems with WRENCH
Developing accurate and scalable simulators of production workflow management systems with WRENCH
复制标题
使用 WRENCH 开发生产工作流程管理系统的准确且可扩展的模拟器
DOI：
10.1016/j.future.2020.05.030
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Suter, Frédéric
中科院分区：
文献类型：
--
作者：
Casanova, Henri;Ferreira da Silva, Rafael;Tanaka, Ryan;Pandey, Suraj;Jethwani, Gautam;Koch, William;Albrecht, Spencer;Oeth, James;Suter, Frédéric
科学工作流在许多科学领域中被常规使用，并且已经开发了工作流管理系统（WMS）来编排和优化分布式平台上的工作流执行。WMS是与复杂的软件基础设施交互的复杂软件系统。大多数WMS研究和开发活动依赖于在实际硬件平台上使用成熟的软件堆栈进行的经验实验。然而，这些实验仅限于手头的硬件和软件基础设施，并且可能是劳动和/或时间密集型的。因此，仅仅依靠真实世界的实验阻碍了WMS的研究和开发。另一种方法是进行模拟实验。在这项工作中，我们提出了WRENCH，WMS仿真框架，其目标是（i）准确和可扩展的模拟;（ii）易于仿真软件开发。WRENCH通过建立在SimGrid框架上来实现其第一个目标。虽然SimGrid因其仿真模型的准确性和可扩展性而得到认可，但它只提供低级别的仿真抽象，因此在实现复杂系统的仿真器时需要大量的软件开发工作。WRENCH因此通过在SimGrid之上提供高级和直接可重用的仿真抽象来实现其第二个目标。在描述并给出WRENCH的软件架构和API的原理后，我们提出了两个案例研究，其中我们应用WRENCH来模拟飞马生产WMS和WorkQueue应用程序执行框架。我们报告的易于实施，仿真精度和仿真的可扩展性，以确定在何种程度上扳手实现其目标。我们还绘制了定性和定量的比较与以前提出的工作流模拟器。
Scientific workflows are used routinely in numerous scientific domains, and Workflow Management Systems (WMSs) have been developed to orchestrate and optimize workflow executions on distributed platforms. WMSs are complex software systems that interact with complex software infrastructures. Most WMS research and development activities rely on empirical experiments conducted with full-fledged software stacks on actual hardware platforms. These experiments, however, are limited to hardware and software infrastructures at hand and can be labor- and/or time-intensive. As a result, relying solely on real-world experiments impedes WMS research and development. An alternative is to conduct experiments in simulation. In this work we present WRENCH, a WMS simulation framework, whose objectives are (i) accurate and scalable simulations; and (ii) easy simulation software development. WRENCH achieves its first objective by building on the SimGrid framework. While SimGrid is recognized for the accuracy and scalability of its simulation models, it only provides low-level simulation abstractions and thus large software development efforts are required when implementing simulators of complex systems. WRENCH thus achieves its second objective by providing high-level and directly re-usable simulation abstractions on top of SimGrid. After describing and giving rationales for WRENCH’s software architecture and APIs, we present two case studies in which we apply WRENCH to simulate the Pegasus production WMS and the WorkQueue application execution framework. We report on ease of implementation, simulation accuracy, and simulation scalability so as to determine to which extent WRENCH achieves its objectives. We also draw both qualitative and quantitative comparisons with a previously proposed workflow simulator.
登录
查看更多内容
在科学工作流程管理系统背后的模拟中培养能源意识
DOI：
--
发表时间：
2014
期刊：
2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing
影响因子：
--
作者：
G. Kecskeméti;S. Ostermann;R. Prodan
通讯作者：
R. Prodan
一种新型云计算仿真平台的设计
DOI：
10.1007/978-3-642-21931-3_45
发表时间：
2011
期刊：
2013 IEEE 33rd International Conference on Distributed Computing Systems Workshops
影响因子：
--
作者：
A. Núñez;J. L. Vázquez;A. Caminero;J. Carretero;I. Llorente
通讯作者：
I. Llorente
更好地模拟以太网/TCP 网络上的 MPI 应用
DOI：
--
发表时间：
2013
期刊：
PMBS@SC
影响因子：
--
作者：
Paul Bédaride;A. Degomme;S. Genaud;Arnaud Legrand;George S. Markomanolis;M. Quinson;Mark Stillwell;F. Suter;B. Videau
通讯作者：
B. Videau
通过全对和波前抽象利用多核集群中的并行性
DOI：
--
发表时间：
2009
期刊：
IEEE International Symposium on High-Performance Parallel Distributed Computing
影响因子：
--
作者：
Li Yi;C. Moretti;S. Emrich;Kenneth Judd;D. Thain
通讯作者：
D. Thain
集群、云和网格上可扩展基因组组装的框架
影响因子：
5.3
作者：
C. Moretti;A. Thrasher;Li Yu;Michael Olson;S. Emrich;D. Thain
通讯作者：
D. Thain