Adding Storage Simulation Capacities to the SimGrid Toolkit: Concepts, Models, and API
Adding Storage Simulation Capacities to the SimGrid Toolkit: Concepts, Models, and API
复制标题
向 SimGrid 工具包添加存储模拟功能：概念、模型和 API
DOI：
--
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
Pierre Veyre
中科院分区：
文献类型：
--
作者：
A. Lèbre;Arnaud Legrand;F. Suter;Pierre Veyre
对于各种分布式计算基础设施，即集群、网格、云、数据中心或超级计算机，存储是应对科学数据生产的巨大增长以及不断增长的数据分析和保存需求的重要组成部分。了解存储子系统的性能或正确确定其尺寸是一个重要的问题，仿真可以通过允许针对任意假设场景进行快速、完全可重复和可配置的实验来提供帮助。然而，大多数为分布式系统研究而定制的模拟框架不提供或很少提供存储资源的抽象或模型。在本文中，我们详细介绍了 SimGrid 的扩展，这是一个用于模拟大规模分布式计算系统的多功能工具包，具有存储模拟功能。我们首先定义所需的抽象，并提出一个新的 API 来处理基于 SimGrid 的模拟器中的存储组件及其内容。然后，我们描述基本存储组件（磁盘）的性能，并导出这些资源的模型。最后，我们列出了集群、网格、云和数据中心中存储模拟的几个具体用例，所提议的扩展将是有益的。
For each kind of distributed computing infrastructures, i.e., clusters, grids, clouds, data centers, or supercomputers, storage is a essential component to cope with the tremendous increase in scientific data production and the ever-growing need for data analysis and preservation. Understanding the performance of a storage subsystem or dimensioning it properly is an important concern for which simulation can help by allowing for fast, fully repeatable, and configurable experiments for arbitrary hypothetical scenarios. However, most simulation frameworks tailored for the study of distributed systems offer no or little abstractions or models of storage resources. In this paper, we detail the extension of SimGrid, a versatile toolkit for the simulation of large-scale distributed computing systems, with storage simulation capacities. We first define the required abstractions and propose a new API to handle storage components and their contents in SimGrid-based simulators. Then we characterize the performance of the fundamental storage component that are disks and derive models of these resources. Finally we list several concrete use cases of storage simulations in clusters, grids, clouds, and data centers for which the proposed extension would be beneficial.