An autonomous configuration scheme of storage tiers for distributed file system

An autonomous configuration scheme of storage tiers for distributed file system
复制标题

分布式文件系统存储层自主配置方案

DOI:
10.1109/snpd.2017.8022761
复制
发表时间:
2017
期刊:
Proceedings of the 18th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD 2017)
影响因子:
--
通讯作者:
Hirata Hiroaki
Hirata Hiroaki
中科院分区:
--
文献类型:
--
作者:
Shimano Shingo;Nunome Atsushi;Yokoi Yuta;Shibayama Kiyoshi;Hirata Hiroaki

文献摘要

相似文献

我们提出了一种分布式存储系统,它可以动态地划分存储层,并自主地优化数据块的位置。这样做的目的是在不增加网络开销的情况下提高存储系统的I/O性能。我们的系统根据设备特性动态组织存储层。根据数据块的访问模式,将数据块放置在合适的存储层中。在本文中,我们提出了一种利用待迁移数据块的访问特性来选择迁移目标存储节点的方法。该方法对存储节点进行动态排序,每个存储节点自主配置存储层。仿真结果表明,与不考虑迁移数据的访问特性的静态迁移相比,该方案最多可使具有文件I/O的程序的执行时间缩短49%。
We have proposed a distributed storage system which dynamically makes storage tiers and optimizes location of data blocks autonomously. This aims to enhance the I/O performance of the storage system without remarkable network overhead. Our system dynamically organizes storage tiers considering device characteristics. And the data blocks will be placed in a suitable storage tier according to their access pattern. In this paper, we propose a method to select the destination storage node for migration using an access characteristic of a data block to be migrated. This method ranks the storage nodes dynamically, and each storage node configures storage tiers autonomously. Simulation results show that our scheme can short the execution time of a program with file I/O by 49% at maximum, in comparison with the static migration without considering the access characteristics of the migration data.