PRS: A Pattern-Directed Replication Scheme for Heterogeneous Object-Based Storage

PRS: A Pattern-Directed Replication Scheme for Heterogeneous Object-Based Storage
复制标题

DOI:
10.1109/tc.2019.2954089
复制
发表时间:
2020-04
影响因子:
3.7
通讯作者:
Jiang Zhou;Yong Chen;Wei Xie;Dong Dai;Shuibing He;Weiping Wang
Jiang Zhou;Yong Chen;Wei Xie;Dong Dai;Shuibing He;Weiping Wang
中科院分区:
计算机科学2区
文献类型:
--
作者:
Jiang Zhou;Yong Chen;Wei Xie;Dong Dai;Shuibing He;Weiping Wang

文献摘要

被引文献

相似文献

数据复制是分布式存储系统中实现高可用性、高可靠性和高性能的关键技术。近年来,随着新存储设备的出现,异构的基于对象的存储系统(诸如具有硬盘驱动器、固态驱动器和其他非易失性存储器设备的混合的存储系统)已经变得越来越有吸引力,因为它们联合收割机组合了不同存储设备的优点以提供更好的承诺。然而,现有的数据复制方案没有很好地考虑异构存储设备的不同特征,这可能导致次优性能。本文介绍了一种新的数据复制方案称为模式定向复制方案(PRS),以实现异构存储系统的高效数据复制。与传统方案不同的是,PRS有选择地复制数据对象,并根据其特性将副本分发到不同的存储设备。它通过计算对象距离将具有I/O相关性的对象聚合成对象组,并根据识别出的应用程序数据访问模式对成组的对象进行复制。此外,PRS使用伪随机算法,通过考虑存储设备的性能和容量特征来优化副本放置。我们已经评估了模式导向的复制计划在牧羊犬,一个典型的基于对象的存储系统进行了广泛的测试。实验结果证实,它是一种高效的异构存储系统复制方案。例如,与现有复制方案相比,读取性能提高了105%,接近10倍。
Data replication is a key technique to achieve high data availability, reliability, and optimized performance in distributed storage systems. In recent years, with emerged new storage devices, heterogeneous object-based storage systems, such as a storage system with a mix of hard disk drives, solid state drives, and other non-volatile memory devices have become increasingly attractive since they combine the merits of different storage devices to deliver better promises. However, existing data replication schemes do not well consider distinct characteristics of heterogeneous storage devices yet, which could lead to suboptimal performance. This article introduces a new data replication scheme called Pattern-directed Replication Scheme (PRS) to achieve efficient data replication for heterogeneous storage systems. Different from traditional schemes, the PRS selectively replicates data objects and distributes replicas to various storage devices based on their characteristics. It aggregates objects that have I/O correlation into object groups by calculating object distance and makes replication for grouped objects according to application's data access pattern identified. In addition, the PRS uses a pseudo random algorithm to optimize replica placement by considering the storage device performance and capacity features. We have evaluated the pattern-directed replication scheme with extensive tests in Sheepdog, a typical object-based storage system. The experimental results confirm that it is a highly efficient replication scheme for heterogeneous storage systems. For instance, the read performance was improved by 105 percent to nearly 10x compared with existing replication schemes.