A method of repairing single node failure in the distributed storage system based on the regenerating-code and a hybrid genetic algorithm
A method of repairing single node failure in the distributed storage system based on the regenerating-code and a hybrid genetic algorithm
复制标题
基于再生码和混合遗传算法的分布式存储系统单节点故障修复方法
DOI:
10.1016/j.neucom.2019.11.124
复制
发表时间:
2020-11
期刊:
影响因子:
6
通讯作者:
Tianxin Ma
中科院分区:
文献类型:
--
作者:
Miao Ye;Hongbing Qiu;Yong Wang;Zou Zhou;Fei Zheng;Tianxin Ma
To ensure the reliability and security of the data, the large-scale distributed storage system usually adopts the data redundancy mechanism to repair the data on the faulty nodes. Comparing with the replication-based method, the data redundancy mechanism of erasure code can effectively improve the use of storage space, but it may result in the large network overhead when recovering the data. The regenerating code is an improved erasure code, which can reduce the quantity of data transmission compared to that of the erasure code. Adopting the regenerating code to repair the data on a faulty node requires constructing an optimal repair tree to maximum the bandwidth of the bottleneck link, which is an NP-hard problem. To construct the optimal repair tree, a hybrid genetic algorithm is proposed in this paper. In particular, our proposal comprehensively considers the network topology and link bandwidth of storage nodes and designs a problem-specific cross-correlation operator, mutation operator and local search operator. In addition, we provided the mathematical proof of the global convergence with probability one with respect to the proposed hybrid genetic algorithm. Through a series of simulation experiments, the results show that our proposal is able to determine the optimal repair tree, which effectively reduces the delay of faulty node repair in distributed storage systems, and improve the repairing efficiency.