Mean-Field Analysis of Coding Versus Replication in Large Data Storage Systems

Mean-Field Analysis of Coding Versus Replication in Large Data Storage Systems
复制标题

大数据存储系统中编码与复制的平均场分析

DOI:
10.1145/3159172
复制
发表时间:
2018
影响因子:
0.6
通讯作者:
Srikant, R.
Srikant, R.
中科院分区:
--
文献类型:
--
作者:
Li, Bin;Ramamoorthy, Aditya;Srikant, R.

文献摘要

参考文献

被引文献

相似文献

我们研究的云存储系统中,大量的文件存储在大量的服务器中。在这样的系统中,文件被复制或编码以确保可靠性,即,以保证从服务器故障中恢复文件。通过适当的负载平衡(路由)方案,可以进一步利用存储中的这种冗余来提高系统性能(平均文件访问延迟)。然而,目前还不清楚是否编码或复制是更好的从系统性能的角度来看,因为相应的嵌入式分析,这样的系统是,在一般情况下,相当困难,除了平凡的情况下,当系统负载渐近趋于零。在这里,我们研究更困难的情况下,系统负载不是渐近为零。使用的事实是,系统的大小是大的,我们得到一个平均场的限制,在每个服务器上等待的文件访问请求的数量的稳态分布。然后,我们使用平均场限制表明,对于每个文件的给定存储容量,编码严格优于复制在所有流量负载,同时提高可靠性。此外,在重业务中性能改善的因子至少与在轻业务情况下一样大。最后,我们通过大量的模拟验证这些结果。
We study cloud storage systems with a very large number of files stored in a very large number of servers. In such systems, files are either replicated or coded to ensure reliability, i.e., to guarantee file recovery from server failures. This redundancy in storage can further be exploited to improve system performance (mean file-access delay) through appropriate load-balancing (routing) schemes. However, it is unclear whether coding or replication is better from a system performance perspective since the corresponding queueing analysis of such systems is, in general, quite difficult except for the trivial case when the system load asymptotically tends to zero. Here, we study the more difficult case where the system load is not asymptotically zero. Using the fact that the system size is large, we obtain a mean-field limit for the steady-state distribution of the number of file access requests waiting at each server. We then use the mean-field limit to show that, for a given storage capacity per file, coding strictly outperforms replication at all traffic loads while improving reliability. Further, the factor by which the performance improves in the heavy traffic is at least as large as in the light-traffic case. Finally, we validate these results through extensive simulations.
DOI: 10.1109/tnet.2015.2466453
发表时间: 2014-04
期刊: IEEE/ACM Transactions on Networking
影响因子: --
作者:
Yu Xiang;Tian Lan;V. Aggarwal;Y. Chen
通讯作者: Yu Xiang;Tian Lan;V. Aggarwal;Y. Chen
DOI: 10.1016/j.peva.2011.07.015
发表时间: 2011-11-01
影响因子: 2.2
作者:
Lu, Yi;Xie, Qiaomin;Greenberg, Albert
通讯作者: Greenberg, Albert
云存储系统中编码与复制的平均场分析
DOI: --
发表时间: 2016
期刊: IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications
影响因子: --
作者:
Bin Li;A. Ramamoorthy;R. Srikant
通讯作者: R. Srikant
有效复制排队任务以减少云系统中的延迟
DOI: --
发表时间: 2015
期刊:
影响因子: --
作者:
Gauri Joshi
通讯作者: Gauri Joshi