Managing Response Time Tails by Sharding

Managing Response Time Tails by Sharding
复制标题

通过分片管理响应时间尾部

DOI:
10.1145/3300143
复制
发表时间:
2019
影响因子:
0.6
通讯作者:
Harrison P
Harrison P
中科院分区:
--
文献类型:
--
作者:
Harrison P

文献摘要

参考文献

相似文献

矩阵分析方法被开发来计算响应时间的概率分布(即,数据访问时间),这是通过将数据对象分片成N个片段来实现的,仅需要K <N个片段来重构对象。这导致了一个部分分叉连接模型,可以选择取消冗余N-K任务的策略。分析模型的准确性得到了广泛设置中模拟测试的支持。在增加的工作负载强度,数值结果表明,在何种程度上增加冗余级别减少存储读取的平均响应时间,并显着的尾部分布,这是证明在中高分位数,高达99。还示出了通过两种用于取消冗余任务的策略实现的响应时间的定量减少:用于结束时取消和开始时取消,这限制了引入的额外负载,同时失去了片段服务时间之间的选择性的益处。
Matrix analytic methods are developed to compute the probability distribution of response times (i.e., data access times) in distributed storage systems protected by erasure coding, which is implemented by sharding a data object intoNfragments, onlyK<;Nof which are required to reconstruct the object. This leads to a partial-fork-join model with a choice of canceling policies for the redundantN−Ktasks. The accuracy of the analytical model is supported by tests against simulation in a broad range of setups. At increasing workload intensities, numerical results show the extent to which increasing the redundancy level reduces the mean response time of storage reads and significantly flattens the tail of their distribution; this is demonstrated at medium-high quantiles, up to the 99th. The quantitative reduction in response time achieved by two policies for canceling redundant tasks is also shown: for cancel-at-finish and cancel-at-start, which limits the additional load introduced whilst losing the benefit of selectivity amongst fragment service times.
DOI: --
发表时间: 2006
期刊: European Performance Engineering Workshop
影响因子: --
作者:
A. Heindl;G. Horváth;K. Gross
通讯作者: K. Gross
DOI: 10.1109/tnet.2015.2466453
发表时间: 2014-04
期刊: IEEE/ACM Transactions on Networking
影响因子: --
作者:
Yu Xiang;Tian Lan;V. Aggarwal;Y. Chen
通讯作者: Yu Xiang;Tian Lan;V. Aggarwal;Y. Chen
大数据存储系统中编码与复制的平均场分析
DOI: 10.1145/3159172
发表时间: 2018
影响因子: 0.6
作者:
Li, Bin;Ramamoorthy, Aditya;Srikant, R.
通讯作者: Srikant, R.
三角形M/G/1型和树状准生死马尔可夫链
DOI: --
发表时间: 2011
影响因子: 2.1
作者:
B. V. Houdt;J. V. Leeuwaarden
通讯作者: J. V. Leeuwaarden
MDS 队列:分析代码和冗余请求的延迟性能
DOI: --
发表时间: 2012
期刊:
影响因子: --
作者:
Nihar B. Shah;Kangwook Lee;K. Ramchandran
通讯作者: K. Ramchandran