Flow Distribution-aware Load Balancing for the Datacenter
Flow Distribution-aware Load Balancing for the Datacenter
复制标题
数据中心的流量分布感知负载平衡
DOI:
10.1016/j.comcom.2017.03.005
复制
发表时间:
2017-07
期刊:
影响因子:
--
通讯作者:
Yunjie Liu
中科院分区:
文献类型:
--
作者:
Shuo Wang;Jiao Zhang;Tao Huang;Tian Pan;Jiang Liu;Yunjie Liu
Leveraging centralized and distributed load balancing algorithm to jointly schedule long and short flows attracts much attention since by classifying flows, they could reduce the completion times of flows without losing the scalability. However, existing centralized-distributed joint algorithms generally classify flows according to a static threshold and are unable to adapt to traffic dynamics. More importantly, through over investigation, the overheads of the controller caused by classifying flows and handling flows can be further reduced.In this paper, we present a Flow Distribution-Aware Load Balancing (FDALB) mechanism to reduce flow completion times and achieve high scalability. In FDALB, flows are split into short flows and long flows according to a threshold. The traffic of short flows and long flows are balanced by distributed and centralized algorithms respectively. To adapt to traffic dynamics, we propose a simple yet effective scheme adaptively adjusting the splitting threshold. To reduce the overheads of classifying flows, FDALB leverages end-hosts to tag long flows, which requires no changes in networking hardware. To further reduce the overheads of handling flows, we proposed a new centralized algorithm without requiring flow rates information. Using realistic datacenter workloads, we show that FDALB reduces the average FCT of flows by up to 47% over ECMP while achieves higher scalability than the state-of-art load balancing mechanism Mahout.
登录
查看更多内容
影响因子:
--
作者:
CLOS, C
通讯作者:
CLOS, C
DOI:
10.1007/978-981-13-2315-7_6
发表时间:
2018-08
期刊:
Approaches to Entropy
影响因子:
--
作者:
Jeremy R. H. Tame
通讯作者:
Jeremy R. H. Tame
DOI:
--
发表时间:
2013-04
期刊:
--
影响因子:
--
作者:
Minlan Yu;Lavanya Jose;Rui Miao
通讯作者:
Minlan Yu;Lavanya Jose;Rui Miao
DOI:
10.1145/1644893.1644918
发表时间:
2009-11
期刊:
--
影响因子:
--
作者:
Srikanth Kandula;S. Sengupta;A. Greenberg;Parveen Patel;R. Chaiken
通讯作者:
Srikanth Kandula;S. Sengupta;A. Greenberg;Parveen Patel;R. Chaiken
DOI:
10.1109/noms.2014.6838227
发表时间:
2014-05
期刊:
2014 IEEE Network Operations and Management Symposium (NOMS)
影响因子:
--
作者:
S. R. Chowdhury;Md. Faizul Bari;Reaz Ahmed;R. Boutaba
通讯作者:
S. R. Chowdhury;Md. Faizul Bari;Reaz Ahmed;R. Boutaba