LEGOStore: A Linearizable Geo-Distributed Store Combining Replication and Erasure Coding
LEGOStore: A Linearizable Geo-Distributed Store Combining Replication and Erasure Coding
复制标题
DOI：
10.14778/3547305.3547323
复制
发表时间：
2021-11
期刊：
影响因子：
--
通讯作者：
Hamid Zare;V. Cadambe;B. Urgaonkar;Chetan Sharma;Praneet Soni;Nader Alfares;A. Merchant
中科院分区：
文献类型：
--
作者：
Hamid Zare;V. Cadambe;B. Urgaonkar;Chetan Sharma;Praneet Soni;Nader Alfares;A. Merchant
我们设计并实现了 LEGOStore，这是一种基于地理分布式公共云数据中心 (DC) 的基于纠删码 (EC) 的线性化数据存储。对于这样的数据存储，以下因素的结合为 EC 提供了与复制进行延迟竞争的机会：(a) 与远程 DC 通信以容忍整个 DC 故障并实现线性化的必要性； (b) 大多数大型人口中心附近出现了 DC。 LEGOStore 采用优化框架，对于给定的对象，在复制和 EC 以及各种 DC 放置之间仔细选择，以最大限度地降低总体成本。为了应对工作负载的动态变化，LEGOStore 采用了一种新颖的敏捷重新配置协议。我们使用跨越 9 个 Google Cloud Platform DC 的 LEGOStore 原型进行的评估证明了我们想法的有效性。我们观察到，在满足尾部延迟 SLO 的同时，与代表最先进水平的基线相比，成本节省范围从中等 (5-20%) 到显着 (60%)。我们的重新配置协议能够在 3 到 4 个 DC 间 RTT 中转换关键位置（在我们的实验中小于 1 秒），从而能够灵活地适应动态条件。
We design and implement LEGOStore, an erasure coding (EC) based linearizable data store over geo-distributed public cloud data centers (DCs). For such a data store, the confluence of the following factors opens up opportunities for EC to be latency-competitive with replication: (a) the necessity of communicating with remote DCs to tolerate entire DC failures and implement linearizability; and (b) the emergence of DCs near most large population centers. LEGOStore employs an optimization framework that, for a given object, carefully chooses among replication and EC, as well as among various DC placements to minimize overall costs. To handle workload dynamism, LEGOStore employs a novel agile reconfiguration protocol. Our evaluation using a LEGOStore prototype spanning 9 Google Cloud Platform DCs demonstrates the efficacy of our ideas. We observe cost savings ranging from moderate (5-20%) to significant (60%) over baselines representing the state of the art while meeting tail latency SLOs. Our reconfiguration protocol is able to transition key placements in 3 to 4 inter-DC RTTs (< 1s in our experiments), allowing for agile adaptation to dynamic conditions.