BESPOKV: Application Tailored Scale-Out Key-Value Stores

BESPOKV: Application Tailored Scale-Out Key-Value Stores
复制标题

DOI:
10.1109/sc.2018.00005
复制
发表时间:
2018-11
期刊:
SC18: International Conference for High Performance Computing, Networking, Storage and Analysis
影响因子:
--
通讯作者:
Ali Anwar;Yue Cheng;Hai Huang;Jingoo Han;Hyogi Sim;Dongyoon Lee;F. Douglis;A. Butt
Ali Anwar;Yue Cheng;Hai Huang;Jingoo Han;Hyogi Sim;Dongyoon Lee;F. Douglis;A. Butt
中科院分区:
其他
文献类型:
--
作者:
Ali Anwar;Yue Cheng;Hai Huang;Jingoo Han;Hyogi Sim;Dongyoon Lee;F. Douglis;A. Butt

文献摘要

相似文献

企业 KV 存储不太适合 HPC 应用程序,并且需要定制和繁琐的端到端 KV 设计来提取 HPC 应用程序需求。为此,在本文中,我们提出了 BESPOKV,一种自适应、可扩展和横向扩展的 KV 存储框架。 BESPOKV 将 KV 存储设计解耦到用于分布式管理的控制平面和用于本地数据存储的数据平面。 BESPOKV 将单服务器 KV 存储(称为数据集)作为输入,并透明地启用可扩展且容错的分布式 KV 存储服务。由此产生的分布式存储还可以适应一致性或拓扑要求的变化,并且可以轻松扩展以适应新类型的服务。实验表明,支持 BESPOKV 的分布式 KV 存储可以水平扩展到大量节点,并且性能与最先进的系统相当,有时甚至更好。
Enterprise KV stores are not well suited for HPC applications, and entail customization and cumbersome end-to-end KV design to extract the HPC application needs. To this end, in this paper we present BESPOKV, an adaptive, extensible, and scale-out KV store framework. BESPOKV decouples the KV store design into the control plane for distributed management and the data plane for local data store. BESPOKV takes as input a single-server KV store, called a datalet, and transparently enables a scalable and fault-tolerant distributed KV store service. The resulting distributed stores are also adaptive to consistency or topology requirement changes and can be easily extended for new types of services. Experiments show that BESPOKV-enabled distributed KV stores scale horizontally to a large number of nodes, and performs comparably and sometimes better than the state-of-the-art systems.