Caribou: Intelligent Distributed Storage
Caribou: Intelligent Distributed Storage
复制标题
Caribou：智能分布式存储
DOI：
--
复制
发表时间：
2017
影响因子：
2.5
通讯作者：
G. Alonso
中科院分区：
文献类型：
--
作者：
Z. István;David Sidler;G. Alonso
数据中心处理的数据量不断增加，导致了固有的低效率：在带宽、延迟和功耗方面，移动数据是昂贵的，特别是考虑到许多数据库操作的计算复杂性较低。
在本文中，我们将探讨数据库引擎中的近数据处理，即，将部分计算直接卸载到存储节点的选项。我们在Caribou中实现了我们的想法，Caribou是一个智能分布式存储层，它结合了在使用专用硬件构建系统时学到的许多经验教训。Caribou通过一个简单的键值存储接口通过网络提供对DRAM/NVRAM存储的访问，每个存储节点通过复制以线速提供高带宽近数据处理和容错。其结果是一个高效的、分布式的、智能的数据存储，由于采用了微服务器架构，该数据存储可用于提高性能、降低功耗和数据中心的真实的资产使用。
The ever increasing amount of data being handled in data centers causes an intrinsic inefficiency: moving data around is expensive in terms of bandwidth, latency, and power consumption, especially given the low computational complexity of many database operations.
In this paper we explore near-data processing in database engines, i.e., the option of offloading part of the computation directly to the storage nodes. We implement our ideas in Caribou, an intelligent distributed storage layer incorporating many of the lessons learned while building systems with specialized hardware. Caribou provides access to DRAM/NVRAM storage over the network through a simple key-value store interface, with each storage node providing high-bandwidth near-data processing at line rate and fault tolerance through replication. The result is a highly efficient, distributed, intelligent data storage that can be used to both boost performance and reduce power consumption and real estate usage in the data center thanks to the micro-server architecture adopted.