Bigtable: A distributed storage system for structured data

Bigtable: A distributed storage system for structured data
复制标题

DOI:
10.1145/1365815.1365816
复制
发表时间:
2008-06-01
影响因子:
1.5
通讯作者:
Gruber, Robert E.
Gruber, Robert E.
中科院分区:
计算机科学2区
文献类型:
--
作者:
Chang, Fay;Dean, Jeffrey;Gruber, Robert E.

文献摘要

被引文献

相似文献

BigTable是一种用于管理结构化数据的分布式存储系统,旨在扩展到非常大的规模:跨越数千台商用服务器的PB级数据。Google的许多项目都将数据存储在Bigtable中,包括Web索引、Google Earth和Google Finance。这些应用程序对BigTable提出了非常不同的要求,无论是在数据大小(从URL到网页再到卫星图像)还是在延迟要求(从后端批量处理到实时数据服务)方面。尽管有这些不同的需求,Bigtable已经成功地为所有这些Google产品提供了一个灵活的、高性能的解决方案。在本文中,我们描述了Bigtable提供的简单数据模型,它使客户可以动态地控制数据布局和格式,并描述了BigTable的设计和实现。
Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Finance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a flexible, high-performance solution for all of these Google products. In this article, we describe the simple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we describe the design and implementation of Bigtable.