CRII: CSR: Scaling Geo-Replicated Storage In and Across Many Datacenters

CRII：CSR：在多个数据中心内和跨多个数据中心扩展地理复制存储

• 批准号: 1464438
• 负责人: Wyatt Lloyd
• 金额: $ 17.5万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-03-01 至 2017-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1464438&HistoricalAwards=false
• 关键词: CRII; CSR; Scaling; Geo; Replicated

This project focuses on improving the state of the art in storage for large-scale websites like Amazon, Facebook, and Google that are an integral part of our modern lives. The research is important because it will make the websites more reliable, less expensive to build, and faster for everyone to access. The efforts of this project will guide and focus both industrial efforts and future researchers. This project has the following unique features: optimal speed for reading data from storage and scalability inside and across data centers when compared to the leading research system and the leading industrial system. A working prototype of new storage designs will be produced and released during the course of the work. To accomplish the goals, the project addresses two major deficiencies in the state of the art. First, current systems are likely non-optimal for reading data from storage as they all use multiple rounds of communication. This problem will be addressed by designing, implementing, and evaluating algorithms for reading data that use optimally few rounds of communication. Second, current systems do not scale across data centers, so that building more data centers does not increase the amount of storage or its throughput. This project will use partial replication to store only a subset of the data in each data center so that adding new data centers will result in proportional increases in storage capacity and throughput. An important component is the innovation educational experience in the design phase of the project and systems building experience in the implementation phase for graduate students.Large-scale websites are an important and enriching part of modern life. The algorithms and prototypes developed by this research will make the storage that powers them bigger and faster. These improvements to storage will in turn result in improvements to the websites themselves and perhaps even enable new types of services that were not previously possible.

该项目的重点是改善亚马逊、Facebook和谷歌等大型网站的存储技术，这些网站是我们现代生活中不可或缺的一部分。 这项研究很重要，因为它将使网站更可靠，建设成本更低，每个人都能更快地访问。 该项目的努力将指导和关注工业努力和未来的研究人员。 与领先的研究系统和领先的工业系统相比，该项目具有以下独特功能：从存储中阅读数据的最佳速度以及数据中心内部和跨数据中心的可扩展性。 在工作过程中，将制作和发布新储存设计的工作原型。 为了实现这些目标，该项目解决了现有技术中的两个主要缺陷。首先，当前的系统对于从存储中阅读数据可能不是最佳的，因为它们都使用多轮通信。 这个问题将通过设计、实现和评估阅读数据的算法来解决，这些算法最好使用几轮通信。 其次，当前的系统不能跨数据中心扩展，因此构建更多的数据中心不会增加存储量或吞吐量。 此项目将使用部分复制在每个数据中心中仅存储数据的一个子集，以便添加新的数据中心将导致存储容量和吞吐量的成比例增加。 一个重要的组成部分是项目设计阶段的创新教育经验和研究生实施阶段的系统建设经验。大型网站是现代生活中重要而丰富的一部分。 这项研究开发的算法和原型将使存储更大，更快。 存储的这些改进将反过来导致网站本身的改进，甚至可能实现以前不可能的新类型的服务。