CSR: Medium: Collaborative Research: Soup: Flexible Storage and Processing for On-Line Applications

CSR:媒介:协作研究:汤:在线应用程序的灵活存储和处理

基本信息

  • 批准号:
    1704376
  • 负责人:
  • 金额:
    $ 40万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2018
  • 资助国家:
    美国
  • 起止时间:
    2018-01-15 至 2021-12-31
  • 项目状态:
    已结题

项目摘要

The project aims to build a new kind of storage system for use in busy web sites, combining high performance with ease of programming. The project's key idea is to ask a web site's developers to declare in advance all the ways in which the web site will need to retrieve and process data. This allows the database to prepare all the required outputs in advance, and keep these outputs up to date as new data is inserted into the database. The result is that the web site can read data (and thus generate web pages) efficiently.The project prototype, called Soup, uses a data-flow graph to keep materialized views up to date as database writes arrive; these views hold the results for the web site software's pre-declared queries. However, as the web site software evolves, it will change the set of queries it needs. Soup uses several novel techniques to handle these changes efficiently: re-use of state across successive versions of the data-flow graph, and partial materialization of views and internal data-flow state. Soup supports transactions by combining optimistic concurrency control with data-flow, and allows scale-up of throughput by spreading data and computation over multiple servers.Web sites are an important part of modern life, and an enormous effort is invested in building and maintaining them. This effort could be significantly reduced if storage systems were better matched to the needs of web sites. Soup will provide this better match, by combining the ease of use of relational databases with much-increased speed and efficiency.The project's main results will be a prototype implementation, along with sample applications, documentation, and research papers. The code (Soup and sample applications) will be maintained on GitHub, where anyone can examine and fetch the most recent versions. Documentation will also be maintained on GitHub, and papers will be available on the project web site. We intend to maintain the project repository for at least five years beyond the end of the project. All of these resources will be available from the project web page: https://pdos.csail.mit.edu/soup
该项目旨在构建一种新的存储系统,用于繁忙的网站,结合高性能和易于编程。该项目的关键思想是要求网站的开发人员预先声明网站检索和处理数据所需的所有方式。这允许数据库提前准备所有必需的输出,并在向数据库中插入新数据时使这些输出保持最新。其结果是网站可以高效地读取数据(从而生成网页)。项目原型名为Soup,它使用数据流图在数据库写入到达时保持实体化视图的最新;这些视图保存网站软件预先声明的查询的结果。然而,随着网站软件的发展,它将改变它所需的查询集。SOUP使用几种新技术来高效地处理这些更改:跨数据流图的连续版本重用状态,以及视图和内部数据流状态的部分物化。SOUP通过将乐观并发控制与数据流相结合来支持事务,并允许通过将数据和计算分布在多个服务器上来扩大吞吐量。网站是现代生活的重要组成部分,人们在构建和维护网站方面投入了巨大的努力。如果存储系统更好地匹配网站的需求,这项工作可能会大大减少。通过将关系数据库的易用性与大大提高的速度和效率结合起来,SOUP将提供这种更好的匹配。该项目的主要结果将是一个原型实现,以及示例应用程序、文档和研究论文。代码(Soup和示例应用程序)将在GitHub上维护,任何人都可以在那里检查和获取最新版本。还将在GitHub上维护文件,并在项目网站上提供文件。我们打算在项目结束后至少维持五年的项目库。所有这些资源都可以从项目网页获得:https://pdos.csail.mit.edu/soup

项目成果

期刊论文数量(7)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Privacy Heroes Need Data Disguises
隐私英雄需要数据伪装
Noria: dynamic, partially-stateful data-flow for high-performance web applications
  • DOI:
  • 发表时间:
    2018-10
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Jon Gjengset;Malte Schwarzkopf;J. Behrens;Lara Timbó Araújo;Martin Ek;E. Kohler;M. Kaashoek;R. Morris
  • 通讯作者:
    Jon Gjengset;Malte Schwarzkopf;J. Behrens;Lara Timbó Araújo;Martin Ek;E. Kohler;M. Kaashoek;R. Morris
NORIA: A NEW TAKE ON FAST WEB APPLICATION BACKENDS
NORIA:快速 Web 应用程序后端的新尝试
  • DOI:
  • 发表时间:
    2019
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Gjengset, J Schwarzkopf
  • 通讯作者:
    Gjengset, J Schwarzkopf
Position: GDPR Compliance by Construction
职位:建筑业 GDPR 合规性
  • DOI:
    10.1007/978-3-030-33752-0_3
  • 发表时间:
    2019
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Schwarzkopf, M Kohler
  • 通讯作者:
    Schwarzkopf, M Kohler
Towards Multiverse Databases
迈向多元宇宙数据库
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Edward Kohler其他文献

Edward Kohler的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Edward Kohler', 18)}}的其他基金

QCIS-FF: Quantum Computing & Information Science Faculty Fellow at Harvard University
QCIS-FF:量子计算
  • 批准号:
    2013303
  • 财政年份:
    2020
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
CSR: Medium: Collaborative Research: Fast and Simple Concurrency Through Data-Abstraction Transactions
CSR:媒介:协作研究:通过数据抽象事务实现快速而简单的并发
  • 批准号:
    1513416
  • 财政年份:
    2015
  • 资助金额:
    $ 40万
  • 项目类别:
    Standard Grant
CSR: Medium: Collaborative Research: The Commutativity Rule for Scalable System Software
CSR:媒介:协作研究:可扩展系统软件的交换性规则
  • 批准号:
    1302359
  • 财政年份:
    2013
  • 资助金额:
    $ 40万
  • 项目类别:
    Standard Grant
CAREER: Fine-Grained Operating System Components for Storage
职业:用于存储的细粒度操作系统组件
  • 批准号:
    0546892
  • 财政年份:
    2006
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
(SGER) Preliminary Steps Toward a Verifiable Kernel
(SGER) 实现可验证内核的初步步骤
  • 批准号:
    0541606
  • 财政年份:
    2005
  • 资助金额:
    $ 40万
  • 项目类别:
    Standard Grant
NeTS - NOSS: High-Level and Efficient Sensor Network Programs
NeTS - NOSS:高级且高效的传感器网络程序
  • 批准号:
    0435497
  • 财政年份:
    2004
  • 资助金额:
    $ 40万
  • 项目类别:
    Standard Grant

相似海外基金

Collaborative Research: CSR: Medium: Scaling Secure Serverless Computing on Heterogeneous Datacenters
协作研究:CSR:中:在异构数据中心上扩展安全无服务器计算
  • 批准号:
    2312206
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Architecting GPUs for Practical Homomorphic Encryption-based Computing
协作研究:CSR:中:为实用的同态加密计算构建 GPU
  • 批准号:
    2312276
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Fortuna: Characterizing and Harnessing Performance Variability in Accelerator-rich Clusters
合作研究:CSR:Medium:Fortuna:表征和利用富含加速器的集群中的性能变异性
  • 批准号:
    2312689
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Fortuna: Characterizing and Harnessing Performance Variability in Accelerator-rich Clusters
合作研究:CSR:Medium:Fortuna:表征和利用富含加速器的集群中的性能变异性
  • 批准号:
    2401244
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Scaling Secure Serverless Computing on Heterogeneous Datacenters
协作研究:CSR:中:在异构数据中心上扩展安全无服务器计算
  • 批准号:
    2312207
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Adaptive Environmental Awareness for Collaborative Augmented Reality
协作研究:企业社会责任:媒介:协作增强现实的自适应环境意识
  • 批准号:
    2312760
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Core: Medium: Scaling Unix/Linux Shell Programs
协作研究:CSR:核心:中:扩展 Unix/Linux Shell 程序
  • 批准号:
    2312346
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: MemDrive: Memory-Driven Full-Stack Collaboration for Autonomous Embedded Systems
协作研究:CSR:媒介:MemDrive:自主嵌入式系统的内存驱动全栈协作
  • 批准号:
    2312397
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: MemDrive: Memory-Driven Full-Stack Collaboration for Autonomous Embedded Systems
协作研究:CSR:媒介:MemDrive:自主嵌入式系统的内存驱动全栈协作
  • 批准号:
    2312396
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR: Medium: Adaptive Environmental Awareness for Collaborative Augmented Reality
协作研究:企业社会责任:媒介:协作增强现实的自适应环境意识
  • 批准号:
    2312761
  • 财政年份:
    2023
  • 资助金额:
    $ 40万
  • 项目类别:
    Continuing Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了