CSR: Medium: Collaborative Research: Soup: Flexible Storage and Processing for On-Line Applications

CSR：媒介：协作研究：汤：在线应用程序的灵活存储和处理

• 批准号: 1704172
• 负责人: Robert Morris
• 金额: $ 80万
• 依托单位: Massachusetts Institute of Technology
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-01-15 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1704172&HistoricalAwards=false
• 关键词: CSR; Medium; Collaborative; Research; Soup

The project aims to build a new kind of storage system for use in busy web sites, combining high performance with ease of programming. The project's key idea is to ask a web site's developers to declare in advance all the ways in which the web site will need to retrieve and process data. This allows the database to prepare all the required outputs in advance, and keep these outputs up to date as new data is inserted into the database. The result is that the web site can read data (and thus generate web pages) efficiently.The project prototype, called Soup, uses a data-flow graph to keep materialized views up to date as database writes arrive; these views hold the results for the web site software's pre-declared queries. However, as the web site software evolves, it will change the set of queries it needs. Soup uses several novel techniques to handle these changes efficiently: re-use of state across successive versions of the data-flow graph, and partial materialization of views and internal data-flow state. Soup supports transactions by combining optimistic concurrency control with data-flow, and allows scale-up of throughput by spreading data and computation over multiple servers.Web sites are an important part of modern life, and an enormous effort is invested in building and maintaining them. This effort could be significantly reduced if storage systems were better matched to the needs of web sites. Soup will provide this better match, by combining the ease of use of relational databases with much-increased speed and efficiency.The project's main results will be a prototype implementation, along with sample applications, documentation, and research papers. The code (Soup and sample applications) will be maintained on GitHub, where anyone can examine and fetch the most recent versions. Documentation will also be maintained on GitHub, and papers will be available on the project web site. We intend to maintain the project repository for at least five years beyond the end of the project. All of these resources will be available from the project web page: https://pdos.csail.mit.edu/soup

该项目旨在构建一种新的存储系统，用于忙碌的网站，结合高性能和易于编程。该项目的核心思想是要求网站的开发人员提前声明网站需要检索和处理数据的所有方式。这允许数据库提前准备所有需要的输出，并在新数据插入数据库时保持这些输出为最新。结果是网站可以有效地读取数据（从而生成网页）。这个项目原型叫做Soup，它使用数据流图来保持物化视图在数据库写入到达时保持最新;这些视图保存网站软件预先声明的查询的结果。然而，随着网站软件的发展，它将改变所需的查询集。Soup使用了几种新颖的技术来有效地处理这些变化：跨数据流图的连续版本重用状态，以及视图和内部数据流状态的部分物化。Soup通过将乐观并发控制与数据流相结合来支持事务，并通过将数据和计算分布在多个服务器上来允许吞吐量的扩展。Web站点是现代生活的重要组成部分，并且在构建和维护它们方面投入了巨大的精力。如果存储系统能够更好地满足网站的需要，这项工作就可以大大减少。Soup将提供更好的匹配，通过结合关系数据库的易用性和更高的速度和效率，该项目的主要成果将是一个原型实现，沿着示例应用程序，文档和研究论文。代码（Soup和示例应用程序）将在GitHub上维护，任何人都可以检查和获取最新版本。文档也将在GitHub上维护，论文将在项目网站上提供。我们打算在项目结束后将项目存储库至少保留五年。所有这些资源都可以从项目网页上获得：https://pdos.csail.mit.edu/soup

项目成果

Privacy Heroes Need Data Disguises

隐私英雄需要数据伪装

• DOI: 10.1145/3458336.3465284
• 发表时间: 2021
• 期刊: Proceedings of the 18th ACM SIGOPS Workshop on Hot Topics in Operating Systems
• 作者: Tsai, Lillian;Schwarzkopf, Malte;Kohler, Eddie
• 通讯作者: Kohler, Eddie

Position: GDPR Compliance by Construction

职位：建筑业 GDPR 合规性

• DOI: 10.1007/978-3-030-33752-0_3
• 发表时间: 2019
• 期刊: vol 11721.
• 作者: Schwarzkopf, M Kohler

Towards Multiverse Databases

迈向多元宇宙数据库

• DOI: 10.1145/3317550.3321425
• 发表时间: 2019
• 期刊: HotOS '19: Proceedings of the Workshop on Hot Topics in Operating Systems
• 作者: Marzoev, Alana;Araújo, Lara Timbó;Schwarzkopf, Malte;Yagati, Samyukta;Kohler, Eddie;Morris, Robert;Kaashoek, M. Frans;Madden, Sam
• 通讯作者: Madden, Sam

Noria: dynamic, partially-stateful data-flow for high-performance web applications

• 发表时间: 2018-10
• 作者: Jon Gjengset;Malte Schwarzkopf;J. Behrens;Lara Timbó Araújo;Martin Ek;E. Kohler;M. Kaashoek;R. Morris

NORIA: A NEW TAKE ON FAST WEB APPLICATION BACKENDS

NORIA：快速 Web 应用程序后端的新尝试

• 发表时间: 2019
• 期刊: ;login:
• 作者: Gjengset, J Schwarzkopf