III: Small: Scalable, Practical Deterministic Database Systems

III：小型：可扩展、实用的确定性数据库系统

• 批准号: 1763797
• 负责人: Daniel Abadi
• 金额: $ 32.02万
• 依托单位: University of Maryland, College Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-07-01 至 2019-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1763797&HistoricalAwards=false
• 关键词: III; Small; Scalable; Practical; Deterministic

The database system was one of the first highly concurrent systems ever designed, and has served as a blueprint for the design of many subsequent concurrent computing systems. The decision to allow the system to process concurrent transactions nondeterministically has led to countless headaches from bugs (and debugging), security, replication, and general code complexity. The research funded by this grant will investigate the development of a fundamentally different design for concurrent execution of transactions in database systems that guarantees that the final state of the database is deterministically prescribed from the input to the system. Such databases have the potential to significantly improve the throughput, latency, fault tolerance, and general robustness of database systems. In addition to performing fundamental research on deterministic database systems, we plan to develop open source code for the different components of the system including transaction management, concurrency control, and log management. We expect this code will be useful both for development of other database systems, and also as pedagogical tools for database systems courses. We plan heavy undergraduate involvement in the research, including contributions from women and underrepresented minorities.Key research areas within the project include automatic read/write-set detection (a key requirement to making deterministic database systems practical and widely adopted), leveraging the active replication enabled by determinism to accelerate distributed read-only queries, building a deterministic system out of nondeterministic components, and worker thread scheduling within the database system. These research topics will enable a high-throughput ACID-compliant database system that can scale commit protocols for distributed transactions, the support of performant transactions and queries within the same system, and the ability to handle wild fluctuations in server performance (especially virtual servers in the cloud) and fluctuations in offered workload (including unexpected load spikes). For further information see the project web site at: http://db.cs.yale.edu/calvin.

数据库系统是有史以来设计的第一个高度并发的系统之一，并已成为许多后续并发计算系统的设计蓝图。允许系统非确定性地处理并发事务的决定导致了无数令人头痛的问题，包括错误（和调试）、安全性、复制和一般代码复杂性。由该基金资助的研究将调查开发一种根本不同的设计，用于数据库系统中事务的并发执行，以保证数据库的最终状态从系统的输入确定性地规定。这样的数据库有可能显着提高数据库系统的吞吐量，延迟，容错和一般的鲁棒性。除了对确定性数据库系统进行基础研究外，我们还计划为系统的不同组件开发开源代码，包括事务管理，并发控制和日志管理。我们希望这段代码对其他数据库系统的开发以及数据库系统课程的教学工具都是有用的。我们计划让大量的本科生参与这项研究，包括女性和代表性不足的少数民族的贡献。（使确定性数据库系统实用并被广泛采用的关键要求），利用由确定性启用的主动复制来加速分布式只读查询，从非确定性组件中构建确定性系统，以及数据库系统内的工作线程调度。这些研究主题将实现一个高吞吐量的ACID兼容的数据库系统，该系统可以扩展分布式事务的提交协议，支持同一系统内的高性能事务和查询，以及处理服务器性能（特别是云中的虚拟服务器）的剧烈波动和提供的工作负载（包括意外的负载峰值）的波动的能力。欲了解更多信息，请访问项目网站：http://db.cs.yale.edu/calvin。

项目成果

Latch-free Synchronization in Database Systems: Silver Bullet or Fool's Gold?

• 发表时间: 2017
• 作者: Jose M. Faleiro;D. Abadi

An overview of deterministic database systems

• DOI: 10.1145/3181853
• 发表时间: 2018-08
• 期刊: Communications of the ACM
• 影响因子: 22.7
• 作者: D. Abadi;Jose M. Faleiro

Low-Overhead Asynchronous Checkpointing in Main-Memory Database Systems

• DOI: 10.1145/2882903.2915966
• 发表时间: 2016-06
• 期刊: Proceedings of the 2016 International Conference on Management of Data
• 作者: Kun Ren;Thaddeus Diamond;D. Abadi;Alexander Thomson

Design Principles for Scaling Multi-core OLTP Under High Contention

• DOI: 10.1145/2882903.2882958
• 发表时间: 2015-12
• 期刊: Proceedings of the 2016 International Conference on Management of Data
• 作者: Kun Ren;Jose M. Faleiro;D. Abadi

SLOG: Serializable, Low-latency, Geo-replicated Transactions

• DOI: 10.14778/3342263.3342647
• 发表时间: 2019-07
• 期刊: Proc. VLDB Endow.
• 作者: Kun Ren;Dennis Li;Daniel J. Abadi