III: Small: Multi-Version Concurrency Control on Modern Hardware
III: Small: Multi-Version Concurrency Control on Modern Hardware
批准号:
1718581
负责人:
Daniel Abadi
金额:
$50.0万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2017
资助国家:
美国
项目状态:
已结题
起止时间:
2017-08-15 至 2022-07-31
中文摘要
数据库系统在更新数据的方式上通常分为两类:要么用新值覆盖旧值,要么存储(并使其可访问)旧版本和新版本的数据。大多数早期的数据库系统都属于第一类(存储数据),因为存储空间昂贵且有限。然而,随着合规性、审计、报告、备份和灾难恢复用例越来越依赖于阅读数据库快照和可能后来更新的数据,数据库系统在近线访问模式中维护记录值的最近版本的能力变得越来越重要。此外,维护记录值的多个版本可能使数据库能够提高其处理事务请求的吞吐量-对同一记录的读取和写入可能并发发生,而不是延迟事务以避免不一致的读取。因此,数据库系统架构的趋势是朝着第二类:保持数据值的多个版本。现有的多版本数据库系统在处理当今存在的合规性、审计、报告、备份和灾难恢复用例方面已经做得很好。但是,在许多情况下,它们无法提供针对快照隔离异常的保护,快照隔离异常会违反数据库中数据的正确性,并可能导致在数据库系统之上编写的应用程序代码中出现错误。现有的少数几个系统避免了这些异常,但这样做会对吞吐量和数据库性能造成很大的损失。此外,大多数现有的多版本数据库系统都是为磁盘存储设计的,并且在主存负载下很难表现良好。我们正在构建一个完全重新设计的多版本数据库系统,专为主存部署而设计。它的架构实现了极高的吞吐量,同时避免了以前系统中存在的影响应用程序开发人员和数据库用户的基本写入偏斜异常。我们正在将数据库可恢复性和事务切割的新技术集成到多版本数据库系统架构中,以提高事务吞吐量至少一个数量级。我们还在研究连续快照复制技术,并从具有有限陈旧性的地理分布副本中提供一致的读取查询。此外,我们正在进行广泛的实验研究,既激励我们的系统的设计,也激励多版本数据库系统在一般与单版本系统的使用。
英文摘要
Database systems generally fall into two categories with respect to how they update data: either they overwrite the old value with the new value, or they store (and make accessible) both the old version and new version of the data. Most early database systems fall in the first category (overwriting data) because storage was expensive and limited. However, as compliance, auditing, reporting, back-up, and disaster recovery use-cases increasingly rely on reading database snapshots and data that may have been later updated, the ability of a database system to maintain recent versions of record values in near-line access modes has become increasingly important. Furthermore, maintaining multiple versions of record values potentially enables the database to improve its throughput of handling transaction requests - reads and writes of the same record can potentially occur concurrently instead of delaying transactions to avoid inconsistent reads. Therefore, the trend in database system architecture is towards the second category: keeping around multiple versions of data values. Existing multi-versioned database systems have done an adequate job in handling the compliance, auditing, reporting, back-up, and disaster recovery use-cases that exist today. However, in many cases they provide no protection against snapshot isolation anomalies that violates the correctness of the data in the database and can result in bugs in application code written on top of the database system. The few existing systems that avoid these anomalies only do so at significant costs to throughput and database performance. Furthermore, most existing multi-versioned database systemsare designed for disk-storage, and struggle to perform well under main-memory workloads.We are building a completely redesigned multi-versioned database system, designed for main-memory deployments. It is architected to achieve extremely high throughput, while avoiding the fundamental write skew anomalies that have existed in previous systems affecting both application developers and database users. We are integrating novel techniques for database recoverability and transaction chopping into the multi-versioned database system architecture in order to improve transaction throughput by at least an order of magnitude. We are also investigating techniques for continuous snapshot replication and serving consistent read queries from geo-distributed replicas with bounded staleness. Furthermore, we are performing extensive experimental studies that both motivate the design of our system, and also motivate the use of multi-versioned database systems in general vs. single-versioned systems.
期刊论文(5)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
DOI:
10.1145/3448016.3452842
发表时间:
2021-06
期刊:
Proceedings of the 2021 International Conference on Management of Data
影响因子:
--
作者:
[Souvik Bhattacherjee;Gang Liao;M. Hicks;D. Abadi]
通讯作者:
Souvik Bhattacherjee;Gang Liao;M. Hicks;D. Abadi
DOI:
10.14778/3352063.3352145
发表时间:
2019-08
期刊:
Proc. VLDB Endow.
影响因子:
--
作者:
[A. Abouzeid;D. Abadi;Kamil Bajda-Pawlikowski;A. Silberschatz]
通讯作者:
A. Abouzeid;D. Abadi;Kamil Bajda-Pawlikowski;A. Silberschatz
DOI:
10.14778/3342263.3342647
发表时间:
2019-07
期刊:
Proc. VLDB Endow.
影响因子:
--
作者:
[Kun Ren;Dennis Li;Daniel J. Abadi]
通讯作者:
Kun Ren;Dennis Li;Daniel J. Abadi
DOI:
--
发表时间:
2018-10
期刊:
影响因子:
--
作者:
[Joshua Lockerman;Jose M. Faleiro;Juno Kim;Soham Sankaran;D. Abadi;J. Aspnes;S. Sen;M. Balakrishnan]
通讯作者:
Joshua Lockerman;Jose M. Faleiro;Juno Kim;Soham Sankaran;D. Abadi;J. Aspnes;S. Sen;M. Balakrishnan
DOI:
10.1145/3181853
发表时间:
2018-08
期刊:
Communications of the ACM
影响因子:
22.7
作者:
[D. Abadi;Jose M. Faleiro]
通讯作者:
D. Abadi;Jose M. Faleiro
III: Small: Peer-to-peer Database (P2PDB): A decentralized, scalable data sharing and management platform
-
批准号:1910613
-
项目类别:Continuing Grant
-
资助金额:$50.0万
-
财政年份:2019
-
负责人:Daniel Abadi
-
依托单位:
III: Small: Scalable, Practical Deterministic Database Systems
-
批准号:1763797
-
项目类别:Standard Grant
-
资助金额:$32.02万
-
财政年份:2017
-
负责人:Daniel Abadi
-
依托单位:
III: Small: Scalable, Practical Deterministic Database Systems
-
批准号:1527118
-
项目类别:Standard Grant
-
资助金额:$50.0万
-
财政年份:2015
-
负责人:Daniel Abadi
-
依托单位:
EAGER: Scaling the Preprocessor and Making it More Intelligent in Deterministic Database Systems
-
批准号:1249722
-
项目类别:Standard Grant
-
资助金额:$20.0万
-
财政年份:2012
-
负责人:Daniel Abadi
-
依托单位:
Collaborative Research: A Comparative Study of Approaches to Cluster-Based Large Scale Data Analysis
-
批准号:0844480
-
项目类别:Standard Grant
-
资助金额:$23.93万
-
财政年份:2009
-
负责人:Daniel Abadi
-
依托单位:
CAREER: Architecting A Database Management System for Semantic Web Data
-
批准号:0845643
-
项目类别:Continuing Grant
-
资助金额:$40.0万
-
财政年份:2009
-
负责人:Daniel Abadi
-
依托单位:
国内基金
海外基金
登录
查看更多内容
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:
-
依托单位:
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
-
批准号:
-
项目类别:省市级项目
-
资助金额:10.0万元
-
批准年份:2022
-
负责人:张祥忠
-
依托单位:
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
-
批准号:32000033
-
项目类别:青年科学基金项目
-
资助金额:24.0万元
-
批准年份:2020
-
负责人:林平
-
依托单位:
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
-
批准号:31972324
-
项目类别:面上项目
-
资助金额:58.0万元
-
批准年份:2019
-
负责人:高学文
-
依托单位:
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
-
批准号:81900988
-
项目类别:青年科学基金项目
-
资助金额:21.0万元
-
批准年份:2019
-
负责人:毛梦莹
-
依托单位:
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
-
批准号:31870821
-
项目类别:面上项目
-
资助金额:56.0万元
-
批准年份:2018
-
负责人:陈江宁
-
依托单位:
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
-
批准号:31802058
-
项目类别:青年科学基金项目
-
资助金额:26.0万元
-
批准年份:2018
-
负责人:麻慧
-
依托单位:
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
-
批准号:31772128
-
项目类别:面上项目
-
资助金额:60.0万元
-
批准年份:2017
-
负责人:吴建国
-
依托单位:
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
-
批准号:81704176
-
项目类别:青年科学基金项目
-
资助金额:20.0万元
-
批准年份:2017
-
负责人:赵继梦
-
依托单位:
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
-
批准号:91640114
-
项目类别:重大研究计划
-
资助金额:85.0万元
-
批准年份:2016
-
负责人:何祖华
-
依托单位: