SPX: Collaborative Research: Distributed Database Management with Logical Leases and Hardware Transactional Memory

SPX：协作研究：具有逻辑租赁和硬件事务内存的分布式数据库管理

• 批准号: 1822920
• 负责人: Srini Devadas
• 金额: $ 45万
• 依托单位: Massachusetts Institute of Technology
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2021-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1822920&HistoricalAwards=false
• 关键词: SPX; Collaborative; Research; Distributed; Database

Database systems are the foundation of critical applications that maintain large amounts of data. Since single-processor performance plateaued a decade ago, increasing the number of processors or servers has become the only viable way of improving performance in distributed database management systems. Scalability is a daunting challenge in these systems due to the complex coordination among the large number of parallel tasks---a problem that this project seeks to solve. Most existing database systems determine the order among parallel tasks using conventional physical time. These systems require managing distributed locks, which leads to blocking and computation overhead. Other systems use logical time, which can be thought of as position in an order, to eliminate locking, but require centralized generation of the ordering, which is a serious scalability bottleneck as core count increases. This project breaks the abstraction of physical time and replaces it with a new definition of time that incorporates both logical and physical aspects. "Physiological" time, termed physiological time for ease of pronunciation, uses logical timestamps to order events and then breaks ties using physical time. This enables novel dependency-avoiding approaches to improving system performance and scalability. This project applies physiological time to three components in a distributed database system. (1) At hardware level, a new hardware transaction memory (HTM) mechanism will be built, which allows more effective data movement in multi-core processors' caches. (2) A new distributed concurrency control protocol will be designed and implemented to coordinate large numbers of parallel tasks in a distributed database. (3) An efficient parallel indexing data structure will be proposed for both multi-core and distributed databases. All three parts of the project will be prototyped and deployed in hardware/software testbeds.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

数据库系统是维护大量数据的关键应用程序的基础。自从十年前单处理器性能停滞不前以来，增加处理器或服务器的数量已成为提高分布式数据库管理系统性能的唯一可行方法。由于大量并行任务之间的复杂协调，可伸缩性在这些系统中是一个艰巨的挑战-这是本项目试图解决的问题。大多数现有的数据库系统使用传统的物理时间来确定并行任务之间的顺序。这些系统需要管理分布式锁，这会导致阻塞和计算开销。其他系统使用逻辑时间(可以被认为是顺序中的位置)来消除锁定，但需要集中生成顺序，随着核心计数的增加，这是一个严重的可伸缩性瓶颈。这个项目打破了物理时间的抽象，取而代之的是一个结合了逻辑和物理两个方面的时间的新定义。“生理学”时间，为了便于发音，被称为生理学时间，它使用逻辑时间戳来对事件进行排序，然后使用物理时间来打破平局。这使得能够采用新的避免依赖的方法来提高系统性能和可扩展性。该项目将生理时间应用于分布式数据库系统中的三个组件。(1)在硬件层面，将建立一种新的硬件事务存储器(HTM)机制，允许在多核处理器的缓存中更有效地移动数据。(2)设计并实现了一种新的分布式并发控制协议，用于协调分布式数据库中的大量并行任务。(3)提出了一种适用于多核数据库和分布式数据库的高效并行索引数据结构。该项目的所有三个部分都将是原型，并将部署在硬件/软件测试平台中。该奖项反映了NSF的法定使命，并已通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。