Collaborative Research: CNS Core: Small: Scalable ACID Transactions for Persistent Memory Databases

合作研究：CNS 核心：小型：持久内存数据库的可扩展 ACID 事务

• 批准号: 2008884
• 负责人: Simon Peter
• 金额: $ 28.5万
• 依托单位: University of Texas at Austin
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2022-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2008884&HistoricalAwards=false
• 关键词: Collaborative; Research; CNS; Core; Small

This project addresses the inability of current database systems to keep up with the ever growing demands of applications that analyze and extract information from machine-generated data sets, such as Internet-of-Things sensors and machine-learning systems. Intuitively, doubling a system's computing resources should double the load that the system can process per unit of time, but that is not true of today's databases: beyond a fairly modest system size, adding more computing resources does not scale to proportionate gains in performance. The key reason is that databases, to perform correctly, must limit concurrent access to some critical data structures: adding more resources increases competition for access to these data structures, creating a bottleneck for the system's performance. This project introduces a key innovation towards scalable databases. It frees the database from the need, whenever a databases record is modified, to immediately update range indexes---a common form of data organization in databases that tend to become a hotspot when databases try to scale up their computing resources. To remove this bottleneck, this project develops a new scalable interface: per-processor-core queues absorb index updates and merge them in the shared range index data structures periodically, in the background. Eliminating synchronous updates to range indices does not weaken the database guarantees: the standard correctness criterion of serializability is achieved by globally ordering transactional updates using multi-part timestamps derived from a system-wide clock; data durability is achieved by storing per-core queues in non-volatile memory; and a new data structure ensures that reads performed on individual records return their most-recently committed value.Databases are a critical component of modern planet-scale applications. By eliminating scalability bottlenecks and leveraging emerging non volatile memory technology, this project will dramatically reduce the cost to provision databases. In particular, a large fraction of operational cost in multi-billion-dollar data centers is spent on powering a growing number of servers. Improving the scalability of multiple processor cores will increase the density of database deployments, reducing drastically the number of servers required to provision a database: the savings can defer the need for new data centers and storage devices, as more useful work is achieved with existing servers, or reduce energy consumption for existing workloads. The work will also influence the education of the next generation of database engineers. Proposed lecture and project materials will prepare students to identify scalable database designs when responding to future changes in hardware and application workloads.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目解决了当前数据库系统无法跟上应用程序不断增长的需求，这些应用程序分析并从机器生成的数据集中提取信息，例如物联网传感器和机器学习系统。直观地说，将系统的计算资源加倍应该使系统在单位时间内可以处理的负载加倍，但这对于今天的数据库来说并不正确：除了相当适度的系统大小之外，增加更多的计算资源并不能按比例增加性能。 关键的原因是，数据库要正确地执行，必须限制对某些关键数据结构的并发访问：添加更多的资源会增加对这些数据结构的访问的竞争，从而为系统的性能造成瓶颈。 该项目引入了可扩展数据库的关键创新。它使数据库不必在数据库记录被修改时立即更新范围索引-这是数据库中数据组织的一种常见形式，当数据库试图扩展其计算资源时，它往往会成为一个热点。为了消除这个瓶颈，这个项目开发了一个新的可扩展接口：每个处理器核心队列吸收索引更新，并定期将它们合并到共享范围索引数据结构中，在后台。消除对范围索引的同步更新不会削弱数据库保证：通过使用从系统范围时钟导出的多部分时间戳对事务更新进行全局排序来实现可串行化的标准正确性标准;通过将每个核的队列存储在非易失性存储器中来实现数据持久性;新的数据结构确保对单个记录执行的读取返回其最近提交的值。数据库是现代行星级应用程序的关键组件。通过消除可伸缩性瓶颈和利用新兴的非易失性内存技术，该项目将大大降低配置数据库的成本。特别是，数十亿美元的数据中心的运营成本的很大一部分用于为越来越多的服务器提供动力。提高多处理器内核的可扩展性将提高数据库部署的密度，大幅减少配置数据库所需的服务器数量：节省可以推迟对新数据中心和存储设备的需求，因为使用现有服务器可以实现更有用的工作，或者减少现有工作负载的能耗。这项工作也将影响下一代数据库工程师的教育。建议的讲座和项目材料将帮助学生在应对硬件和应用程序工作负载的未来变化时识别可扩展的数据库设计。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

HeMem: Scalable Tiered Memory Management for Big Data Applications and Real NVM

• DOI: 10.1145/3477132.3483550
• 发表时间: 2021-10
• 期刊: Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles
• 作者: Amanda Raybuck;Tim Stamler;Wei Zhang;M. Erez;Simon Peter