CAREER: The Case for Disaggregated Database Systems

数据库系统是许多关键任务应用程序（如金融、电子商务和运输）的基础，因为它们有效地管理大规模数据。几十年来，数据库系统一直是为单片服务器构建的，其中计算、内存和存储是紧密集成的。然而，这些传统数据库现在很难满足弹性、可伸缩性和成本效益的严格要求，特别是在支持云中的大规模应用程序时。最近，出现了一种新兴的硬件资源分解技术趋势，它涉及将硬件资源（如计算、内存和存储）物理地分离到不同的资源池中，以实现独立和弹性的资源扩展。然而，这种分解的体系结构对传统数据库提出了根本性的挑战。该项目将构建一个新的数据库系统，该系统专门针对资源分解进行了优化，以大幅提高性能、可伸缩性和弹性。反过来，这将大大降低数据库客户的成本，并为社会带来可观的经济效益。开发的技术将被开源，以加强研究基础设施。研究结果将通过出版物在一流场所传播，并将纳入普渡大学研究生和本科生的数据库课程。此外，该项目将通过积极参与传统上在该领域代表性不足的群体，如妇女、少数民族和贫困学生，促进多样性和包容性。具体来说，这个项目研究了资源分解（关于存储和内存）对数据库系统的深远影响。通过三个重点提出了一种新的分类数据库系统。第一个要点介绍了有效管理数据库日志和执行事务提交以实现存储分解的新方法。第二个要点提出了优化数据库索引和内存分解缓冲区管理器的新技术。第三个重点是为内存分解开发一个新的分布式数据库架构，并重新设计并发控制和崩溃恢复。总的来说，该项目将通过开始对分解数据（库）系统的新研究，推动数据库系统领域的下一波创新。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Database systems are fundamental to numerous mission-critical applications, such as finance, e-commerce, and transportation, because they efficiently manage large-scale data. For decades, database systems have been built for monolithic servers, where compute, memory, and storage are tightly integrated. However, these traditional databases now struggle to meet the stringent requirements of elasticity, scalability, and cost-effectiveness, especially when supporting large-scale applications in the cloud. Recently, there has been an emerging technology trend towards hardware resource disaggregation, which involves physically separating the hardware resources (such as compute, memory, and storage) into distinct resource pools to enable independent and elastic resource scaling. However, this disaggregated architecture presents fundamental challenges for traditional databases. This project will build a new database system that is specifically optimized for resource disaggregation to substantially improve performance, scalability, and elasticity. This will, in turn, significantly reduce costs for database customers and yield substantial economic benefits for society. The developed techniques will be open-sourced to enhance the research infrastructure. Research findings will be disseminated through publications at top-tier venues and will be incorporated into both graduate-level and undergraduate-level database courses at Purdue University. Furthermore, this project will foster diversity and inclusion by actively engaging groups that are traditionally underrepresented in this field, such as women, minority groups, and underprivileged students.Specifically, this project investigates the profound impact of resource disaggregation (with respect to both storage and memory) on database systems. It presents a new disaggregated database system through three key thrusts. The first thrust introduces new approaches to efficiently manage database logs and perform transaction commits for storage disaggregation. The second thrust proposes new techniques to optimize database indexes and the buffer manager for memory disaggregation. The third thrust develops a new distributed database architecture for memory disaggregation and redesigns concurrency control and crash recovery. Overall, this project will drive the next wave of innovation in the field of database systems by starting a new line of research on disaggregated data(base) systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.