CAREER: The Case for Disaggregated Database Systems

数据库系统是许多关键任务应用程序的基础，例如金融，电子商务和运输，因为它们可以有效地管理大规模数据。几十年来，数据库系统一直是为单片服务器构建的，其中计算，内存和存储紧密集成。然而，这些传统数据库现在难以满足弹性、可扩展性和成本效益的严格要求，特别是在支持云中的大规模应用程序时。最近，已经出现了朝向硬件资源分解的新兴技术趋势，其涉及将硬件资源（诸如计算、存储器和存储）物理地分离成不同的资源池以实现独立且弹性的资源缩放。然而，这种分类架构对传统数据库提出了根本性的挑战。该项目将构建一个新的数据库系统，专门针对资源分解进行优化，以大幅提高性能，可伸缩性和弹性。这反过来将大大降低数据库客户的成本，并为社会带来巨大的经济效益。所开发的技术将是开源的，以加强研究基础设施。研究结果将通过顶级场所的出版物传播，并将纳入普渡大学的研究生和本科生数据库课程。此外，本项目还将通过积极吸引女性、少数民族、贫困学生等在该领域传统上代表性不足的群体参与，促进多样性和包容性。具体而言，本项目将调查资源分解（存储和内存）对数据库系统的深刻影响。它通过三个主要方面提出了一个新的分类数据库系统。第一个推力引入了新的方法来有效地管理数据库日志和执行存储分解的事务提交。第二个重点提出了优化数据库索引和缓冲区管理器的新技术。第三个推力开发了一个新的分布式数据库体系结构的内存分解和重新设计并发控制和崩溃恢复。总的来说，该项目将通过启动分类数据（基础）系统的新研究路线，推动数据库系统领域的下一波创新。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Database systems are fundamental to numerous mission-critical applications, such as finance, e-commerce, and transportation, because they efficiently manage large-scale data. For decades, database systems have been built for monolithic servers, where compute, memory, and storage are tightly integrated. However, these traditional databases now struggle to meet the stringent requirements of elasticity, scalability, and cost-effectiveness, especially when supporting large-scale applications in the cloud. Recently, there has been an emerging technology trend towards hardware resource disaggregation, which involves physically separating the hardware resources (such as compute, memory, and storage) into distinct resource pools to enable independent and elastic resource scaling. However, this disaggregated architecture presents fundamental challenges for traditional databases. This project will build a new database system that is specifically optimized for resource disaggregation to substantially improve performance, scalability, and elasticity. This will, in turn, significantly reduce costs for database customers and yield substantial economic benefits for society. The developed techniques will be open-sourced to enhance the research infrastructure. Research findings will be disseminated through publications at top-tier venues and will be incorporated into both graduate-level and undergraduate-level database courses at Purdue University. Furthermore, this project will foster diversity and inclusion by actively engaging groups that are traditionally underrepresented in this field, such as women, minority groups, and underprivileged students.Specifically, this project investigates the profound impact of resource disaggregation (with respect to both storage and memory) on database systems. It presents a new disaggregated database system through three key thrusts. The first thrust introduces new approaches to efficiently manage database logs and perform transaction commits for storage disaggregation. The second thrust proposes new techniques to optimize database indexes and the buffer manager for memory disaggregation. The third thrust develops a new distributed database architecture for memory disaggregation and redesigns concurrency control and crash recovery. Overall, this project will drive the next wave of innovation in the field of database systems by starting a new line of research on disaggregated data(base) systems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.