CAREER: Distributed Protocols and Primitives Optimized for RDMA Read/Write Operations in Data Management Systems

因特网的扩散使每天向数百万用户提供广泛使用的服务成为可能。在设计支持这些服务的系统软件时，最大的挑战之一是设计软件基础设施的组件，使其可扩展以处理超大的工作负载。远程直接内存访问（RDMA）是提高可扩展性的一项重要技术。RDMA允许服务器在不中断其执行的情况下访问远程服务器内存，从而实现更有效的通信和服务大量用户请求的能力。这个项目研究同步。同步是可伸缩性的一个障碍，因为它需要大量的额外计算，以便在多个实体之间进行协调，但它是确保数据完整性的必要条件。特别是，同步通常需要远程机器响应数据访问请求的双边通信。本提案研究单边rdma优化的高性能同步技术，并将演示如何在易于使用的抽象中实现它们以开发基础架构系统软件。该项目的成果是允许专业和非专业程序员构建可以利用RDMA处理数百万用户请求而不牺牲性能的服务的技术。通过利用作为该项目的结果交付的基础设施软件，开发人员可以将他们的大部分工作集中在服务的核心业务逻辑上。该项目的原则和发现有助于实现双重目标。首先，它们形成了一个坚实的基础，可以指导未来几代渴望为整个社会提供服务的开发人员。其次，它们抽象出具有挑战性的细节，允许程序员利用项目的解决方案，而不管他们在RDMA和同步领域的技术深度如何。这不仅简化了大型高性能服务的实现，而且使那些有资源来解决复杂问题的人与那些没有资源的人之间的竞争环境更加公平。这些研究成果将通过广泛的教育计划正式纳入研究生和本科课程以及K-12活动的教材和工具中，旨在鼓励学生通过研究生学习的途径学习计算机科学，并扩大参与和增加计算机科学的多样性，特别是对女性而言。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The proliferation of the Internet enables the delivery of widely used services to millions of users every day. One of the biggest challenges in designing the system software that supports these services is engineering the components of the software infrastructure to scale to handle extremely large workloads. Remote Direct Memory Access (RDMA) is an important technology to improve achievable scalability. RDMA allows servers to access remote server memory without interrupting their execution resulting on more efficient communication and the ability to serve massive numbers of user requests. This project studies synchronization. Synchronization is a barrier to scalability as it entails significant additional computation in order to coordinate among multiple entities but is mandatory to ensure data integrity. In particular, synchronization typically requires two-sided communication where the remote machine responds to data access requests. This proposal investigates one-sided RDMA-optimized high-performance synchronization techniques and will demonstrate how they can be realized in easy-to-use abstractions to develop infrastructural system software.The outcomes of this project are techniques that allow both specialized and non-expert programmers to build services that can exploit RDMA to handle millions of user requests without sacrificing performance. By leveraging the infrastructural software delivered as a result of this project, developers can focus most of their work on the core business logic of the service. The principles and findings of the project contribute to a twofold goal. First, they form a solid foundation to instruct future generations of developers who yearn for delivering services that target society at large. Second, they abstract away the challenging details, allowing programmers to leverage the project's solutions regardless of their technical depth in the realm of RDMA and synchronization. This not only simplifies the implementation of large high-performance services, but also evens the playing field between those who have the resources to tackle complex problems, and those who do not. These research outcomes will be formalized in teaching material and tools for graduate and undergraduate courses and K-12 activities through a broad education plan designed to encourage students towards computer science study with a path towards graduate study and to broaden participation and increase diversity in computer science, especially for women.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.