CSR: Medium: Building next-generation cloud infrastructure using RDMA

随着计算和数据转移到“云”上，需要通过改进硬件和通信基础设施来显著提高底层数据中心的容量和性能。通信基础设施的一个关键组成部分是网络实施，目前基于以太网。技术趋势表明，下一代数据中心网络将基于RDMA(Remote Direct Memory Access，远程直接内存访问)，这是当今高性能计算机系统中使用的一种强大的通信技术。虽然RDMA提供了巨大的性能潜力，但当前的云基础架构并未设计为利用这一潜力。该项目将研究基于RDMA的分布式存储系统和内存应用程序的系统设计。具体来说，项目研究议程包括(A)构建高性能的分布式键值存储和基于B树的存储(B)开发图像搜索和深度学习中的几个应用程序，这些应用程序通过RDMA的超低延迟和高吞吐量使其分发成为可能；(C)在NSF资助的探测器试验台上评估所产生的系统和应用程序的规模性能。

As computation and data are moved to the "cloud", there is a need to significantly increase the capacity and performance of the underlying data centers through improved hardware and communication infrastructure. A key component of the communication infrastructure is the network implementation, currently based upon Ethernet. Technological trends suggest that next-generation data center networks will be based upon RDMA (Remote Direct Memory Access), a powerful communciation technology used today in high performance computer systems. While RDMA offers enormous performance potential, current cloud infrastructures are not designed to exploit this potential. This project will investigate RDMA-based system designs for distributed storage systems and in-memory applications.Specifically, the project research agenda consists of (a) building a high performance distributed key-value store and a B-tree based store (b) developing several applications in image search and deep learning whose distribution is made feasible by RDMA's ultra-low-latency and high throughput; (c) evaluating the performance of the resulting systems and applications at scale on the NSF-funded PRObE testbed.