Dagger: Towards Efficient RPCs in Cloud Microservices With Near-Memory Reconfigurable NICs
Dagger: Towards Efficient RPCs in Cloud Microservices With Near-Memory Reconfigurable NICs
复制标题
DOI：
10.1109/lca.2020.3020064
复制
发表时间：
2020-07-01
影响因子：
2.3
通讯作者：
Delimitrou, Christina
中科院分区：
文献类型：
--
作者：
Lazarev, Nikita;Adit, Neil;Delimitrou, Christina
云应用程序越来越依赖于数百个松散耦合的微服务来完成满足应用程序端到端QoS要求的用户请求。服务之间的通信时间占端到端延迟的很大一部分，并且可以引入性能不可预测性和QoS违规。这封信介绍了我们在Dagger上的早期工作，Dagger是一个用于网络的硬件加速平台，专为微服务的独特品质而设计。Dagger架构依赖于基于FPGA的NIC，通过可配置的内存互连与处理器紧密耦合，旨在卸载和加速RPC堆栈。与使用PCIe链路作为NIC I/O接口的传统云系统不同，我们利用内存互连的FPGA作为网络设备，以提供细粒度微服务所需的效率，透明度和可编程性。我们表明，这大大提高了云RPC的CPU利用率和性能。
Cloud applications are increasingly relying on hundreds of loosely-coupled microservices to complete user requests that meet an application's end-to-end QoS requirements. Communication time between services accounts for a large fraction of the end-to-end latency and can introduce performance unpredictability and QoS violations. This letter presents our early work on Dagger, a hardware acceleration platform for networking, designed specifically with the unique qualities of microservices in mind. The Dagger architecture relies on an FPGA-based NIC, closely coupled with the processor over a configurable memory interconnect, designed to offload and accelerate RPC stacks. Unlike the traditional cloud systems that use PCIe links as the NIC I/O interface, we leverage memory-interconnected FPGAs as networking devices to provide the efficiency, transparency, and programmability needed for fine-grained microservices. We show that this considerably improves CPU utilization and performance for cloud RPCs.