FlexDriver: a network driver for your accelerator
FlexDriver: a network driver for your accelerator
复制标题
FlexDriver：加速器的网络驱动程序
DOI：
10.1145/3503222.3507776
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
M. Silberstein
中科院分区：
文献类型：
--
作者：
Haggai Eran;Maxim Fudim;Gabi Malka;Gal Shalom;Noam Cohen;Amit Hermony;Dotan Levi;L. Liss;M. Silberstein
我们提出了一种新的系统设计，用于将硬件和FPGA加速器连接到网络，允许加速器直接控制商品网络接口卡（NIC），而不使用CPU。这使我们能够解决利用现有NIC硬件卸载（如虚拟化、隧道和RDMA）进行加速器联网的关键挑战。我们的方法支持各种用例，从分散式加速器的直接网络访问到网络堆栈的内联加速，所有这些都没有加速器中复杂的网络逻辑。为了证明这种方法的可行性，我们构建了FlexDriver（FLD），这是一个实现NIC数据平面驱动程序的加速器硬件模块。我们的主要技术贡献是一种机制，压缩了两个数量级的NIC控制结构，使FLD实现高网络的可扩展性与低芯片面积成本和没有带宽干扰的加速器逻辑。NVIDIA Innova-2 FPGA智能加速器的原型展示了我们的设计在三种不同加速器上的实用性：分解的LTE密码、IP碎片整理内联加速器和物联网密码令牌认证卸载。这些加速器可达到25 Gbps的线路速率，并利用NIC进行RDMA处理、VXLAN隧道和流量整形，而无需CPU参与。
We propose a new system design for connecting hardware and FPGA accelerators to the network, allowing the accelerator to directly control commodity Network Interface Cards (NICs) without using the CPU. This enables us to solve the key challenge of leveraging existing NIC hardware offloads such as virtualization, tunneling, and RDMA for accelerator networking. Our approach supports a diverse set of use cases, from direct network access for disaggregated accelerators to inline-acceleration of the network stack, all without the complex networking logic in the accelerator. To demonstrate the feasibility of this approach, we build FlexDriver (FLD), an on-accelerator hardware module that implements a NIC data-plane driver. Our main technical contribution is a mechanism that compresses the NIC control structures by two orders of magnitude, allowing FLD to achieve high networking scalability with low die area cost and no bandwidth interference with the accelerator logic. The prototype for NVIDIA Innova-2 FPGA SmartNICs showcases our design’s utility for three different accelerators: a disaggregated LTE cipher, an IP-defragmentation inline accelerator, and an IoT cryptographic-token authentication offload. These accelerators reach 25 Gbps line rate and leverage the NIC for RDMA processing, VXLAN tunneling, and traffic shaping without CPU involvement.