Offloading load balancers onto SmartNICs
Offloading load balancers onto SmartNICs
复制标题
将负载均衡器卸载到 SmartNIC 上
DOI：
10.1145/3476886.3477505
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Krishnamurthy, Arvind
中科院分区：
文献类型：
--
作者：
Cui, Tianyi;Zhang, Wei;Zhang, Kaiyuan;Krishnamurthy, Arvind
负载平衡器在当今的云中广泛使用，用于大规模地跨数据中心服务器分发网络请求。虽然负载均衡器最初是使用专用和自定义硬件构建的，但大多数云提供商现在使用基于软件的负载均衡器。这使得实现更加灵活，并且还支持在通用服务器上按需提供负载平衡工作负载，但这增加了配置和操作成本。我们探索将负载均衡卸载到可编程的smartnic上。为了充分利用智能网卡的成本和能源效率，我们的设计提出了三个关键思想。首先，我们认为即使对于L7负载均衡器，也不需要完整且复杂的TCP/IP堆栈，而是提出了在SmartNIC上使用轻量级转发代理的设计。其次，我们开发了连接管理数据结构，当在多核smartnic上执行时，以最小的同步提供高度的并发性。最后，我们描述了如何在smartnic上使用自定义加速器加速负载平衡逻辑。我们的概念验证实现和初步结果表明，SmartNIC是导航潜在性能成本权衡的有前途的选择。
Load balancers are pervasively used inside today's clouds to distribute network requests across data center servers at scale. While load balancers were initially built using dedicated and custom hardware, most cloud providers now use software-based load balancers. This allows the implementations to be more agile and also enables on-demand provisioning of load balancing workload on generic servers, but it comes with increased provisioning and operating costs.We explore offloading load balancing onto programmable SmartNICs. To fully leverage the cost and energy efficiency of SmartNICs, our design proposes three key ideas. First, we argue that a full and complex TCP/IP stack is not required even for L7 load balancers and instead propose a design that uses a lightweight forwarding agent on the SmartNIC. Second, we develop connection management data structures that provide a high degree of concurrency with minimal synchronization when executed on multi-core SmartNICs. Finally, we describe how the load balancing logic could be accelerated using custom accelerators on SmartNICs. Our proof-of-concept implementations and preliminary results show that SmartNIC is a promising choice for navigating the underlying performance-cost tradeoffs.
SmartNIC 加速的私人通信案例
DOI：
--
发表时间：
2020
期刊：
Asia-Pacific Workshop on Networking
影响因子：
--
作者：
Duckwoo Kim;Seungeon Lee;KyoungSoo Park
通讯作者：
KyoungSoo Park