E3: Energy-Efficient Microservices on SmartNIC-Accelerated Servers
E3: Energy-Efficient Microservices on SmartNIC-Accelerated Servers
复制标题
DOI：
--
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
Ming Liu;Simon Peter;A. Krishnamurthy;P. Phothilimthana
中科院分区：
文献类型：
--
作者：
Ming Liu;Simon Peter;A. Krishnamurthy;P. Phothilimthana
我们研究使用SmartNIC加速服务器在数据中心执行基于微服务的应用程序。通过将合适的微服务卸载到SmartNIC的低功耗处理器，我们可以在不损失延迟的情况下提高服务器能效。然而，作为主机数据路径中的异构计算基底，SmartNIC给微服务平台带来了几个挑战：网络流量路由和负载平衡，异构硬件上的微服务放置，以及共享SmartNIC资源的争用。我们介绍了E3，一个用于SmartNIC加速服务器的微服务执行平台。E3遵循Azure Service Fabric微服务平台的设计理念，并将关键系统组件扩展到SmartNIC，以解决上述挑战。E3采用了三项关键技术：通过SmartNIC到主机的基于ECMP的负载平衡，网络拓扑感知的微服务放置，以及可以检测SmartNIC过载的数据平面编排器。我们使用Cavium LiquidIO SmartNIC的E3原型表明，SmartNIC卸载可以将集群能效提高3倍，成本效率提高1.9倍，延迟成本高达4%，适用于常见的微服务，包括实时分析，物联网中心和虚拟网络功能。
We investigate the use of SmartNIC-accelerated servers to execute microservice-based applications in the data center. By offloading suitable microservices to the SmartNIC’s lowpower processor, we can improve server energy-efficiency without latency loss. However, as a heterogeneous computing substrate in the data path of the host, SmartNICs bring several challenges to a microservice platform: network traffic routing and load balancing, microservice placement on heterogeneous hardware, and contention on shared SmartNIC resources. We present E3, a microservice execution platform for SmartNIC-accelerated servers. E3 follows the design philosophies of the Azure Service Fabric microservice platform and extends key system components to a SmartNIC to address the above-mentioned challenges. E3 employs three key techniques: ECMP-based load balancing via SmartNICs to the host, network topology-aware microservice placement, and a data-plane orchestrator that can detect SmartNIC overload. Our E3 prototype using Cavium LiquidIO SmartNICs shows that SmartNIC offload can improve cluster energy-efficiency up to 3× and cost efficiency up to 1.9× at up to 4% latency cost for common microservices, including real-time analytics, an IoT hub, and virtual network functions.