Optimus Prime: Accelerating Data Transformation in Servers
Optimus Prime: Accelerating Data Transformation in Servers
复制标题
Optimus Prime：加速服务器中的数据转换
DOI：
10.1145/3373376.3378501
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Christoph E. Koch
中科院分区：
文献类型：
--
作者：
Arash Pourhabibi Zarandi;Siddharth Gupta;H. Kassir;Mark Sutherland;Zilu Tian;M. Drumond;B. Falsafi;Christoph E. Koch
现代的在线服务因其可靠性，可靠性，可编程性和开发速度而从单片应用转变为松散耦合的微服务。通过数据中心网络通信的微服务需要数据转换（DT），以在其内部格式之间来回转换消息。由于周围系统组件的潜伏期减少，即应用程序运行时间，协议堆栈和网络硬件，这项工作将DT视为瓶颈。因此，我们建议使用新颖的抽象，一种内存架构来表示DT操作的可编程DT加速器Optimus Prime（OP）。该模式与当今的DT框架兼容，并使任何兼容的加速器都可以执行包含请求并行的转换。我们的评估表明，OP的DT吞吐量与当今NIC的线路速率相匹配，并且与软件相比，在CPU硅区域和功率的一小部分中，吞吐量高约60倍。我们还评估了一组在节俭时运行的微服务，并显示服务潜伏期的30％。
Modern online services are shifting away from monolithic applications to loosely-coupled microservices because of their improved scalability, reliability, programmability and development velocity. Microservices communicating over the datacenter network require data transformation (DT) to convert messages back and forth between their internal formats. This work identifies DT as a bottleneck due to reductions in latency of the surrounding system components, namely application runtimes, protocol stacks, and network hardware. We therefore propose Optimus Prime (OP), a programmable DT accelerator that uses a novel abstraction, an in-memory schema, to represent DT operations. The schema is compatible with today's DT frameworks and enables any compliant accelerator to perform the transformations comprising a request in parallel. Our evaluation shows that OP's DT throughput matches the line rate of today's NICs and has ~60x higher throughput compared to software, at a tiny fraction of the CPU's silicon area and power. We also evaluate a set of microservices running on Thrift, and show up to 30% reduction in service latency.