SpecFaaS: Accelerating Serverless Applications with Speculative Function Execution
SpecFaaS: Accelerating Serverless Applications with Speculative Function Execution
复制标题
DOI：
10.1109/hpca56546.2023.10071120
复制
发表时间：
2023-02
期刊：
影响因子：
--
通讯作者：
Jovan Stojkovic;Tianyi Xu;H. Franke;J. Torrellas
中科院分区：
文献类型：
--
作者：
Jovan Stojkovic;Tianyi Xu;H. Franke;J. Torrellas
无用的计算已成为流行的云计算范式。通过一种基于软件支持的投机性执行的新方法。 （Specfaas）。控制依赖性在管道分支预测中的预测，数据依赖性在此支持下对此进行了推测。下游功能与上游功能重叠，从而在Apache OpenWhisk上缩短了应用程序的端到端执行时间。 Specfaas的平均加速度为4.6倍，平均而言，应用程序吞吐量增加了3.9倍，尾部潜伏期降低了58.7％。
Serverless computing has emerged as a popular cloud computing paradigm. Serverless environments are convenient to users and efficient for cloud providers. However, they can induce substantial application execution overheads, especially in applications with many functions.In this paper, we propose to accelerate serverless applications with a novel approach based on software-supported speculative execution of functions. Our proposal is termed Speculative Function-as-a-Service (SpecFaaS). It is inspired by out-of-order execution in modern processors, and is grounded in a characterization analysis of FaaS applications. In SpecFaaS, functions in an application are executed early, speculatively, before their control and data dependences are resolved. Control dependences are predicted like in pipeline branch prediction, and data dependences are speculatively satisfied with memoization. With this support, the execution of downstream functions is overlapped with that of upstream functions, substantially reducing the end-to-end execution time of applications. We prototype SpecFaaS on Apache OpenWhisk, an open-source serverless computing platform. For a set of applications in a warmed-up environment, SpecFaaS attains an average speedup of 4.6×. Further, on average, the application throughput increases by 3.9× and the tail latency decreases by 58.7%.