MXFaaS: Resource Sharing in Serverless Environments for Parallelism and Efficiency
MXFaaS: Resource Sharing in Serverless Environments for Parallelism and Efficiency
复制标题
DOI：
10.1145/3579371.3589069
复制
发表时间：
2023-06
期刊：
影响因子：
--
通讯作者：
Jovan Stojkovic;Tianyi Xu;H. Franke;J. Torrellas
中科院分区：
文献类型：
--
作者：
Jovan Stojkovic;Tianyi Xu;H. Franke;J. Torrellas
尽管服务器计算是一种流行的范式，但当前的无服务器环境具有较高的间接费用。在本文中实质上执行，我们使用名为MXFAA的新平台设计来瞄准这种主导模式有效地多路复用（即共享）处理器周期，I/O带宽和内存/处理器状态在同时执行同一功能的调用之间。仔细地安排相同的功能调用，以最少响应时间。访问和远程函数调用来自同一功能的调用。可以共享未修改的内存状态，因此我们在两个无服务器平台中实现MXFAA，并使用MXFAAS实现MXFAA。与最先进的无服务器环境相比，MXFAA的效率更高，将P99尾巴延迟降低了5.2倍，并将吞吐量降低了4.8倍。内存使用3.4×。
Although serverless computing is a popular paradigm, current serverless environments have high overheads. Recently, it has been shown that serverless workloads frequently exhibit bursts of invocations of the same function. Such pattern is not handled well in current platforms. Supporting it efficiently can speed-up serverless execution substantially. In this paper, we target this dominant pattern with a new server-less platform design named MXFaaS. MXFaaS improves function performance by efficiently multiplexing (i.e., sharing) processor cycles, I/O bandwidth, and memory/processor state between concurrently executing invocations of the same function. MXFaaS introduces a new container abstraction called MXContainer. To enable efficient use of processor cycles, an MXContainer carefully helps schedule same-function invocations for minimal response time. To enable efficient use of I/O bandwidth, an MXContainer coalesces remote storage accesses and remote function calls from same-function invocations. Finally, to enable efficient use of memory/processor state, an MXContainer first initializes the state of its container and only later, on demand, spawns a process per function invocation, so that all invocations can share unmodified memory state and hence minimize memory footprint. We implement MXFaaS in two serverless platforms and run diverse serverless benchmarks. With MXFaaS, serverless environments are much more efficient. Compared to a state-of-the-art serverless environment, MXFaaS on average speeds-up execution by 5.2×, reduces P99 tail latency by 7.4×, and improves throughput by 4.8×. In addition, it reduces the average memory usage by 3.4×.