Particle: ephemeral endpoints for serverless networking
Particle: ephemeral endpoints for serverless networking
复制标题
DOI：
10.1145/3419111.3421275
复制
发表时间：
2020-10
期刊：
影响因子：
--
通讯作者：
Shelby Thomas;Lixiang Ao;G. Voelker;G. Porter
中科院分区：
文献类型：
--
作者：
Shelby Thomas;Lixiang Ao;G. Voelker;G. Porter
Burst-Parallelless无服务器应用程序调用数千个短寿命的分布式功能来完成复杂的作业，例如数据分析，视频编码或编译。尽管这些任务在几秒钟内执行，但启动和配置他们依赖的虚拟网络是一个主要的瓶颈，最多可消耗总启动时间的84％。在本文中，我们表征了该网络冷启动问题的大小，其中三个流行的覆盖网络，Docker Swarm，Weave和Linux覆盖层。我们专注于端到端启动时间，该时间涵盖了引导一组容器以及互连的时间。我们的主要观察结果是，在短寿命的无服务器环境中，现有的无服务器网络量表的叠加方法尺寸很差。根据我们的发现，我们开发了粒子，这是一个针对多节点无服务器叠加层网络量身定制的网络堆栈，可在不牺牲多租赁，一般性或吞吐量的情况下优化网络创建。当集成到无服务器平行的视频处理管道中时，粒子将应用程序运行时提高了2.4--3倍，而现有覆盖层则将运行时提高。
Burst-parallel serverless applications invoke thousands of short-lived distributed functions to complete complex jobs such as data analytics, video encoding, or compilation. While these tasks execute in seconds, starting and configuring the virtual network they rely on is a major bottleneck that can consume up to 84% of total startup time. In this paper we characterize the magnitude of this network cold start problem in three popular overlay networks, Docker Swarm, Weave, and Linux Overlay. We focus on end-to-end startup time that encompasses both the time to boot a group of containers as well as interconnecting them. Our primary observation is that existing overlay approaches for serverless networking scale poorly in short-lived serverless environments. Based on our findings we develop Particle, a network stack tailored for multi-node serverless overlay networks that optimizes network creation without sacrificing multi-tenancy, generality, or throughput. When integrated into a serverless burst-parallel video processing pipeline, Particle improves application runtime by 2.4--3X over existing overlays.