LineFS: Efficient SmartNIC Offload of a Distributed File System with Pipeline Parallelism
LineFS: Efficient SmartNIC Offload of a Distributed File System with Pipeline Parallelism
复制标题
DOI：
10.1145/3477132.3483565
复制
发表时间：
2021-10
期刊：
影响因子：
--
通讯作者：
Jongyul Kim;Insu Jang;Waleed Reda;Jaeseong Im;Marco Canini;Dejan Kostic;Youngjin Kwon;Simon Peter;Emmett Witchel
中科院分区：
文献类型：
--
作者：
Jongyul Kim;Insu Jang;Waleed Reda;Jaeseong Im;Marco Canini;Dejan Kostic;Youngjin Kwon;Simon Peter;Emmett Witchel
在多租户系统中，分布式文件系统（DFS）的CPU开销越来越成为应用程序性能的负担。CPU和内存干扰会导致应用程序和存储性能下降和不稳定，特别是操作延迟。最近用于持久内存（PM）的客户端本地DFS加速了这一趋势。将DFS卸载到SmartNIC是解决这些问题的一个很有前途的解决方案，但要将DFS的复杂需求满足到位于PCIe上的简单SmartNIC处理器上是一个挑战。我们提出了LineFS，一个SmartNIC卸载，高性能的DFS与客户端本地PM的支持。为了充分利用SmartNIC架构，我们将DFS操作分解为执行阶段，这些执行阶段可以卸载到SmartNIC上的并行数据路径执行管道。LineFS将复制、压缩、数据发布、索引和一致性管理等CPU密集型DFS任务卸载到Smart-NIC。我们在Mellanox BlueField Smart-NIC上实现LineFS，并将其与最先进的PM DFS Assise进行比较。LineFS将LevelDB的延迟提高了80%，将Filebench的吞吐量提高了79%，同时在主机系统故障期间提供了扩展的DFS可用性。
In multi-tenant systems, the CPU overhead of distributed file systems (DFSes) is increasingly a burden to application performance. CPU and memory interference cause degraded and unstable application and storage performance, in particular for operation latency. Recent client-local DFSes for persistent memory (PM) accelerate this trend. DFS offload to SmartNICs is a promising solution to these problems, but it is challenging to fit the complex demands of a DFS onto simple SmartNIC processors located across PCIe. We present LineFS, a SmartNIC-offloaded, high-performance DFS with support for client-local PM. To fully leverage the SmartNIC architecture, we decompose DFS operations into execution stages that can be offloaded to a parallel datapath execution pipeline on the SmartNIC. LineFS offloads CPU-intensive DFS tasks, like replication, compression, data publication, index and consistency management to a Smart-NIC. We implement LineFS on the Mellanox BlueField Smart-NIC and compare it to Assise, a state-of-the-art PM DFS. LineFS improves latency in LevelDB up to 80% and throughput in Filebench up to 79%, while providing extended DFS availability during host system failures.