Gfarm/BB — Gfarm File System for Node-Local Burst Buffer
Gfarm/BB — Gfarm File System for Node-Local Burst Buffer
复制标题
Gfarm/BB — 用于节点本地突发缓冲区的 Gfarm 文件系统
DOI：
--
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Y. Oyama
中科院分区：
文献类型：
--
作者：
O. Tatebe;Shukuko Moriwake;Y. Oyama
突发缓存已经成为满足高性能计算机突发业务I/O性能要求的主要部件。本文提出了一种高效利用节点本地存储系统的突发缓冲区文件系统GFARM/BB。虽然节点本地存储提高了存储性能，但它们仅在作业分配期间可用。Gfield/BB应该具有更好的访问和元数据性能，而它应该在作业执行之前按需构建。为了提高读写性能，它利用了文件描述符传递和远程直接内存访问(RDMA)。由于它是一个时态文件系统，它通过省略持久性和冗余性来提高元数据的性能。与IP over InfiniBand(IPoIB)相比，使用RDMA时，读写带宽分别提高了1.7倍和2.2倍。它在目录创建性能上达到了每秒14 700次操作，比完全持久和冗余的情况快13.4倍。使用2个节点，Gfield/BB的构建耗时0.31秒。IOR基准测试和ARGOT-IO应用I/O基准测试表明，通过利用节点本地存储的局部性，可扩展的性能改进。与BeeOND相比，Gfield/BB在IOR读写基准测试中的性能分别提高了2.6倍和2.4倍，在ARGOT-IO方面的性能分别提高了2.5倍。
Burst buffer has become a major component to meet the I/O performance requirement of HPC bursty traffic. This paper proposes Gfarm/BB that is a file system for a burst buffer efficiently exploiting node-local storage systems. Although node-local storages improve storage performance, they are only available during the job allocation. Gfarm/BB should have better access and metadata performance while it should be constructed on-demand before the job execution. To improve the read and write performance, it exploits the file descriptor passing and remote direct memory access (RDMA). It improves the metadata performance by omitting the persistency and the redundancy since it is a temporal file system. Using RDMA, writes and reads bandwidth are improved by 1.7x and 2.2x compared with IP over InfiniBand (IPoIB), respectively. It achieves 14 700 operations per second in the directory creation performance, which is 13.4x faster than the fully persistent and redundant case. The construction of Gfarm/BB takes 0.31 seconds using 2 nodes. IOR benchmark and ARGOT-IO application I/O benchmark show the scalable performance improvement by exploiting the locality of node-local storages. Compared with BeeOND, Gfarm/BB shows 2.6x and 2.4x better performance in IOR write and read benchmarks, respectively, and it shows 2.5x better performance in ARGOT-IO.