Benefits of high speed interconnects to cluster file systems: a case study with Lustre
Benefits of high speed interconnects to cluster file systems: a case study with Lustre
复制标题
集群文件系统高速互连的优势：Lustre 案例研究
DOI：
10.1109/ipdps.2006.1639564
复制
发表时间：
2006
期刊：
影响因子：
--
通讯作者：
D. Panda
中科院分区：
文献类型：
--
作者：
Weikuan Yu;R. Noronha;Shuang Liang;D. Panda
集群文件系统和存储区域网络（SAN）利用网络IO来实现更高的IO带宽。有效地整合网络机制对它们的业绩很重要。在本文中，我们执行一个流行的集群文件系统，光泽，超过两个领先的高速集群互连：InfiniBand和Quadrics的评估。我们的评估进行了顺序IO和并行IO基准，以探讨不同的通信特性下的光泽的能力。实验结果表明，直接实现的光泽在这两个互连可以提高其性能，相比IP仿真InfiniBand（IPoIB）。Lustre over Quadrics的性能与Lustre over InfiniBand在我们现有平台上的性能相当。最新的InfiniBand产品可以采用最新的技术，如PCI-Express和DDR，并提供更高的容量。我们的研究结果表明，在一个有两个对象存储发烧（OSS）的Lustre文件系统，InfiniBand与PCI-Express技术可以提高Lustre写性能的24%。此外，我们的实验结果表明，Lustre元数据操作不随OSS数量的增加而扩展，尽管使用了高性能互连
Cluster file systems and storage area networks (SAN) make use of network IO to achieve higher IO bandwidth. Effective integration of networking mechanisms is important to their performance. In this paper, we perform an evaluation of a popular cluster file system, Lustre, over two of the leading high speed cluster interconnects: InfiniBand and Quadrics. Our evaluation is performed with both sequential IO and parallel IO benchmarks in order to explore the capacity of Lustre under different communication characteristics. Experimental results show that direct implementations of Lustre over both interconnects can improve its performance, compared to an IP emulation over InfiniBand (IPoIB). The performance of Lustre over Quadrics is comparable to that of Lustre over InfiniBand with the platforms we have. Latest InfiniBand products can embrace latest technologies, such as PCI-Express and DDR, and provide higher capacity. Our results show that over a Lustre file system with two object storage fervers (OSSs), InfiniBand with PCI-Express technology can improve Lustre write performance by 24%. Furthermore, our experimental results indicate that Lustre meta-data operations do not scale with an increasing number of OSSs, in spite of using high performance interconnects