The galley parallel file system

The galley parallel file system
复制标题

DOI:
10.1145/237578.237639
复制
发表时间:
1997-06
期刊:
Parallel Comput.
影响因子:
--
通讯作者:
N. Nieuwejaar;D. Kotz
N. Nieuwejaar;D. Kotz
中科院分区:
其他
文献类型:
--
作者:
N. Nieuwejaar;D. Kotz

文献摘要

被引文献

相似文献

摘要当前大多数多处理器文件系统都是并行使用多个磁盘,利用高聚合带宽来满足并行科学应用日益增长的I/O需求。许多多处理器文件系统为应用程序提供传统的类Unix接口,允许应用程序透明地访问多个磁盘。这种接口隐藏了文件系统中的并行性,增加了可编程性的易用性,但使复杂的程序员和库很难或不可能使用有关其I/O需求的知识来利用这种并行性。除了提供的接口不足之外,大多数当前的多处理器文件系统都针对不同的工作负载进行了优化,而不是要求它们支持。我们介绍Galley,一个新的并行文件系统,旨在有效地支持现实的科学多处理器工作负载。我们讨论Galley的文件结构和应用程序接口,以及该接口提供的性能优势。
Abstract Most current multiprocessor file systems are designed to use multiple disks in parallel, using the high aggregate bandwidth to meet the growing I/O requirements of parallel scientific applications. Many multiprocessor file systems provide applications with a conventional Unix-like interface, allowing the application to access multiple disks transparently. This interface conceals the parallelism within the file system, increasing the ease of programmability, but making it difficult or impossible for sophisticated programmers and libraries to use knowledge about their I/O needs to exploit that parallelism. In addition to providing an insufficient interface, most current multiprocessor file systems are optimized for a different workload than they are being asked to support. We introduce Galley, a new parallel file system that is intended to efficiently support realistic scientific multiprocessor workloads. We discuss Galley's file structure and application interface, as well as the performance advantages offered by that interface.