Scalable Distributed Directory Implementation on Orange File System
Scalable Distributed Directory Implementation on Orange File System
复制标题
Orange 文件系统上的可扩展分布式目录实现
DOI：
--
复制
发表时间：
2011
期刊：
影响因子：
--
通讯作者：
Elaine C. Quarles
中科院分区：
文献类型：
--
作者：
Shuangyang Yang;W. Ligon;Elaine C. Quarles
在橙子文件系统中，大数据文件被分条到多个服务器上以提供高并发访问，然而，大目录的内容仅存储在单个服务器上，这成为处理并发访问同一目录的大量请求的瓶颈。本文实现了一个适用于橙子文件系统的可扩展分布式目录，并在一个大规模系统中进行了评估。吞吐量性能是由UCAR metarates基准的修改版本来测量的。结果表明，在多个客户端同时创建和删除一个目录下的大量文件时，具有很好的可伸缩性。在64台服务器和128个客户端同时访问同一目录的情况下，可扩展的分布式目录可以实现每秒创建8，000多个文件，平均每秒删除11，000多个文件。
In Orange File System, large data files are striped across multiple servers to provide highly concurrent access, however, contents of large directories are only stored in a single server, which is becoming a bottleneck in handling a large number of requests accessing the same directory concurrently. In this paper, a scalable distributed directory for Orange File System is implemented and evaluated in a largescale system. The throughput performance is measured by a modified version of UCAR metarates benchmark. The result shows great scalability in concurrently creating and removing large numbers of files under one directory by multiple clients. On a 64-servers setup and 128 clients accessing the same directory concurrently, the scalable distributed directory can achieve more than 8,000 file creations per second and over 11,000 file removals per second on average.