Wide-area cooperative storage with CFS
Wide-area cooperative storage with CFS
复制标题
DOI：
10.1145/502034.502054
复制
发表时间：
2001-10
期刊：
影响因子：
--
通讯作者：
F. Dabek;M. Kaashoek;David R Karger;R. Morris;I. Stoica
中科院分区：
文献类型：
--
作者：
F. Dabek;M. Kaashoek;David R Karger;R. Morris;I. Stoica
协作文件系统(CFS)是一种新的对等只读存储系统，它为文件存储和检索的效率、健壮性和负载平衡提供了可证明的保证。CFS使用完全分散的体系结构来实现这一点，该体系结构可以扩展到大型系统。CFS服务器为数据块存储提供分布式哈希表(DHash)。CFS客户端将DHash数据块解释为文件系统。DHash以精细的粒度分发和缓存数据块以实现负载平衡，使用复制实现健壮性，并通过服务器选择减少延迟。DHash使用Chord定位协议查找数据块，该协议在服务器数量上以时间对数运行。CFS使用SFS文件系统工具包实现，运行在Linux、OpenBSD和FreeBSD上。在全球部署的原型上的经验表明，CFS向客户端提供数据的速度与FTP一样快。受控测试表明，CFS是可扩展的：在4,096台服务器上，查找一个数据块只需要联系7台服务器。测试还展示了近乎完美的健壮性和性能，即使在多达一半的服务器出现故障的情况下也是如此。
The Cooperative File System (CFS) is a new peer-to-peer read-only storage system that provides provable guarantees for the efficiency, robustness, and load-balance of file storage and retrieval. CFS does this with a completely decentralized architecture that can scale to large systems. CFS servers provide a distributed hash table (DHash) for block storage. CFS clients interpret DHash blocks as a file system. DHash distributes and caches blocks at a fine granularity to achieve load balance, uses replication for robustness, and decreases latency with server selection. DHash finds blocks using the Chord location protocol, which operates in time logarithmic in the number of servers.CFS is implemented using the SFS file system toolkit and runs on Linux, OpenBSD, and FreeBSD. Experience on a globally deployed prototype shows that CFS delivers data to clients as fast as FTP. Controlled tests show that CFS is scalable: with 4,096 servers, looking up a block of data involves contacting only seven servers. The tests also demonstrate nearly perfect robustness and unimpaired performance even when as many as half the servers fail.