A Distributed Virtual Fileserver System with Redundant File Storing

点击翻译按钮获取中文摘要

This project targeted to develop a virtual fileserver system, which consists of many client PCs as its component nodes. Each client PC provides a part of its own storage area to construct a virtual filesystem that supplies a large amount of shared disk space consequently. One of the most important benefits of this approach is as the number of clients increases, the total capacity and total processing power increase as well. All nodes in the system run by a distributed, autonomous manner so that the entire system does not stop working if some portion of nodes got failure. File segments are redundantly stored for robustness.To archive this project, we set a design of a distributed file backup system as a first goal. It might be easier to implement than filesystem because backup systems are not so sensitive from the aspect of performance requirements. Then we have designed and implemented a distributed virtual filesystem with the knowledge acquired from the first goal.We also studied on distributed hash tables (DHT). Since each node in the system works autonomously and may join/leave at anytime, flexibility of DHTs is favorable to manage nodes and file placement. Our proposed DHT performs with our hierarchical clustering algorithm. It makes the utilization of network resource as effectively as possible by traffic localization.