Fundamental Study on Parallel Archiving System and Adaptive Load Balancing Mechanisms for it

点击翻译按钮获取中文摘要

To establish the method of constructing a very large scale archiver of peta byte class which is needed at the coming generation by means of combining relatively small commodity archivers of tera byte order, we develop the efficient file management algorithms. Cooperation of element archivers ranging form hundreds to thousands, file management and file migration on them are not studied yet.At first, we studied the feasibility of parallel archiving system, clarified the migration algorithms which could be realized physically and estimated the costs and performances for them. We designed a conceptual architecture of parallel archiving system consisting of hundreds to thousands of element archivers and proposed the access frequency based adaptive algorithms for the tape migration between the element archivers. We indicated that considering the processing capability of each element archiver made it possible to redistribute tapes automatically among the element archivers and to serve requests even if some tape drives fails. Further, cooperation of the element archivers to fasten data I/O operations was also examined. Moreover, using the file organization and the access pattern at the global environmental database system, we clarified the effectiveness of the parallel archiveing system for real applications.