Fundamental Study on Parallel Archiving System and Adaptive Load Balancing Mechanisms for it

并行归档系统及其自适应负载均衡机制的基础研究

• 批准号: 07408008
• 负责人: TAKAGI Mikio
• 金额: $ 8.96万
• 依托单位: University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 1995
• 资助国家: 日本
• 起止时间: 1995 至 1996
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-07408008/
• 关键词: archiving system; parallel processing; load balancing; tape migration

To establish the method of constructing a very large scale archiver of peta byte class which is needed at the coming generation by means of combining relatively small commodity archivers of tera byte order, we develop the efficient file management algorithms. Cooperation of element archivers ranging form hundreds to thousands, file management and file migration on them are not studied yet.At first, we studied the feasibility of parallel archiving system, clarified the migration algorithms which could be realized physically and estimated the costs and performances for them. We designed a conceptual architecture of parallel archiving system consisting of hundreds to thousands of element archivers and proposed the access frequency based adaptive algorithms for the tape migration between the element archivers. We indicated that considering the processing capability of each element archiver made it possible to redistribute tapes automatically among the element archivers and to serve requests even if some tape drives fails. Further, cooperation of the element archivers to fasten data I/O operations was also examined. Moreover, using the file organization and the access pattern at the global environmental database system, we clarified the effectiveness of the parallel archiveing system for real applications.

为了结合相对较小的tera字节顺序的商用归档器，建立下一代需要的超大规模的peta字节类归档器的方法，我们开发了高效的文件管理算法。数百到数千个元素归档器之间的协作、它们之间的文件管理和文件迁移尚未研究。首先研究了并行归档系统的可行性，明确了可物理实现的迁移算法，并对其成本和性能进行了估算。设计了一个由数百到数千个单元归档器组成的并行归档系统的概念架构，并提出了基于访问频率的单元归档器间磁带迁移自适应算法。我们指出，考虑到每个元素归档器的处理能力，可以在元素归档器之间自动重新分发磁带，并且即使某些磁带驱动器出现故障也可以为请求提供服务。此外，还研究了元素归档器之间的合作，以加快数据I/O操作。并以全球环境数据库系统中的文件组织和访问模式为例，验证了并行归档系统在实际应用中的有效性。

项目成果

T.Nemoto et al.: "Scalable tape archiver and its application To sattellite image database" Proc.of Int'l Symposium on Remote sensing. 267-272 (1996)

T.Nemoto 等人：“可扩展磁带归档器及其在卫星图像数据库中的应用”Proc.of 国际遥感研讨会。

T.Nemoto et.al.: "Scalable tape archiver and its application to satellite image database" Proc.of Int'l Symposium on Remote Sensing. 267-272 (1996)

T.Nemoto 等人：“可扩展磁带归档器及其在卫星图像数据库中的应用”Proc.of Intl Symposium on Remote Sensing。

T.Nemoto et.al.: "Performane evaluation of cassete migration mechanism for scalable tape archiver" Proc.of SPIE Photonics East '95 Digital lmage storage and Archiving system. 48-58 (1995)

T.Nemoto 等人：“可扩展磁带存档器的磁带迁移机制的性能评估”Proc.of SPIE Photonics East 95 数字图像存储和存档系统。

鮎川健一郎,根元利弘,茂木和彦,喜連川優,高木幹雄: "大規模テープナ-カイバンオケルマイクレーションのシミュレーションによる評価" 情報処理学会第51回(平成7年後期)全国大会講演論文集4D-8. (1995)

Kenichiro Ayukawa、Toshihiro Nemoto、Kazuhiko Mogi、Yu Kitsurekawa、Mikio Takagi：“通过模拟评估大型磁带-na-kaibanokermicration”日本信息处理学会第 51 届（1995 年末）全国会议论文集 4D-8（1995 年）

Toshihiro Nemoto, Masaru Kitsuregawa, Mikio Takagi: "Scalable tape archiver and its application to satellite image database" Proc. of International Symposium on Remote Sensing. 267-272 (1996)

Toshihiro Nemoto、Masaru Kitsurekawa、Mikio Takagi：“可扩展磁带归档器及其在卫星图像数据库中的应用”Proc。