Study on large-scale scalable P2P grid infrastructure for large-capacity distributed computing

适用于大容量分布式计算的大规模可扩展P2P网格基础设施研究

• 批准号: 17200002
• 负责人: SATO Mitsuhisa
• 金额: $ 18.72万
• 依托单位: University of Tsukuba
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (A)
• 财政年份: 2005
• 资助国家: 日本
• 起止时间: 2005 至 2007
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-17200002/
• 关键词: P2P computing; Grid computing; Parallel porocessing; distributed computing; over-lay network; large-canacity computing; P2Pコンピューティング

The concept of P2P grid is to make use of PCs in office and laboratory as a computing resource of Grid computing using P2P technology, while the Grid computing is mainly for sharing computing resource in each research organization. Our objective is to investigate and establish the technology and infrastructure of P2P grid for large-capacity computing and demonstrate its effectiveness in several applications.1. To make use of potential computing resources such as PCs in office as a computing source of grid computing, we have developed a system, called BEE, which enables the Linux binary to run a Grid worker in Windows, and a network-layer which allows the communication traversing the firewall by using UDP-hole punching. And, we also proposed an authentication method called AUBReX (Authentication method Using Buddy-buddy relationship Represented by Cross certificate), which supports both anonymity and malicious user identification, for P2P environment, and a framework for a parallel prog … More ramming model by remote procedure calls, which bridge large-scale computing resource pools managed by multiple Grid-enabled job scheduling systems.2. We proposed a model to separate the data transfer by a data management layer from the RPC programming. We have designed and implemented a prototype data transfer layer, OmniStorage, which allows efficient data transmission of a large amount of data. And we proposed a framework and programming model to support large capacity computing on global distributed file system. We have proposed a scheme for storage and retrieval of XML data using DHT with storage-load balancing method based on extendible hashing.3. We have developed a master-worker type parallel method for finding several eigenvalues and eigenvectors of a generalized eigenvalue problem, which suitable for master-worker programming models in P2P grid. We have also developed numerical algorithms suited to the heterogeneous multi-core systems such as Cell processor which can be recognized as a powerful computing resource in P2P grid. Less

P2P网格的概念是利用P2P技术将办公室和实验室中的PC机作为网格计算的计算资源，而网格计算主要是为了实现各研究机构之间的计算资源共享。我们的目标是研究和建立大容量计算的P2P网格技术和基础设施，并在几个应用中证明其有效性。为了充分利用办公室中的PC机等潜在的计算资源作为网格计算的计算源，我们开发了一个BEE系统，它使Linux二进制文件能够在Windows环境下运行网格工作者，并开发了一个网络层，它通过UDP打孔允许通信穿越防火墙。提出了一种P2P环境下支持匿名和恶意用户识别的认证方法AUBReX（Authentication method Using Buddy-buddy relationship Represented by Cross certificate），并给出了一个并行程序框架。 ...更多信息 通过远程过程调用来实现对模型的冲压，从而将多个网格作业调度系统管理的大规模计算资源池连接起来.我们提出了一个模型，通过数据管理层将数据传输与RPC编程分离。我们已经设计并实现了一个原型数据传输层，OmniStorage，它允许高效的数据传输大量的数据。提出了一种在全局分布式文件系统上支持大容量计算的框架和编程模型。提出了一种基于可扩展哈希的存储负载平衡方法，利用分布式哈希表实现XML数据的存储和检索.针对P2P网格环境下的主从式编程模型，提出了一种求解广义特征值问题的主从式并行方法.我们还开发了适用于异构多核系统的数值算法，如Cell处理器，它可以被认为是P2P网格中强大的计算资源。少

项目成果

On single precision preconditioners for Krylov subspace iterative methods

Krylov子空间迭代方法的单精度预处理器

• 发表时间: 2008
• 期刊: Lecture Notes in Computer Science No. No.4818
• 作者: H. Tadano;T. Sakurai
• 通讯作者: T. Sakurai

Parallelization of Crystal Calculation for Large-Scale Molecular Crystal Structure Analysis

用于大规模分子晶体结构分析的晶体计算并行化

• 发表时间: 2008
• 期刊: J. Comput. Aid. Chem. 9
• 作者: S. Obata;H. Goto
• 通讯作者: H. Goto

Performance Modeling and Optimal Block Size Selection for the Small-Bulge Multishift QR Algorithm

Small-Bulge Multishift QR 算法的性能建模和最佳块大小选择

• 发表时间: 2006
• 期刊: Parallel and Distributed Processing and Applications, Lecture Notes in Computer Science 4330
• 作者: Y. Yamamoto

OmniRPC Grid Parallel Programming Environment for a Large Scale Numerical Computation

用于大规模数值计算的 OmniRPC 网格并行编程环境

• 发表时间: 2005
• 期刊: Prof. of 17th IMACS World Congress Scientific Computation, Applied Mathematics and Simulation (in CD-ROM)
• 作者: Mitsuhisa Sato;Yoshihiro Nakajima;Tesuya Sakurai;Taisuke Boku and Daisuke Takahashi
• 通讯作者: Taisuke Boku and Daisuke Takahashi

ヘテロなOSの計算資源を活用するグリッドRPCの設計

利用异构操作系统计算资源的网格RPC设计

• 发表时间: 2006
• 作者: 中村・中島・佐藤