权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Reconfigurable Parallel Processing Plug＆Play Clustering

可重构并行处理即插即用集群

基本信息

批准号：
12558025
负责人：
MATSUOKA Satoshi
金额：
$ 5.18万
依托单位：
Tokyo Institute of Technology
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2000
资助国家：
日本
起止时间：
2000 至 2001
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-12558025/
关键词：
Plug ＆ Play Lucie Dependable computing Fault-tolerant MPI Automated Cluster Installation and Configuration Node hot swap Large-scale cluster management チェックポイントマイグレーション並列処理クラスタ評価環境

项目摘要

The objective of the project is to push the technological envelop of fault tolerance and reconfigurability in large-scale clustering such that the clusters become almost self-sustaining, and reconfiguring is a matter of "Plug&Play". Some of the salient results are as follows :1) Construction of the "Plug&Play" clustering testbed (20 nodes of DELL Inspiron , Mobile Celeron 600 MHz, 128 MB Memory, 20 GB HDD, 3COM Plug＆Play PCMCIA 100Base-T Network Card). This served as a flexible testbed for middleware development. It was also very compact (a small rack) and low power (less than 400 watts/20 nodes)2) Development of the Parakeet Fault Tolerant, High-Performance Cluster MPI which allows various checkpointing algorithms to be selected from a set of available algorithm by the user according to his application characteristics. Parakeet is an entirely user-level implementation, is portable and efficient, and frees the users from checkpointing concerns within his code. We have implemented vario … More us checkpointing strategies to achieve the best efficiency, and conducted detailed performance analysis comparing with full restart.3) Self-organizing cluster middleware, the Lucie prototype. As a basic technology, plug＆play clustering requires hot swapping of nodes, reconfiguration of software organization within a node, and dynamic partition management. Lucie builds on existing Linux tools to implement full cluster configuration capabilities in an automated fashion. Lucie allows fully automated (re)installation and configuration of every node in a cluster in a very rapid fashion.4) Prototyping scalable, secure and self-organizing cluster communication. We have identified that scalable, reliable, secure, and self-organizing communication within the cluster node is the essential foundation for reliable, plug＆play clustering. We have prototyped some of the ideas in the Gfarm (cluster middleware for Petascale Datagrid processing) job manager : there, the self-organizing process ring structure governs all the nodes, and jobs can be started up rapidly in parallel, in a safe secure manner. Less

该项目的目标是推动大规模集群中容错和可重构性的技术极限，使集群几乎能够自我维持，并且重构是“即插即用”的事情。部分显着成果如下：1) 构建“即插即用”集群测试平台（20 个节点的 DELL Inspiron、Mobile Celeron 600 MHz、128 MB 内存、20 GB HDD、3COM 即插即用 PCMCIA 100Base-T 网卡）。这是中间件开发的灵活测试平台。它也非常紧凑（一个小机架）和低功耗（小于 400 瓦/20 个节点）2) 开发了 Parakeet 容错高性能集群 MPI，允许用户根据其应用程序特性从一组可用算法中选择各种检查点算法。 Parakeet 是一个完全用户级的实现，可移植且高效，并且使用户摆脱了代码中的检查点问题。我们实施了多种检查点策略以达到最佳效率，并与完全重启进行了详细的性能分析。3）自组织集群中间件，Lucie原型。作为一项基础技术，即插即用集群需要节点的热插拔、节点内软件组织的重新配置以及动态分区管理。 Lucie 基于现有的 Linux 工具构建，以自动化方式实现完整的集群配置功能。 Lucie 允许以非常快速的方式完全自动化（重新）安装和配置集群中的每个节点。4) 构建可扩展、安全和自组织集群通信的原型。我们已经确定，集群节点内的可扩展、可靠、安全和自组织通信是可靠、即插即用集群的重要基础。我们在 Gfarm（用于 Petascale Datagrid 处理的集群中间件）作业管理器中原型化了一些想法：在那里，自组织进程环结构管理所有节点，作业可以以安全可靠的方式快速并行启动。较少的