Reconfigurable Parallel Processing Plug＆Play Clustering

该项目的目标是在大规模集群中推动容错和可重构的技术界限，使集群变得几乎自我维持，重构是一个即插即用的问题。主要成果如下：1)构建了“即插即用”集群试验台(20个节点的Dell Inspiron灵越、移动赛扬600 MHz、128 MB内存、20 GB硬盘、3COM即插即用PCMCIA 100BASE-T网卡)。这为中间件开发提供了一个灵活的试验台。它还非常紧凑(一个小机架)和低功耗(低于400瓦/20节点)2)Parakeet容错、高性能集群MPI的开发，允许用户根据其应用程序特征从一组可用的算法中选择各种检查点算法。鹦鹉是一个完全用户级的实现，可移植且高效，并使用户从其代码中的检查点问题中解脱出来。我们已经实现了VARIO…并与完全重启进行了详细的性能对比分析。3)自组织集群中间件Lucie原型。作为一种基础技术，即插即用集群需要节点的热交换、节点内软件组织的重新配置和动态分区管理。Lucie构建在现有的Linux工具之上，以自动方式实现完整的集群配置功能。Lucie允许以非常快速的方式全自动(重新)安装和配置集群中的每个节点。4)原型可扩展、安全和自组织的集群通信。我们已经认识到，群集节点内可扩展、可靠、安全和自组织的通信是可靠、即插即用的群集的重要基础。我们已经在GFAME(用于Petascale数据网格处理的集群中间件)作业管理器中原型化了一些思想：在那里，自组织进程环结构管理所有节点，作业可以以安全可靠的方式快速并行启动。较少

The objective of the project is to push the technological envelop of fault tolerance and reconfigurability in large-scale clustering such that the clusters become almost self-sustaining, and reconfiguring is a matter of "Plug&Play". Some of the salient results are as follows :1) Construction of the "Plug&Play" clustering testbed (20 nodes of DELL Inspiron , Mobile Celeron 600 MHz, 128 MB Memory, 20 GB HDD, 3COM Plug＆Play PCMCIA 100Base-T Network Card). This served as a flexible testbed for middleware development. It was also very compact (a small rack) and low power (less than 400 watts/20 nodes)2) Development of the Parakeet Fault Tolerant, High-Performance Cluster MPI which allows various checkpointing algorithms to be selected from a set of available algorithm by the user according to his application characteristics. Parakeet is an entirely user-level implementation, is portable and efficient, and frees the users from checkpointing concerns within his code. We have implemented vario … More us checkpointing strategies to achieve the best efficiency, and conducted detailed performance analysis comparing with full restart.3) Self-organizing cluster middleware, the Lucie prototype. As a basic technology, plug＆play clustering requires hot swapping of nodes, reconfiguration of software organization within a node, and dynamic partition management. Lucie builds on existing Linux tools to implement full cluster configuration capabilities in an automated fashion. Lucie allows fully automated (re)installation and configuration of every node in a cluster in a very rapid fashion.4) Prototyping scalable, secure and self-organizing cluster communication. We have identified that scalable, reliable, secure, and self-organizing communication within the cluster node is the essential foundation for reliable, plug＆play clustering. We have prototyped some of the ideas in the Gfarm (cluster middleware for Petascale Datagrid processing) job manager : there, the self-organizing process ring structure governs all the nodes, and jobs can be started up rapidly in parallel, in a safe secure manner. Less