A research on interconnection network for large scale clusters based on commodity network

在本研究中，我们建立了一种技术，提供高性能，可扩展和可靠的互连网络的PC集群，基于商品局域网，如千兆以太网，利用他们的多个链接。在我们的技术中，我们仅通过软件实现了所有这些功能。该系统由两部分组成：（1）利用多个网络链路将联合收割机结合起来，以实现高带宽和冗余;（2）克服传统以太网利用率在性能可扩展性方面的限制，采用简单的树结构，通过附加的以太网驱动程序控制标准的标记VLAN技术，提供多路径解决方案。本文构建了一个具有16个节点的PC集群实验平台，每个节点都配备了双千兆以太网链路，并对系统的性能和功能进行了评估。因此，RI 2N/UDP通过双链路提供双倍带宽， 关于我们 95%以上的效率。当两条链路之一发生故障时，通信流量会自动重定向到另一条链路，以提供用户透明的容错。在这种情况下，具有单个链路的系统也提供超过95%的效率。在对VREC-Net的评估中，我们可以用普通的廉价的第二层以太网交换机和我们的软件构建一个多级的FAT-Tree配置。在可扩展性测试中，我们将软件移植到另一个64节点的平台上，验证了四个上行链路的FAT-Tree可以提供4倍的带宽，可以扩展到上千个PC集群节点。最后，在研究的最后阶段，我们成功地将两种技术结合起来，提供了高带宽，可靠和可扩展的互连解决方案，用于高性能计算的成本/效益PC集群。这三个功能对于大规模HPC来说是非常重要的，我们证明了在本研究中，只有低价格的千兆以太网和第二层交换机才有可能由开发的驱动程序和通信库控制。少

In this research, we have established a technology to provide high-performance, scalable and reliable interconnection network for PC clusters, based on commodity LAN such as Gigabit Ethernet to utilize multiple links of them. In our technology, we implemented all these functionalities by software only. The system consists of two components ; (1) utilizing multiple network links to combine both for high-bandwidth and redundancy, and (2) conquering the limitation of performance scalability on traditional Ethernet utilization, a simple tree construction, to provide multi-path solution with standard tagged-VLAN technology controlled by additional Ethernet driver. These two technologies are named as RI2N/UDP and VFREC-Net, respectively.We constructed a test-bed PC cluster system with 16 nodes where each node is equipped with dual Gigabit Ethernet links to develop the system and evaluate the performance and functionality. As a result, RI2N/UDP provides doubled bandwidth with dual links with … More more than 95% of efficiency. When one of two links fails, the communication traffic is automatically redirected to the other link to provide user-transparent fault tolerance. In this situation, the system with a single link also provides more than 95% efficiency. In the evaluation of VFREC-Net, we could construct a multi-stage FAT-Tree configuration with ordinary and inexpensive Layer-2 Ethernet switch and our software. For the scalability test, we ported the software to another platform with 64 nodes, and confirmed the FAT-Tree with four up-links exactly provides four times bandwidth which is enable to expand for thousands of PC cluster nodes.Finally at the last stage of our research, we could successfully combined two technologies to provide high-bandwidth, reliable and scalable interconnection solution for cost/effective PC cluster for high performance computing. These three features are really essential for large scale HPC, and we proved that it is possible with only low-price Gigabit Ethernet and Layer-2 switches controlled by the developed drivers and communication libraries in this research. Less