权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

A research on interconnection network for large scale clusters based on commodity network

基于商品网络的大规模集群互联网络研究

基本信息

批准号：
17500031
负责人：
BOKU Taisuke
金额：
$ 2.11万
依托单位：
University of Tsukuba
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
2005
资助国家：
日本
起止时间：
2005 至 2006
项目状态：
已结题

项目摘要

In this research, we have established a technology to provide high-performance, scalable and reliable interconnection network for PC clusters, based on commodity LAN such as Gigabit Ethernet to utilize multiple links of them. In our technology, we implemented all these functionalities by software only. The system consists of two components ; (1) utilizing multiple network links to combine both for high-bandwidth and redundancy, and (2) conquering the limitation of performance scalability on traditional Ethernet utilization, a simple tree construction, to provide multi-path solution with standard tagged-VLAN technology controlled by additional Ethernet driver. These two technologies are named as RI2N/UDP and VFREC-Net, respectively.We constructed a test-bed PC cluster system with 16 nodes where each node is equipped with dual Gigabit Ethernet links to develop the system and evaluate the performance and functionality. As a result, RI2N/UDP provides doubled bandwidth with dual links with … More more than 95% of efficiency. When one of two links fails, the communication traffic is automatically redirected to the other link to provide user-transparent fault tolerance. In this situation, the system with a single link also provides more than 95% efficiency. In the evaluation of VFREC-Net, we could construct a multi-stage FAT-Tree configuration with ordinary and inexpensive Layer-2 Ethernet switch and our software. For the scalability test, we ported the software to another platform with 64 nodes, and confirmed the FAT-Tree with four up-links exactly provides four times bandwidth which is enable to expand for thousands of PC cluster nodes.Finally at the last stage of our research, we could successfully combined two technologies to provide high-bandwidth, reliable and scalable interconnection solution for cost/effective PC cluster for high performance computing. These three features are really essential for large scale HPC, and we proved that it is possible with only low-price Gigabit Ethernet and Layer-2 switches controlled by the developed drivers and communication libraries in this research. Less

在本研究中，我们建立了一种技术来为PC集群提供高性能、可扩展和可靠的互连网络，基于千兆位以太网等商用局域网，利用它们之间的多条链路。在我们的技术中，我们仅通过软件实现了所有这些功能。该系统由两部分组成：(1)利用多条网络链路结合在一起，以获得高带宽和冗余；(2)克服了传统以太网利用性能可伸缩性的限制，采用简单的树形结构，通过附加以太网驱动程序控制标准的Tag-Vlan技术，提供多路径解决方案。分别将这两种技术命名为RI2N/UDP和VFREC-Net，构建了一个具有16个节点的PC集群测试系统，每个节点都配备了双千兆以太网链路，以开发该系统，并对其性能和功能进行评估。因此，RI2N/UDP通过使用…的双链路提供双倍带宽95%以上的效率。当两条链路中的一条发生故障时，通信流量会自动重定向到另一条链路，以提供用户透明的容错。在这种情况下，单链路系统也提供了95%以上的效率。在对VFREC-Net的评估中，我们可以用普通廉价的二层以太网交换机和我们的软件来构建多级胖树结构。在可伸缩性测试中，我们将软件移植到另一个有节点的平台上，并验证了有四条上行链路的胖树提供了四倍的带宽，可以扩展到成千上万的PC集群节点，最终在研究的最后阶段，我们可以成功地将两种技术结合起来，为高性能计算的高性价比PC集群提供高带宽、可靠和可扩展的互联解决方案。这三个功能对于大规模高性能计算来说是必不可少的，我们在本研究中证明了只有使用所开发的驱动程序和通信库控制的低价格千兆以太网和二层交换机才是可能的。较少