A Trial Deployment of a Reliable Network-Multicast Application across Internet2

A Trial Deployment of a Reliable Network-Multicast Application across Internet2
复制标题

DOI:
10.1109/indis51933.2020.00008
复制
发表时间:
2020-11
期刊:
2020 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS)
影响因子:
--
通讯作者:
Yuanlong Tan;M. Veeraraghavan;Hwajung Lee;S. Emmerson;J. Davidson
Yuanlong Tan;M. Veeraraghavan;Hwajung Lee;S. Emmerson;J. Davidson
中科院分区:
其他
文献类型:
--
作者:
Yuanlong Tan;M. Veeraraghavan;Hwajung Lee;S. Emmerson;J. Davidson

文献摘要

相似文献

许多科学学科的一个持续趋势是,科学仪器收集的数据量不断增加,人们希望迅速有效地将这些数据分发给科学界。将这些大型数据集传输到地理上分布的研究社区会消耗大量的网络带宽。随着数据量和用户数量的增长,可靠的网络多播是一种有前途的方法,以减少所需的带宽的增长率,以支持有效的数据分发。在以前的工作中,我们确定了可靠的网络组播的需要:从事大气研究的科学家订阅气象文件流。具体而言,大学合作大气研究(UCAR)使用本地数据管理器(LDM)来传播数据。这项工作描述了一个多播功能的LDM,其中8个大学校园通过相应的区域研究和教育网络(REN)和Internet2连接的试验部署。使用此部署,我们评估了LDM的新版本LDM7,它使用具有可靠传输协议的网络多播,并利用第2层(L2)多点虚拟LAN(VLANIMPLS)。部署了一个性能监控系统来收集LDM7的实时性能,这表明我们的概念验证原型在两个方面明显优于当前的生产LDM LDM6:(i)LDM7可以比LDM6更快地分发文件流。在6个用户的情况下,使用100 Mbps的LDM7可以观察到近22倍的改进。以及(ii)为了实现类似的性能,LDM7显著降低了对带宽的需求,这比LDM6降低了约90%的带宽需求,以实现跨四个用户的20 Mbps平均吞吐量。
A continuing trend in many scientific disciplines is the growth in the volume of data collected by scientific instruments and the desire to rapidly and efficiently distribute this data to the scientific community. Transferring these large data sets to a geographically distributed research community consumes significant network bandwidth. As both the data volume and number of subscribers grows, reliable network multicast is a promising approach to reduce the rate of growth of the bandwidth needed to support efficient data distribution. In prior work, we identified a need for reliable network multicast: scientists engaged in atmospheric research subscribing to meteorological file-streams. Specifically, the University Cooperation Atmospheric Research (UCAR) uses the Local Data Manager (LDM) to disseminate data. This work describes a trial deployment of a multicast-enabled LDM, in which eight university campuses are connected via corresponding regional Research-and-Education Networks (RENs) and Internet2. Using this deployment, we evaluated the new version of LDM, LDM7, which uses network multicast with a reliable transport protocol, and leverages Layer-2 (L2) multipoint Virtual LAN (VLANIMPLS). A performance monitoring system was deployed to collect real-time performance of LDM7, which showed that our proof-of-concept prototype worked significantly better than the current production LDM, LDM6, in two ways: (i) LDM7 can distribute file streams faster than LDM6. With six subscribers, an almost 22-fold improvement was observed with LDM7 at 100 Mbps. And (ii) to achieve a similar performance, LDM7 significantly reduces the need for bandwidth, which reduced the bandwidth requirement by about 90% over LDM6 to achieve 20 Mbps average throughput across four subscribers.