High-performance reliable network-multicast over a trial deployment
High-performance reliable network-multicast over a trial deployment
复制标题
DOI：
10.1007/s10586-021-03519-6
复制
发表时间：
2022-02
期刊：
影响因子：
--
通讯作者：
Yuanlong Tan;M. Veeraraghavan;Hwajung Lee;S. Emmerson;J. Davidson
中科院分区：
文献类型：
--
作者：
Yuanlong Tan;M. Veeraraghavan;Hwajung Lee;S. Emmerson;J. Davidson
在许多科学学科中，一个持续的趋势是，科学仪器收集的数据量不断增长，并渴望迅速和有效地将这些数据分发给科学界。随着数据量和用户数量的增长，可靠的网络组播是一种很有前途的方法，可以缓解对带宽的需求，以支持向多个地理上分散的研究社区高效地分发数据。在之前的工作中，我们确定了对可靠的网络组播的需求：从事大气研究的科学家订阅气象文件流。一种名为本地数据管理器(LDM)的应用程序被用来向数百名订户传播气象数据。本文提出了一种高性能、可靠的网络组播解决方案--动态可靠文件流组播服务(DRFSM)，并描述了一个由8个大学校园通过研究和教育网络(RENS)和Internet2连接的试验部署，以及一个支持DRFSM的LDM(LDM7)。使用此部署，我们评估了DRFSM体系结构，该体系结构使用具有可靠传输协议的网络组播，并利用第2层(L2)多点虚拟局域网(VLAN/MPLS)。为了实时采集LDM7的性能，开发了一个性能监测系统。测量表明，我们的概念验证原型在两个方面明显好于当前生产的LDM(LDM6)。首先，LDM7的数据分发速度比LDM6更快。在6个订户和100 Mbps带宽限制设置的情况下，LDM7的交付时间几乎提高了22倍。其次，LDM7显著降低了向用户提供数据所需的带宽需求。要在四个用户之间实现20 Mbps的平均吞吐量，LDM7需要的带宽比LDM6少90%。
A continuing trend in many scientific disciplines is the growth in the volume of data collected by scientific instruments and the desire to rapidly and efficiently distribute this data to the scientific community. As both the data volume and number of subscribers grows, a reliable network multicast is a promising approach to alleviate the demand for the bandwidth needed to support efficient data distribution to multiple, geographically-distributed, research communities. In prior work, we identified the need for a reliable network multicast: scientists engaged in atmospheric research subscribing to meteorological file-streams. An application called Local Data Manager (LDM) is used to disseminate meteorological data to hundreds of subscribers. This paper presents a high-performance, reliable network multicast solution, Dynamic Reliable File-Stream Multicast Service (DRFSM), and describes a trial deployment comprising eight university campuses connected via Research-and-Education Networks (RENs) and Internet2 and a DRFSM-enabled LDM (LDM7). Using this deployment, we evaluated the DRFSM architecture, which uses network multicast with a reliable transport protocol, and leverages Layer-2 (L2) multipoint Virtual LAN (VLAN/MPLS). A performance monitoring system was developed to collect the real-time performance of LDM7. The measurements showed that our proof-of-concept prototype worked significantly better than the current production LDM (LDM6) in two ways. First, LDM7 distributes data faster than LDM6. With six subscribers and a 100 Mbps bandwidth limit setting, an almost 22-fold improvement in delivery time was observed with LDM7. Second, LDM7 significantly reduces the bandwidth requirement needed to deliver data to subscribers. LDM7 needed 90% less bandwidth than LDM6 to achieve a 20 Mbps average throughput across four subscribers.