Dynamically Creating Custom SDN High-Speed Network Paths for Big Data Science Flows

Dynamically Creating Custom SDN High-Speed Network Paths for Big Data Science Flows
复制标题

为大数据科学流程动态创建自定义 SDN 高速网络路径

DOI:
10.1145/3093338.3104155
复制
发表时间:
2017
期刊:
Practice & Experience in Advanced Research Computing Conference (PEARC 2017
影响因子:
--
通讯作者:
Fei, Zongming
Fei, Zongming
中科院分区:
--
文献类型:
--
作者:
Rivera, Sergio;Hayashida, Mami;Griffioen, James;Fei, Zongming

文献摘要

参考文献

被引文献

相似文献

现有校园网络基础设施的设计不能有效处理大数据集的传输。这些网络中的性能下降通常是由中间设备引起的-这些设备通过深入检查通过网络的所有流量(包括大数据传输)来执行校园范围的策略。我们正在为我们的校园网络开发软件定义网络(SDN)解决方案,通过动态计算绕过某些中间盒的路由来赠款科学流特权,以避免它们造成的瓶颈。使用SDN控制器提供的全局网络信息,我们正在开发图形数据库方法来计算自定义路径,这些自定义路径不仅绕过中间盒来实现某些要求(例如,等待时间、带宽、跳数),而且还插入逐跳修改分组的规则,以创建标准路由/转发的假象,而不管分组正在被重新路由的事实。在一些情况下,需要使用网络功能虚拟化(NFV)技术(例如,NAT)。为了确保路径计算是在拓扑的最新快照上运行的,我们引入了一种版本控制机制,该机制允许仅在发生“重要”网络更改并由大数据流请求时才进行延迟拓扑更新。
Existing campus network infrastructure is not designed to effectively handle the transmission of big data sets. Performance degradation in these networks is often caused by middleboxes -- appliances that enforce campus-wide policies by deeply inspecting all traffic going through the network (including big data transmissions). We are developing a Software-Defined Networking (SDN) solution for our campus network that grants privilege to science flows by dynamically calculating routes that bypass certain middleboxes to avoid the bottlenecks they create. Using the global network information provided by an SDN controller, we are developing graph databases approaches to compute custom paths that not only bypass middleboxes to achieve certain requirements (e.g., latency, bandwidth, hop-count) but also insert rules that modify packets hop-by-hop to create the illusion of standard routing/forward despite the fact that packets are being rerouted. In some cases, additional functionality needs to be added to the path using network function virtualization (NFV) techniques (e.g., NAT). To ensure that path computations are run on an up-to-date snapshot of the topology, we introduce a versioning mechanism that allows for lazy topology updates that occur only when "important" network changes take place and are requested by big data flows.
VIP 通道:授权流的高速自定义通信路径
DOI: 10.1109/icccn.2017.8038429
发表时间: 2017
期刊: 2017 26th International Conference on Computer Communication and Networks (ICCCN)
影响因子: --
作者:
James N. Griffioen;K. Calvert;Zongming Fei;Sergio Rivera;Jacob Chappell;M. Hayashida;Charles Carpenter;Yongwook Song;Hussamuddin Nasir
通讯作者: Hussamuddin Nasir
创建复杂的测试床网络来探索基于 SDN 的全校园科学 DMZ
DOI: --
发表时间: 2017
期刊: Conference on Computer Communications Workshops
影响因子: --
作者:
P. S. Rivera;Jacob Chappell;M. Hayashida;Andrew Groenewold;Peter Oostema;Caleb Voss;Hussamuddin Nasir;Charles Carpenter;Yongwook Song;Zongming Fei;J. Griffioen
通讯作者: J. Griffioen