High speed scientific data transfers using software defined networking
High speed scientific data transfers using software defined networking
复制标题
使用软件定义网络进行高速科学数据传输
DOI：
--
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
J. Bunn
中科院分区：
文献类型：
--
作者：
H. Newman;A. Mughal;D. Kcira;I. Legrand;R. Voicu;J. Bunn
全球分布的科学合作获取、模拟、处理和分析的海量数据量继续呈指数级增长。一个典型的例子是大型强子对撞机项目，现在正处于第二个三年数据采集周期的开始，在以前无法到达的能量范围内寻找新的粒子和相互作用，仅在过去的12个月里，它的峰值数据传输速率就增长了70%。其他主要科学项目，如LSST和SKA，以及从地球观测到基因组学的其他学科，预计在未来十年内将有与LHC项目类似或更大的需求。如果这些计划要继续取得进展并实现其目标，就必须开发新的方法，在国家和全球范围内实现快速、高效和可靠的数据传输，以及新一代智能、软件驱动的网络，能够支持具有高容量和/或实时数据传输不同需求的多个科学计划。在本文中，我们描述了加州理工学院高能物理团队和合作者的活动，与使用软件定义网络有关，以帮助实现快速有效的数据分发和访问。超级计算2014年的成果与我们在实验项目的高级网络服务上的工作、开发下一代集成SDN架构的新项目以及我们在超级计算2015年的计划一起提出。
The massive data volumes acquired, simulated, processed and analyzed by globally distributed scientific collaborations continue to grow exponentially. One leading example is the LHC program, now at the start of its second three year data taking cycle, searching for new particles and interactions in a previously inaccessible range of energies, which has experienced a 70% growth in peak data transfer rates over the last 12 months alone. Other major science programs such as LSST and SKA, and other disciplines ranging from earth observation to genomics, are expected to have similar or great needs than the LHC program within the next decade. The development of new methods for fast, efficient and reliable data transfers over national and global distances, and a new generation of intelligent, software-driven networks capable of supporting multiple science programs with diverse needs for high volume and/or real-time data delivery, are essential if these programs are to continue to progress, and meet their goals. In this paper we describe activities of the Caltech High Energy Physics team and collaborators, related to the use Software Defined Networking to help achieve fast and efficient data distribution and access. Results from Supercomputing 2014 are presented together with our work on the Advanced Network Services for the Experiments project, and a new project developing a Next Generation Integrated SDN Architecture, as well as our plans for Supercomputing 2015.