STI: Multi-Gbps TCP: Data Intensive Networks for Science & Engineering

该项目将开发和部署“Multi-Gbps TCP”，以实现跨共享网络的Terascale数据传输，用于数据密集型科学和工程。这建立在加州理工学院多年理论发展和深入模拟的基础上。测试，优化和部署将使用区域，国家和跨洋研究和生产网络完成，这些网络可供加州理工学院高能物理（HEP）集团及其在Abilene，DataTAG，Starlight-CERN-SURFNet“波长三角形”，TeraGrid，AMPATH，CANARIE，CalREN和太平洋轻轨的合作伙伴使用（在某些情况下由其共同管理和运营）。与IETF、ISOC和GGF合作，并在项目过程中提交适当的RFC和文档，将确保开发的新技术是现有标准的一致扩展，并可供全球研究界使用。（主动队列管理）方案，具有丢失恢复调整，随着网络容量、大小和负载的增加，保持稳定性、高利用率和可忽略的丢失和延迟。我们的目标是验证和部署这些技术在HEP网络，TeraGrid和其他美国骨干网，包括Abilene，ESnet，CalREN，和MREN.It是众所周知的，TCP探测可用容量的加法-增加-乘法-减少策略表现不佳，在大窗口大小，由于严重的动态和平衡问题。 这些问题必须解决，以规模TCP的高带宽制度。支持者已经开发了一种数学理论，提供了对当前协议的基本理解，并暴露了它们在高延迟，高容量环境中的稳定性问题，并导出了一类新的TCP / AQM算法来解决这些问题。这项工作的核心是使用正确的缩放来补偿延迟，容量和路由。幸运的是，网络结构是这样的，有足够的信息允许以分布式和分散的方式应用正确的扩展，同时保持与当前协议的兼容性。这些新的算法，与TCP恢复调整，将自动重新调整参数，以保持稳定性和优化性能的容量，延迟，路由或loads.In模拟的新算法在ns-2和已达到98%的利用率与小于100个数据包的均衡队列（0.08 ms的排队延迟）。在这个项目中，我们将在全球HEP研究和生产网络中实现和演示这些算法。此外，还将与标准机构合作，以帮助推动新兴标准的发展，并与网格软件开发人员合作，以部署这些标准。该项目将利用Low和Doyle在TCP/AQM方面的理论工作，以及邦恩和纽曼在HEP国际网络开发和运营方面的领导能力和经验（和更广泛的科学界）在过去20年中，以及广泛的基础设施的HEP网络，使迅速的影响。该项目的成功不仅将使HEP社区直接受益，而且将首次有效使用网格、全球分布式Terascale计算和分布式Petascale数据库，从而影响多个领域的研究方法。NSF认识到传输1018字节（EB）的数据文件非常重要。这个项目解决了如何在真实的操作中做到这一点的问题。

The project will develop and deploy "Multi-Gbps TCP" to enable Terascale data transfers across shared networks for data intensive science and engineering. This builds on a foundation of several years of theoretical development and in-depth simulations at Caltech. The testing, optimization and deployment will be accomplished using the regional, national and transoceanic research and production networks available to (and in some cases co-managed and operated by) the Caltech High Energy Physics (HEP) group together with their partners in Abilene, DataTAG, the Starlight-CERN-SURFNet "wavelength triangle", TeraGrid, AMPATH, CANARIE, CalREN and Pacific Light Rail. Work with IETF, ISOC and GGF, and submission of appropriate RFCs and documents during the course of the project, will ensure that the new techniques developed are consistent extensions of existing standards, and available to the worldwide research community.The goal of this project is to develop practical TCP and AQM (Active Queue Management) schemes, with loss recovery tuning, that maintain stability, high utilization and negligible loss and delay as the network increases in capacity, size, and load. We aim to validate and deploy these techniques on HEP networks, the TeraGrid and other US backbones including Abilene, ESnet, CalREN, and MREN.It is well-known that the additive-increase-multiplicative-decrease strategy with which TCP probes available capacity performs poorly at large window sizes due to serious dynamic and equilibrium problems. These problems must be solved to scale TCP to the high bandwidth regime. The proponents have developed a mathematical theory that provides a fundamental understanding of the current protocols and exposes their stability problems in high latency, high capacity environments and derived a new class of TCP / AQM algorithms that solve these problems. The central thrust of this work is to compensate for delay, capacity, and routing using the correct scaling. Fortunately, the network structure is such that there is sufficient information to allow the right scaling to be applied in a distributed and decentralized manner, while remaining compliant with the current protocol. These new algorithms, with TCP recovery tuning, will automatically rescale the parameters so as to maintain stability and optimize performance as capacity, delay, routing or loads change.In simulation the new algorithms in ns-2 and have achieved 98% utilization with an equilibrium queue of less than 100 packets (0.08 ms queuing delay). In this project, we will implement and demonstrate these algorithms in the global HEP research and production networks. In addition, work will occur with both with the standards bodies to help drive emerging standards, and with Grid software developers to deploy them.The project will leverage the theoretical work on TCP/AQM of Low and Doyle, the leadership and experience of Bunn and Newman in the development and operation of the international network for HEP (and the broader scientific community) over the last 20 years, and the extensive infrastructure of HEP networks to make a quick impact. The project's success will not only benefit directly the HEP community, but will influence research methods in several fields, by enabling the effective use of Grids, globally distributed Terascale computing, and distributed Petascale databases for the first time.NSF recognizes that transfers of data files of 1018 bytes (exabytes) is important. This project addresses the issue of how to do this in real operations.