Collaborative Research:EAGER:Large-Scale Distributed Scientific Experiments on Shared Substrate

下一代分布式系统在分布式计算资源的可用性方面将有一个巨大的提升，因此它们的成功在很大程度上将依赖于下一代互联网，以便能够为这些极端分布式的环境提供足够的多样化网络支持。科学应用，从大学和研究机构内的私有云到由各种网格资源组成的科学云，如超级计算中心等，以及商业云，如亚马逊、GoGrid、Rackspace等，代表着高度分布式的应用环境，将从底层网络底层的相当多样化中获得巨大好处。下一代互联网应该允许多个分组交换网络环境在共享的底层共存。允许每个环境独立地优化其特定环境，而不会对其他共存网络环境的性能产生不利影响。为此，首席调查人员(PI)提出了弹性管道、？用于互联网的动态、按需、端到端的基础设施配置层。弹性管道借鉴了弹性云，这是一种按需、动态、计算资源租赁的架构，被各种云计算平台所普及。然而，弹性管道概念背后的主要动机是为实现多个独立的、特定于需求的？增加架构支持。网络环境在当前互联网的多域共享基础设施上共存。？隔离？因为它适用于提议的设计，所以不同于虚拟化？基于PI施加的两个基本设计约束的机制：c1。必须保留本征基础设施中的基本数据包处理规则。C2。独立的路由域(通常称为自治系统(AS))需要被允许控制和优化它们各自的网络。该项目是一种新的面向对象的互联网体系结构的概念验证实施。这一实施预计将导致对绩效指标背后的基本原则进行彻底的可行性研究？下一代互联网的架构理念。此外，弹性管道抽象本身是一个独立的模块，可以在当前的Internet上增量地实现，以提供巨大的收益，使目前僵化的？PI使用大规模科学实验的特定用例上下文来演示我们的体系结构的主张。大规模分布式科学实验由地理上分散的科学家、使用专用网络资源的科学设备组成。这种专门的设施会产生巨大的安装成本和时间，需要通过足够的长期使用来摊销。因此，大型科学实验是多需求特定网络环境的完美用例。更广泛的影响建议的研究可以作为下一代互联网体系结构的基础，该体系结构将通过为特定应用动态配置和创建特定需求的网络环境，允许多个组织之间自然共享资源。该奖项下的工作将开发弹性管的原型。有可能改变所有分布式计算的基本范例的抽象。此外，设计上的基本约束是否允许PI的增量部署？想法带到现在的互联网上。PI计划在Globecom、Infocom和SIGCOMM等领先的商业和网络会议上组织特别会议，该项目的成果将被整合到两所大学的网络架构研究生课程中。

The next generation of distributed systems is slated for a huge ramp-up in terms of availability of distributed compute resources and thus shall largely depend for their success on the next generation Internet to be able to offer enough diversified network support for these extremely distributed contexts. Scientific applications, on consolidated resources ranging from private clouds within universities and research organizations, science clouds consisting of various grid resources such as supercomputing centers etc, and commercial clouds such as Amazon, GoGrid, Rackspace, etc, represent a highly distributed application context that shall hugely benefit from considerable diversification of the underlying network substrate.The next generation Internet should allow multiple packet switching network contexts to co-exist over a shared substrate. Each context is allowed to independently optimize its specific context without adversely affecting the performance of other co-located network contexts. To that end, the principal investigators (PIs) present ?elastic pipes,? a dynamic, on-demand, end-to-end, infrastructure-provisioning layer for the Internet. Elastic pipes borrow themselves from elastic clouds, an on demand, dynamic, compute resource leasing architecture popularized by various cloud computing platforms. However, the primary motivation behind the elastic pipe concept is to add architectural support for the realization of multiple isolated ?requirement specific? networking contexts to co-exist over the multi-domain shared infrastructure of the current Internet. ?Isolation? as it applies to the proposed design is different from that in ?virtualization? mechanisms based on two fundamental design constraints that the PIs have imposed:C1. The fundamental packet processing discipline in the native infrastructure has to be preserved.C2. Independent routing domains (commonly known as Autonomous Systems (AS) need to be allowed to control and optimize their individual networks.This project is a proof-of-concept implementation of a new object oriented Internet architecture. This implementation is expected to result in a thorough feasibility study of the basic principles behind the PIs? architectural ideas for the next generation Internet. Additionally, the elastic pipe abstraction is in itself an independent module that can be incrementally implemented over the present Internet to provide huge gains in terms of diversification of the presently ?ossified? Internet.The PIs use the specific use-case context of large scale scientific experimentation to demonstrate the claims of our architecture. Large scale distributed scientific experiments consist of geographically spread out scientists, scientific installations using dedicated networking resources. Such specialized facilities incur huge setup costs and time that need to be amortized through sufficient long term usage. Large scale scientific experiments thus serve as the perfect use case for multiple ?requirement specific networking contexts.?Broader ImpactThe proposed research may serve as a basis of a next generation Internet architecture that will allow natural sharing of resources among multiple organizations by dynamically configuring and creating a requirement specific network context for a particular application. Work under this award will develop the primitives of the ?elastic pipes? abstraction that has the potential to change the basic paradigm of all distributed computing. Also, the basic constraints placed on the design allow an incremental deployment of the PIs? ideas to the present Internet. The PIs plan to organize special sessions at leading business and networking conferences, such as Globecom, Infocom, and SIGCOMM and the results of this project will be integrated in graduate courses on networking architecture at the two universities.