Collaborative Research:EAGER:Large-Scale Distributed Scientific Experiments on Shared Substrate

下一代分布式系统将在分布式计算资源的可用性方面有一个巨大的提升，因此将在很大程度上依赖于下一代Internet的成功，从而能够为这些极端分布式的环境提供足够多样化的网络支持。科学应用基于整合资源，包括大学和研究机构内部的私有云，由各种网格资源（如超级计算中心等）组成的科学云，以及Amazon、GoGrid、Rackspace等商业云，它们代表了高度分布式的应用环境，将极大地受益于底层网络基板的相当多样化。下一代互联网应该允许多个分组交换网络上下文在共享的基板上共存。允许每个上下文独立地优化其特定上下文，而不会对其他同址网络上下文的性能产生不利影响。为此，首席调查员（pi）出席？弹性管道、?一个动态的、随需应变的、端到端的互联网基础设施供应层。弹性管道借用了弹性云，弹性云是一种随需应变的、动态的、计算资源租赁的架构，被各种云计算平台所推广。然而，弹性管道概念背后的主要动机是为实现多个隔离？要求特定的吗?在当前Internet的多域共享基础设施上共存的网络环境。？隔离?由于它适用于所建议的设计，因此与虚拟化中的设计不同。基于pi施加的两个基本设计约束的机制：本机基础设施中的基本包处理规则必须保留。需要允许独立的路由域（通常称为自治系统（as））控制和优化它们各自的网络。这个项目是一个新的面向对象的互联网架构的概念验证实现。预计这一实施将导致对pi背后的基本原则进行彻底的可行性研究。下一代互联网的架构思想。此外，弹性管道抽象本身就是一个独立的模块，可以在当前的Internet上增量实现，从而在当前僵化的业务多样化方面提供巨大的收益。互联网。pi使用大规模科学实验的特定用例上下文来演示我们架构的要求。大规模的分布式科学实验由地理上分散的科学家组成，科学装置使用专用的网络资源。这种专门的设施会产生巨大的安装成本和时间，需要通过足够的长期使用来摊销。因此，大规模的科学实验就成为了multiple ？需求特定的网络环境。更广泛的影响提议的研究可以作为下一代互联网体系结构的基础，该体系结构将通过动态配置和为特定应用程序创建特定需求的网络上下文，允许多个组织之间自然地共享资源。在这个奖项下的工作将发展？弹性管道?有可能改变所有分布式计算的基本范式的抽象。此外，设计上的基本约束允许pi的增量部署。和现在的互联网。两所大学计划在Globecom、Infocom、SIGCOMM等主要企业及网络会议上举办特别会议，并将其成果整合到两所大学的网络架构研究生课程中。

The next generation of distributed systems is slated for a huge ramp-up in terms of availability of distributed compute resources and thus shall largely depend for their success on the next generation Internet to be able to offer enough diversified network support for these extremely distributed contexts. Scientific applications, on consolidated resources ranging from private clouds within universities and research organizations, science clouds consisting of various grid resources such as supercomputing centers etc, and commercial clouds such as Amazon, GoGrid, Rackspace, etc, represent a highly distributed application context that shall hugely benefit from considerable diversification of the underlying network substrate.The next generation Internet should allow multiple packet switching network contexts to co-exist over a shared substrate. Each context is allowed to independently optimize its specific context without adversely affecting the performance of other co-located network contexts. To that end, the principal investigators (PIs) present ?elastic pipes,? a dynamic, on-demand, end-to-end, infrastructure-provisioning layer for the Internet. Elastic pipes borrow themselves from elastic clouds, an on demand, dynamic, compute resource leasing architecture popularized by various cloud computing platforms. However, the primary motivation behind the elastic pipe concept is to add architectural support for the realization of multiple isolated ?requirement specific? networking contexts to co-exist over the multi-domain shared infrastructure of the current Internet. ?Isolation? as it applies to the proposed design is different from that in ?virtualization? mechanisms based on two fundamental design constraints that the PIs have imposed:C1. The fundamental packet processing discipline in the native infrastructure has to be preserved.C2. Independent routing domains (commonly known as Autonomous Systems (AS) need to be allowed to control and optimize their individual networks.This project is a proof-of-concept implementation of a new object oriented Internet architecture. This implementation is expected to result in a thorough feasibility study of the basic principles behind the PIs? architectural ideas for the next generation Internet. Additionally, the elastic pipe abstraction is in itself an independent module that can be incrementally implemented over the present Internet to provide huge gains in terms of diversification of the presently ?ossified? Internet.The PIs use the specific use-case context of large scale scientific experimentation to demonstrate the claims of our architecture. Large scale distributed scientific experiments consist of geographically spread out scientists, scientific installations using dedicated networking resources. Such specialized facilities incur huge setup costs and time that need to be amortized through sufficient long term usage. Large scale scientific experiments thus serve as the perfect use case for multiple ?requirement specific networking contexts.?Broader ImpactThe proposed research may serve as a basis of a next generation Internet architecture that will allow natural sharing of resources among multiple organizations by dynamically configuring and creating a requirement specific network context for a particular application. Work under this award will develop the primitives of the ?elastic pipes? abstraction that has the potential to change the basic paradigm of all distributed computing. Also, the basic constraints placed on the design allow an incremental deployment of the PIs? ideas to the present Internet. The PIs plan to organize special sessions at leading business and networking conferences, such as Globecom, Infocom, and SIGCOMM and the results of this project will be integrated in graduate courses on networking architecture at the two universities.