Collaborative Research:EAGER:Large-Scale Distributed Scientific Experiments on Shared Substrate

合作研究：EAGER：共享基质上的大规模分布式科学实验

• 批准号: 1019120
• 负责人: Arjan Durresi
• 金额: $ 9.95万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-02-15 至 2015-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1019120&HistoricalAwards=false
• 关键词: Collaborative; Research; EAGER; Large; Scale

The next generation of distributed systems is slated for a huge ramp-up in terms of availability of distributed compute resources and thus shall largely depend for their success on the next generation Internet to be able to offer enough diversified network support for these extremely distributed contexts. Scientific applications, on consolidated resources ranging from private clouds within universities and research organizations, science clouds consisting of various grid resources such as supercomputing centers etc, and commercial clouds such as Amazon, GoGrid, Rackspace, etc, represent a highly distributed application context that shall hugely benefit from considerable diversification of the underlying network substrate.The next generation Internet should allow multiple packet switching network contexts to co-exist over a shared substrate. Each context is allowed to independently optimize its specific context without adversely affecting the performance of other co-located network contexts. To that end, the principal investigators (PIs) present ?elastic pipes,? a dynamic, on-demand, end-to-end, infrastructure-provisioning layer for the Internet. Elastic pipes borrow themselves from elastic clouds, an on demand, dynamic, compute resource leasing architecture popularized by various cloud computing platforms. However, the primary motivation behind the elastic pipe concept is to add architectural support for the realization of multiple isolated ?requirement specific? networking contexts to co-exist over the multi-domain shared infrastructure of the current Internet. ?Isolation? as it applies to the proposed design is different from that in ?virtualization? mechanisms based on two fundamental design constraints that the PIs have imposed:C1. The fundamental packet processing discipline in the native infrastructure has to be preserved.C2. Independent routing domains (commonly known as Autonomous Systems (AS) need to be allowed to control and optimize their individual networks.This project is a proof-of-concept implementation of a new object oriented Internet architecture. This implementation is expected to result in a thorough feasibility study of the basic principles behind the PIs? architectural ideas for the next generation Internet. Additionally, the elastic pipe abstraction is in itself an independent module that can be incrementally implemented over the present Internet to provide huge gains in terms of diversification of the presently ?ossified? Internet.The PIs use the specific use-case context of large scale scientific experimentation to demonstrate the claims of our architecture. Large scale distributed scientific experiments consist of geographically spread out scientists, scientific installations using dedicated networking resources. Such specialized facilities incur huge setup costs and time that need to be amortized through sufficient long term usage. Large scale scientific experiments thus serve as the perfect use case for multiple ?requirement specific networking contexts.?Broader ImpactThe proposed research may serve as a basis of a next generation Internet architecture that will allow natural sharing of resources among multiple organizations by dynamically configuring and creating a requirement specific network context for a particular application. Work under this award will develop the primitives of the ?elastic pipes? abstraction that has the potential to change the basic paradigm of all distributed computing. Also, the basic constraints placed on the design allow an incremental deployment of the PIs? ideas to the present Internet. The PIs plan to organize special sessions at leading business and networking conferences, such as Globecom, Infocom, and SIGCOMM and the results of this project will be integrated in graduate courses on networking architecture at the two universities.

下一代分布式系统在分布式计算资源的可用性方面将有巨大的提升，因此它们在下一代互联网上的成功将在很大程度上取决于能够为这些极端分布式的上下文提供足够多样化的网络支持。科学应用程序，在整合的资源上，从大学和研究机构内的私有云，由各种网格资源组成的科学云，如超级计算中心等，以及商业云，如Amazon，GoGrid，Rackspace等，代表了一个高度分布式的应用环境，这将极大地受益于底层网络基底的相当大的多样化。下一代互联网应该允许多个分组切换网络上下文以在共享基底上共存。允许每个上下文独立地优化其特定上下文，而不会对其他共置网络上下文的性能产生不利影响。为此，主要研究者（PI）出席？弹性管，？一个动态的、按需的、端到端的互联网基础设施配置层。弹性管道借用了弹性云，弹性云是一种随需应变、动态的计算资源租赁架构，在各种云计算平台上流行。然而，弹性管道概念背后的主要动机是为实现多个孤立的？具体要求？联网上下文在当前互联网的多域共享基础设施上共存。?隔离？因为它适用于拟议的设计是不同的？虚拟化？基于PI施加的两个基本设计约束的机制：C1.在本地基础设施中的基本数据包处理规则必须被保留。独立的路由域（通常称为自治系统（AS））需要被允许控制和优化它们各自的网络。这个项目是一个新的面向对象的互联网架构的概念验证实现。这一实施预计将导致对PI背后的基本原则进行彻底的可行性研究？下一代互联网的架构思想。此外，弹性管道抽象本身是一个独立的模块，可以在目前的互联网上逐步实现，以提供巨大的收益，在多样化的目前？僵化？PI使用大规模科学实验的特定用例上下文来演示我们架构的声明。大规模分布式科学实验包括地理上分散的科学家，使用专用网络资源的科学设施。这种专门设施产生巨大的设置成本和时间，需要通过足够的长期使用来摊销。因此，大规模的科学实验是多个？要求特定的网络环境。更广泛的影响-拟议的研究可能会作为下一代互联网架构，将允许多个组织之间的自然资源共享的基础上，通过动态配置和创建一个特定的应用程序的要求特定的网络环境。根据这项奖励的工作将开发的原始？弹性管？抽象，有可能改变所有分布式计算的基本范式。此外，对设计的基本约束允许PI的增量部署？到现在的互联网。项目执行员计划在诸如Globecom、Infocom和SIGCOMM等主要商业和联网会议上组织特别会议，该项目的成果将纳入两所大学的联网结构研究生课程。