Adapting Scienti c Work ows on Networked Clouds Using Proactive Introspection RADII : Bridging the Divide Between Data and Infrastructure Management to Suport Data-Driven Collaborations TR-1601

Adapting Scienti c Work ows on Networked Clouds Using Proactive Introspection RADII : Bridging the Divide Between Data and Infrastructure Management to Suport Data-Driven Collaborations TR-1601
复制标题

使用主动自省 RADII 调整网络云上的科学工作流程:弥合数据和基础设施管理之间的鸿沟以支持数据驱动的协作 TR-1601

DOI:
--
复制
发表时间:
2016
期刊:
影响因子:
--
通讯作者:
Charles Schmitt
Charles Schmitt
中科院分区:
--
文献类型:
--
作者:
C. Castillo;Charles Schmitt

文献摘要

被引文献

相似文献

我们目睹了国家网络基础设施资源的急剧增加,以支持数据驱动的研究。精心策划这些资源,以创建能够支持数据密集活动的协作基础架构。在这项工作中,我们介绍了Radii,这是一种新颖的体系结构和系统,可以通过集成的方式安排数据和基础架构管理来实现协作基础架构的配置和配置。我们还引入了跨层数据注释机制,该机制与软件定义的网络(SDN)支持一起允许将用户定义的性能策略嵌入到文件元数据中,并将其转换为可执行的最佳网络计划。通过实验,我们已经在全球生产测试台上部署了半径,与传统方法相比,半径可以将数据传输的网络吞吐量提高28.2%。关键字以DATA为中心的基础架构;网络基础设施;外生irods; SDN
We have witnessed a dramatic increase in national cyberinfrastructure resources to support data-driven research. Orchestrating these resources to enable the creation of collaborative infrastructure capable of supporting data intensive activities is challenging. In this work we present RADII, a novel architecture and system that enables the provisioning and configuration of collaborative infrastructure by orchestrating data and infrastructure management in an integrated manner. We also introduce a cross-layer data annotation mechanism that together with Software-Defined-Networking (SDN) support allows the embedding of user-defined performance policies into file metadata which are translated into executable optimal network plans. We have deployed RADII on a worldwide production testbed and demonstrated through experimentation that RADII can improve network throughput of data transfers by 28.2% as compared to conventional approaches. Keywords-data-centric infrastructure; cyberinfrastructure; ExoGENI; iRODS; SDN