Any Data, Any Time, Anywhere: Global Data Access for Science

Any Data, Any Time, Anywhere: Global Data Access for Science
复制标题

任何时间、任何地点的任何数据:科学的全球数据访问

DOI:
10.1109/bdc.2015.33
复制
发表时间:
2015
期刊:
2015 IEEE/ACM 2nd International Symposium on Big Data Computing (BDC)
影响因子:
--
通讯作者:
M. Zvada
M. Zvada
中科院分区:
--
文献类型:
--
作者:
K. Bloom;T. Boccali;B. Bockelman;D. Bradley;S. Dasu;J. Dost;F. Fanzago;I. Sfiligoi;A. Tadel;M. Tadel;C. Vuosalo;F. Würthwein;A. Yagil;M. Zvada

文献摘要

被引文献

相似文献

数据访问是分布式高吞吐量计算(DHTC)驱动的科学的关键,DHTC是许多重大研究项目(如高能物理(HEP)实验)的关键技术。然而,当涉及许多独立的存储站点时,实现有效的数据访问变得相当困难,因为用户需要学习访问每个系统的复杂性并仔细跟踪数据位置。我们提出了一种替代方法:任何数据,任何时间,任何地方的基础设施。结合几个现有的软件产品,AAA提供了一个全球性的,统一的存储系统视图-一个“数据联合”,一个用于软件交付的全球文件系统,以及一个工作流管理系统。我们介绍了如何一个HEP实验,紧凑μ子螺线管(CMS),是利用AAA的基础设施和一些简单的性能指标。
Data access is key to science driven by distributed high-throughput computing (DHTC), an essential technology for many major research projects such as High Energy Physics (HEP) experiments. However, achieving efficient data access becomes quite difficult when many independent storage sites are involved because users are burdened with learning the intricacies of accessing each system and keeping careful track of data location. We present an alternate approach: the Any Data, Any Time, Anywhere infrastructure. Combining several existing software products, AAA presents a global, unified view of storage systems - a "data federation," a global filesystem for software delivery, and a workflow management system. We present how one HEP experiment, the Compact Muon Solenoid (CMS), is utilizing the AAA infrastructure and some simple performance metrics.