XRootd, disk-based, caching proxy for optimization of data access, data placement and data replication
XRootd, disk-based, caching proxy for optimization of data access, data placement and data replication
复制标题
DOI：
10.1088/1742-6596/513/4/042044
复制
发表时间：
2014-06
期刊：
影响因子：
--
通讯作者：
L. Bauerdick;K. Bloom;B. Bockelman;D. Bradley;S. Dasu;J. Dost;I. Sfiligoi;A. Tadel;M. Tadel;F. Wuerthwein;A. Yagil
中科院分区：
文献类型：
--
作者：
L. Bauerdick;K. Bloom;B. Bockelman;D. Bradley;S. Dasu;J. Dost;I. Sfiligoi;A. Tadel;M. Tadel;F. Wuerthwein;A. Yagil
随着基于XRootd的美国CMS数据联盟的成功，AAA项目通过开发两个XRootd、基于磁盘的缓存代理的样例实现来研究联邦体系结构的扩展。第一种方法简单地在接收到文件打开请求后立即开始获取整个文件，并且适用于预期完全随机的文件访问或者已经知道要读取整个文件的情况。第二种实现支持按需下载部分文件。Hadoop分布式文件系统的扩展已经开发，允许在本地HDFS存储无法提供请求的数据块时立即回退到网络访问。这两种缓存实现都在加州大学圣迭戈分校进行生产前测试。
Following the success of the XRootd-based US CMS data federation, the AAA project investigated extensions of the federation architecture by developing two sample implementations of an XRootd, disk-based, caching proxy. The first one simply starts fetching a whole file as soon as a file open request is received and is suitable when completely random file access is expected or it is already known that a whole file be read. The second implementation supports on-demand downloading of partial files. Extensions to the Hadoop Distributed File System have been developed to allow for an immediate fallback to network access when local HDFS storage fails to provide the requested block. Both cache implementations are in pre-production testing at UCSD.