Systematic benchmarking of HTTPS third party copy on 100Gbps links using XRootD
Systematic benchmarking of HTTPS third party copy on 100Gbps links using XRootD
复制标题
使用 XRootD 对 100Gbps 链路上的 HTTPS 第三方副本进行系统基准测试
DOI：
10.1051/epjconf/202125102001
复制
发表时间：
2021
影响因子：
--
通讯作者：
Bockelman, Brian
中科院分区：
文献类型：
--
作者：
Fajardo, Edgar;Arora, Aashay;Davila, Diego;Gao, Richard;Würthwein, Frank;Bockelman, Brian
高亮度大型强子对撞机提供了一个数据挑战。从实验中记录并传输到数百个地点的数据量将以每年30倍的速度增长。一种比较不同第三方复制（TPC）传输协议性能的系统方法出现了。两个竞争者XRootD-HTTPS和GridFTP在通过100Gbps接口将文件从一台服务器传输到另一台服务器时的性能进行了评估。基准测试是通过在Pacific Research Platform Kubernetes集群上调度pod来完成的，以确保结果的可再现性和可重复性。这为任何TPC传输协议的网络测试开辟了一条未来的途径。
The High Luminosity Large Hadron Collider provides a data challenge. The amount of data recorded from the experiments and transported to hundreds of sites will see a thirty fold increase in annual data volume. A systematic approach to contrast the performance of different Third Party Copy (TPC) transfer protocols arises. Two contenders, XRootD-HTTPS and the GridFTP are evaluated in their performance for transferring files from one server to another over 100Gbps interfaces. The benchmarking is done by scheduling pods on the Pacific Research Platform Kubernetes cluster to ensure reproducible and repeatable results. This opens a future pathway for network testing of any TPC transfer protocol.