HammerCloud: A Stress Testing System for Distributed Analysis
HammerCloud: A Stress Testing System for Distributed Analysis
复制标题
HammerCloud：分布式分析压力测试系统
DOI：
10.1088/1742-6596/331/7/072036
复制
发表时间：
2011
期刊：
影响因子：
--
通讯作者：
M. Paladin
中科院分区：
文献类型：
--
作者：
D. Ster;J. Elmsheuser;Mario Ubeda Garcia;M. Paladin
LHC 数据的分布式分析是一项 I/O 密集型活动，对远程计算设施的内部网络、存储和本地磁盘提出了很高的要求。因此，调试和维护站点以提供高效的分布式分析服务是一项挑战，可以通过帮助评估各种基础设施设计和配置的工具来辅助。 HammerCloud 就是这样的工具之一；它是一项压力测试服务，由中央运营团队、区域协调员和本地站点管理员使用，以 (a) 向多个站点提交任意数量的分析作业，(b) 将在测试站点上运行的预定数量的作业保持在稳定状态，(c) 生成基于网络的报告，总结测试站点的效率和性能，以及 (d) 提供历史测试结果的 Web 界面，以评估进度和比较站点。 HammerCloud 围绕分布式分析框架 Ganga 构建，利用其 API 进行网格作业管理。 HammerCloud 已被 ATLAS 实验用于对全球许多站点进行连续测试，并且还用于大规模计算挑战（例如 STEP'09 和 UAT'09），其中测试规模超过 10,000 个并发运行，在多天内的总作业数超过 1,000,000 个。另外，CMS实验正在采用HammerCloud； HammerCloud 的插件结构允许使用其官方工具 (CRAB) 执行 CMS 作业。
Distributed analysis of LHC data is an I/O-intensive activity which places large demands on the internal network, storage, and local disks at remote computing facilities. Commissioning and maintaining a site to provide an efficient distributed analysis service is therefore a challenge which can be aided by tools to help evaluate a variety of infrastructure designs and configurations. HammerCloud is one such tool; it is a stress testing service which is used by central operations teams, regional coordinators, and local site admins to (a) submit arbitrary number of analysis jobs to a number of sites, (b) maintain at a steady-state a predefined number of jobs running at the sites under test, (c) produce web-based reports summarizing the efficiency and performance of the sites under test, and (d) present a web-interface for historical test results to both evaluate progress and compare sites. HammerCloud was built around the distributed analysis framework Ganga, exploiting its API for grid job management. HammerCloud has been employed by the ATLAS experiment for continuous testing of many sites worldwide, and also during large scale computing challenges such as STEP'09 and UAT'09, where the scale of the tests exceeded 10,000 concurrently running and 1,000,000 total jobs over multi-day periods. In addition, HammerCloud is being adopted by the CMS experiment; the plugin structure of HammerCloud allows the execution of CMS jobs using their official tool (CRAB).
影响因子：
6.3
作者：
Moscicki, J. T.;Brochu, F.;Williams, M.
通讯作者：
Williams, M.
在 LHC 时代利用 Ganga 加强用户数据分析：可扩展性、监控和用户支持
DOI：
10.1088/1742-6596/331/7/072011
发表时间：
2011
期刊：
Conference Series
影响因子：
--
作者：
Elmsheuser J
通讯作者：
Elmsheuser J