Using XDMoD to facilitate XSEDE operations, planning and analysis
Using XDMoD to facilitate XSEDE operations, planning and analysis
复制标题
使用 XDMoD 促进 XSEDE 操作、规划和分析
DOI：
10.1145/2484762.2484763
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
Gentner, Ryan J.
中科院分区：
文献类型：
--
作者：
Furlani, Thomas R.;Schneider, Barry L.;Jones, Matthew D.;Towns, John;Hart, David L.;Gallo, Steven M.;DeLeon, Robert L.;Lu, Charng-Da;Ghadersohi, Amin;Gentner, Ryan J.
XDMoD 审核工具首次提供了一个综合工具来衡量高端网络基础设施 (CI) 的利用率和性能，最初重点关注 XSEDE。在这里，我们通过几个案例研究展示了它在提供有关 TeraGrid/XSEDE 资源利用率和性能的重要指标方面的实用性，这些指标可用于详细分析和规划以及提高运营效率和性能。测量 XSEDE 等高端网络基础设施的利用率有助于详细了解给定 CI 资源的利用方式，并可以提高资源在作业吞吐量或任何方面的性能。 所需工作特征的数量。在此考虑的案例研究中，使用 XDMoD 对 XSEDE 使用数据进行的详细历史分析清楚地表明了用户数量、总体使用情况以及常规执行的模拟规模的巨大增长。毫不奇怪，物理、化学和工程学科被证明是资源的大量使用者。然而，正如数据清楚地显示的那样，分子生物科学现在是 XSEDE 资源的重要且不断增长的用户，占 2012 年所有 SU 消耗量的 20% 以上。XDMoD 表明，各个科学学科所需的资源非常不同。物理学、天文学和大气科学倾向于解决需要许多核心的大问题。另一方面，分子生物科学应用需要许多周期，但不使用如此大的核心数量。这些区别对于指导未来的网络基础设施设计决策非常重要。XDMoD 实施了一种新颖的基于应用程序内核的审核系统，用于衡量 CI 系统的整体性能和服务质量，通过几个示例，提供了一种自动检测性能不佳的硬件和软件的有用方法。考虑到当今先进 CI 的复杂组成，此功能尤其重要。示例包括基于广泛使用的量子化学程序的应用程序内核，该程序发现了商业并行文件系统的 I/O 堆栈中的软件错误，该错误随后由供应商以软件补丁的形式修复，该补丁现已成为其标准版本的一部分。这个错误导致执行时间急剧增加以及彻底的作业失败，可能会在一段时间内被忽视，并且只有在实施 XDMoD 的应用程序内核套件时才被发现。
The XDMoD auditing tool provides, for the first time, a comprehensive tool to measure both utilization and performance of high-end cyberinfrastructure (CI), with initial focus on XSEDE. Here, we demonstrate, through several case studies, its utility for providing important metrics regarding resource utilization and performance of TeraGrid/XSEDE that can be used for detailed analysis and planning as well as improving operational efficiency and performance.Measuring the utilization of high-end cyberinfrastructure such as XSEDE helps provide a detailed understanding of how a given CI resource is being utilized and can lead to improved performance of the resource in terms of job throughput or any number of desired job characteristics. In the case studies considered here, a detailed historical analysis of XSEDE usage data using XDMoD clearly demonstrates the tremendous growth in the number of users, overall usage, and scale of the simulations routinely carried out. Not surprisingly, physics, chemistry, and the engineering disciplines are shown to be heavy users of the resources. However, as the data clearly show, molecular biosciences are now a significant and growing user of XSEDE resources, accounting for more than 20 percent of all SUs consumed in 2012. XDMoD shows that the resources required by the various scientific disciplines are very different. Physics, Astronomical sciences, and Atmospheric sciences tend to solve large problems requiring many cores. Molecular biosciences applications on the other hand, require many cycles but do not employ core counts that are as large. Such distinctions are important in guiding future cyberinfrastructure design decisions.XDMoD's implementation of a novel application kernel-based auditing system to measure overall CI system performance and quality of service is shown, through several examples, to provide a useful means to automatically detect under performing hardware and software. This capability is especially critical given the complex composition of today's advanced CI. Examples include an application kernel based on a widely used quantum chemistry program that uncovered a software bug in the I/O stack of a commercial parallel file system, which was subsequently fixed by the vendor in the form of a software patch that is now part of their standard release. This error, which resulted in dramatically increased execution times as well as outright job failure, would likely have gone unnoticed for sometime and was only uncovered as a result of implementation of XDMoD's suite of application kernels.
登录
查看更多内容
HPC 资源能力和项目使用情况的深入而广泛的指标
DOI：
10.1145/2063348.2063350
发表时间：
2011
期刊：
2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC)
影响因子：
--
作者：
David L. Hart
通讯作者：
David L. Hart
美国国防部高性能计算现代化计划的持续系统性能监控
DOI：
10.1145/2063348.2063352
发表时间：
2011
期刊：
2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC)
影响因子：
--
作者：
P. Bennett
通讯作者：
P. Bennett
Inca 测试工具和报告框架
DOI：
10.1109/sc.2004.56
发表时间：
2004
期刊：
Proceedings of the ACM/IEEE SC2004 Conference
影响因子：
--
作者：
Shava Smallen;C. Olschanowsky;Kate Ericson;P. Beckman;J. Schopf
通讯作者：
J. Schopf
利用 PEAK 在 XSEDE 资源上实现更好的性能
影响因子：
3.8
作者：
B. Hadri;Haihang You;S. Moore
通讯作者：
S. Moore
测量 TeraGrid：高性能计算联盟的工作负载特征
DOI：
--
发表时间：
2011
期刊：
The international journal of high performance computing applications
影响因子：
--
作者：
David L. Hart
通讯作者：
David L. Hart