Using automated performance modeling to find scalability bugs in complex codes

Using automated performance modeling to find scalability bugs in complex codes
复制标题

使用自动化性能建模来查找复杂代码中的可扩展性错误

DOI:
10.1145/2503210.2503277
复制
发表时间:
2013
期刊:
2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC)
影响因子:
--
通讯作者:
Hoefler
Hoefler
中科院分区:
--
文献类型:
--
作者:
Calotoiu;Hoefler

文献摘要

参考文献

被引文献

相似文献

许多并行应用程序存在潜在的性能限制,这些限制可能会阻止它们扩展到更大的机器规模。通常,这样的可伸缩性错误只有在实际尝试扩展代码时才会显现出来——这是很难进行补救的地方。然而,创建分析性能模型以允许更早地确定此类问题是非常费力的,因此应用程序开发人员最多只能针对几个选定的内核进行尝试,从而冒着错过有害瓶颈的风险。在本文中,我们将展示如何有效地改进这种可伸缩性分析的覆盖范围和速度。为并行程序的每个部分自动生成一个经验性能模型,我们可以很容易地识别那些在较大的核心计数下会降低性能的部分。以气候模拟为例,我们证明了可扩展性缺陷并不局限于通常选择作为内核的那些例程。
Many parallel applications suffer from latent performance limitations that may prevent them from scaling to larger machine sizes. Often, such scalability bugs manifest themselves only when an attempt to scale the code is actually being made---a point where remediation can be difficult. However, creating analytical performance models that would allow such issues to be pinpointed earlier is so laborious that application developers attempt it at most for a few selected kernels, running the risk of missing harmful bottlenecks. In this paper, we show how both coverage and speed of this scalability analysis can be substantially improved. Generating an empirical performance model automatically for each part of a parallel program, we can easily identify those parts that will reduce performance at larger core counts. Using a climate simulation as an example, we demonstrate that scalability bugs are not confined to those routines usually chosen as kernels.
并行和分布式计算系统的性能建模和预测:现有技术的调查
DOI: 10.1109/cisis.2007.49
发表时间: 2007
期刊: First International Conference on Complex, Intelligent and Software Intensive Systems (CISIS'07)
影响因子: --
作者:
Sabri Pllana;I. Brandić;S. Benkner
通讯作者: S. Benkner
MILC 晶格 QCD 应用的性能建模和比较分析 su3_rmd
DOI: 10.1109/ccgrid.2012.123
发表时间: 2012
期刊: 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
影响因子: --
作者:
G. Bauer;S. Gottlieb;T. Hoefler
通讯作者: T. Hoefler
超大规模分布式系统上波前算法的性能分析
DOI: --
发表时间: 1998
期刊: Wide Area Networks and High Performance Computing
影响因子: --
作者:
A. Hoisie;O. Lubeck;H. Wasserman
通讯作者: H. Wasserman
对在 PB 级机器上使用 PB 内存的模拟应用程序的初步研究
DOI: --
发表时间: 2008
期刊:
影响因子: --
作者:
Chao Mei
通讯作者: Chao Mei
DOI: --
发表时间: 1994
期刊: 1994 International Conference on Parallel Processing Vol. 3
影响因子: --
作者:
E. Boyd;W. Azeem;H. Lee;Tien;Shih;E. Davidson
通讯作者: E. Davidson