ExCALIBUR HES Benchmarking for Performance Portable Applications

ExCALIBUR HES 便携式应用性能基准测试

• 批准号: EP/X031829/1
• 负责人: Tuomas Koskela
• 金额: $ 26.84万
• 依托单位: University College London
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2023
• 资助国家: 英国
• 起止时间: 2023 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FX031829%2F1
• 关键词: ExCALIBUR; HES; Benchmarking; Performance; Portable

Application benchmarking is a crucial activity in the UK's path to Exascale. It ensures future Exascalesystems are understood by the community so that UK Science Applications, particularly thosedeveloped as part of ExCALIBUR, can take advantage of the scientific opportunities at Exascale. Linearsolvers are a ubiquitous pattern in many ExCALIBUR codes, and this project will develop a suitablebenchmark applicable to many of UK codes. Application benchmarks are part of the enabling softwarestack that allows the performance of hardware to be assessed for scientific workloads .It is vital to rigorously measure the performance of benchmarks in a systematic way to enhance thetransparency and enable reproducibility. International conferences in this space are now mandatingreproducibility information. This project provides the tooling to make collecting and analysingperformance data straightforward. This will allow application owners to develop the skills andexperience to measure the performance of their code across the gamut of the UK's supercomputerfacilities, and improve their code based on benchmarking as they target Exascale.The increasing diversity of computer architectures now requires applications to strive to bePerformance Portable (PP); that is, achieve a high level of efficiency on a range of different processorswith minimal changes to the source code. Measuring PP using analysis such as those in our recentstudies needs to become as common in HPC as scaling tests or roofline analyses. This is especiallytrue for ExCALIBUR codes, where the likely Exascale architectures may not be known for several years.This project will ensure this vital PP analysis can become ubiquitous in HPC software development.The ReFrame tool has been developed by the CSCS and ETH Zurich to aid in the automated collectionof performance data. ReFrame is an already established approach within ExCALIBUR. This project willaugment the rudimentary performance analysis available in ReFrame to include our own PPMethodology developed with collaborators at Intel . By incorporating this alongside the BenchmarkingInitiative, we will empower the supercomputing community in the UK to measure the performanceportability of their code across the UK's HPC infrastructure. This aligns with the H&ES mission to readyUK codes and software for Exascale.

应用程序基准是英国迈向Exascale的一项关键活动。它确保未来的ExascalesSystem被社区理解，以便英国科学应用程序，特别是那些作为Excalbur的一部分开发的应用程序，可以利用Exascale的科学机会。线性求解器是许多埃克斯卡利伯代码中普遍存在的模式，这个项目将开发一个适用于许多英国代码的基准测试。应用程序基准是支持软件堆栈的一部分，它允许针对科学工作负载评估硬件的性能。以系统的方式严格测量基准的性能对于提高透明度和实现重现性至关重要。这一领域的国际会议现在是强制性的可再生性信息。该项目提供了使收集和分析性能数据变得简单明了的工具。这将允许应用程序所有者发展技能和经验，以测量英国所有超级计算机设施的代码性能，并在以Exascale为目标时基于基准测试改进他们的代码。计算机体系结构日益多样化现在要求应用程序努力成为性能可移植(PP)；即，在对源代码进行最小更改的情况下，在一系列不同的处理器上实现高水平的效率。在高性能混凝土中，使用我们最近研究中的那些分析来测量PP需要变得像伸缩试验或屋顶分析一样普遍。对于埃克斯卡利伯代码尤其如此，其中可能的亿级架构可能在几年内都不为人所知。该项目将确保这种重要的PP分析可以在HPC软件开发中变得无处不在。重帧工具已由CSCS和ETH苏黎世开发，以帮助自动收集性能数据。重帧是王者之剑内部已经确立的方法。该项目将增强REFRAME中提供的基本性能分析，以包括我们与英特尔的合作者共同开发的PPM方法。通过将这一点与基准倡议结合起来，我们将使英国的超级计算社区能够衡量他们的代码在英国高性能计算基础设施中的性能可移植性。这与H&ES为Exascale准备英国代码和软件的使命一致。

项目成果

Principles for Automated and Reproducible Benchmarking

自动化和可重复基准测试的原则

• DOI: 10.1145/3624062.3624133
• 发表时间: 2023
• 作者: Koskela T