ExCALIBUR HES Benchmarking for Performance Portable Applications

应用程序基准测试是英国迈向Exascale的关键活动。它确保未来的Exascale系统被社区所理解，以便英国科学应用，特别是那些作为ExCALIBUR的一部分开发的系统，可以利用Exascale的科学机会。线性求解器是许多ExCALIBUR代码中普遍存在的模式，本项目将开发适用于许多英国代码的合适基准。应用程序基准测试是使能软件栈的一部分，使硬件的性能能够被评估用于科学工作负载。以系统的方式严格测量基准测试的性能以提高透明度和实现可重复性至关重要。这一领域的国际会议现在要求提供再生产信息。这个项目提供了工具，使收集和分析性能数据直截了当。这将使应用程序所有者能够发展技能和经验，以衡量他们的代码在英国所有超级计算机设施中的性能，并在基准测试的基础上改进他们的代码，因为他们的目标是Exascale。也就是说，在一系列不同的处理器上实现高水平的效率，而对源代码的更改最少。测量PP使用分析，如在我们最近的研究需要成为常见的HPC作为缩放测试或屋顶线分析。这对于ExCALIBUR代码来说尤其如此，Exascale架构可能在几年内都不知道。该项目将确保这种重要的PP分析可以在HPC软件开发中无处不在。ReFrame工具由CSCS和ETH苏黎世开发，以帮助自动收集性能数据。ReFrame是ExCALIBUR中已经确立的方法。该项目将扩展ReFrame中可用的基本性能分析，以包括我们与英特尔合作者开发的PP方法。通过将其与BenchmarkingInitiative相结合，我们将使英国的超级计算社区能够在英国的HPC基础设施上测量其代码的性能和可移植性。这与H&ES为Exascale准备UK代码和软件的使命相一致。

Application benchmarking is a crucial activity in the UK's path to Exascale. It ensures future Exascalesystems are understood by the community so that UK Science Applications, particularly thosedeveloped as part of ExCALIBUR, can take advantage of the scientific opportunities at Exascale. Linearsolvers are a ubiquitous pattern in many ExCALIBUR codes, and this project will develop a suitablebenchmark applicable to many of UK codes. Application benchmarks are part of the enabling softwarestack that allows the performance of hardware to be assessed for scientific workloads .It is vital to rigorously measure the performance of benchmarks in a systematic way to enhance thetransparency and enable reproducibility. International conferences in this space are now mandatingreproducibility information. This project provides the tooling to make collecting and analysingperformance data straightforward. This will allow application owners to develop the skills andexperience to measure the performance of their code across the gamut of the UK's supercomputerfacilities, and improve their code based on benchmarking as they target Exascale.The increasing diversity of computer architectures now requires applications to strive to bePerformance Portable (PP); that is, achieve a high level of efficiency on a range of different processorswith minimal changes to the source code. Measuring PP using analysis such as those in our recentstudies needs to become as common in HPC as scaling tests or roofline analyses. This is especiallytrue for ExCALIBUR codes, where the likely Exascale architectures may not be known for several years.This project will ensure this vital PP analysis can become ubiquitous in HPC software development.The ReFrame tool has been developed by the CSCS and ETH Zurich to aid in the automated collectionof performance data. ReFrame is an already established approach within ExCALIBUR. This project willaugment the rudimentary performance analysis available in ReFrame to include our own PPMethodology developed with collaborators at Intel . By incorporating this alongside the BenchmarkingInitiative, we will empower the supercomputing community in the UK to measure the performanceportability of their code across the UK's HPC infrastructure. This aligns with the H&ES mission to readyUK codes and software for Exascale.