ExCALIBUR HES Benchmarking for Performance Portable Applications

应用程序基准测试是英国通往百亿亿级的关键活动。它确保未来的Exascale系统被社区理解，以便英国科学应用，特别是那些作为ExCALIBUR的一部分开发的应用，可以利用Exascale的科学机会。线性求解器是许多ExCALIBUR代码中普遍存在的模式，该项目将开发适用于许多英国代码的合适基准。应用程序基准测试是启用软件栈的一部分，它允许对科学工作负载的硬件性能进行评估。以系统的方式严格测量基准的性能以提高透明度和可重复性是至关重要的。该领域的国际会议现在要求提供可重复性信息。这个项目提供了一个工具，可以直接收集和分析性能数据。这将使应用程序所有者能够发展技能和经验，以衡量他们的代码在英国超级计算机设施范围内的性能，并根据基准测试改进他们的代码，因为他们的目标是Exascale。计算机体系结构的日益多样化现在要求应用程序努力实现性能可移植性（PP）；也就是说，在对源代码进行最小更改的情况下，在一系列不同的处理器上实现高水平的效率。使用我们最近研究中的分析来测量PP需要在高性能计算中变得像尺度测试或屋顶线分析一样普遍。对于ExCALIBUR代码来说尤其如此，可能的百亿亿级架构可能在几年内都不为人所知。这个项目将确保这个重要的PP分析可以在HPC软件开发中无处不在。ReFrame工具由CSCS和苏黎世联邦理工学院开发，用于帮助自动收集性能数据。ReFrame是ExCALIBUR内部已经确立的方法。该项目将增强ReFrame中可用的基本性能分析，包括我们与英特尔合作开发的PPMethodology。通过将其与BenchmarkingInitiative结合起来，我们将使英国的超级计算社区能够在英国的高性能计算基础设施中测量其代码的性能可移植性。这与H&ES为Exascale准备yuk代码和软件的使命一致。

Application benchmarking is a crucial activity in the UK's path to Exascale. It ensures future Exascalesystems are understood by the community so that UK Science Applications, particularly thosedeveloped as part of ExCALIBUR, can take advantage of the scientific opportunities at Exascale. Linearsolvers are a ubiquitous pattern in many ExCALIBUR codes, and this project will develop a suitablebenchmark applicable to many of UK codes. Application benchmarks are part of the enabling softwarestack that allows the performance of hardware to be assessed for scientific workloads .It is vital to rigorously measure the performance of benchmarks in a systematic way to enhance thetransparency and enable reproducibility. International conferences in this space are now mandatingreproducibility information. This project provides the tooling to make collecting and analysingperformance data straightforward. This will allow application owners to develop the skills andexperience to measure the performance of their code across the gamut of the UK's supercomputerfacilities, and improve their code based on benchmarking as they target Exascale.The increasing diversity of computer architectures now requires applications to strive to bePerformance Portable (PP); that is, achieve a high level of efficiency on a range of different processorswith minimal changes to the source code. Measuring PP using analysis such as those in our recentstudies needs to become as common in HPC as scaling tests or roofline analyses. This is especiallytrue for ExCALIBUR codes, where the likely Exascale architectures may not be known for several years.This project will ensure this vital PP analysis can become ubiquitous in HPC software development.The ReFrame tool has been developed by the CSCS and ETH Zurich to aid in the automated collectionof performance data. ReFrame is an already established approach within ExCALIBUR. This project willaugment the rudimentary performance analysis available in ReFrame to include our own PPMethodology developed with collaborators at Intel . By incorporating this alongside the BenchmarkingInitiative, we will empower the supercomputing community in the UK to measure the performanceportability of their code across the UK's HPC infrastructure. This aligns with the H&ES mission to readyUK codes and software for Exascale.