Future-proof massively-parallel execution of multi-block applications

多年来，提高微处理器的时钟频率已经导致计算机应用性能的稳步提高。这几乎免费地提高了应用程序的速度，而不必为每一代新处理器重新编写软件。然而，以这种方式提高处理器的性能导致了不可持续的能耗增加。因此，为了获得更高的性能，芯片开发人员现在依赖于并行操作的多个内核。最新的CPU具有多达10个核心，每个核心具有每个时钟周期产生多达8个单精度浮点结果的向量单元，而最新的图形处理器（GPU）具有多达2688个简单得多的核心，这些核心以32个为一组进行操作。并且很可能在接下来的10年中将看到计算机体系结构的进一步快速发展。这给应用程序开发人员带来了巨大的挑战，他们自然希望专注于他们的工程和科学应用，以及如何最好地建模它们，而不必担心现代计算机体系结构的细节。为了解决这个问题，科学计算领域正在努力开发高级软件包或框架，以便应用程序开发人员可以指定他们想要在高级计算的内容，然后软件包负责实现细节。在EPSRC先前资助的研究的基础上，开发了一个用于非结构化网格应用程序的称为OP2的框架，该提案旨在开发一种名为OPS的面向未来的扩展，以处理多块结构化网格应用程序的需求。开发者可使用精心设计的应用程式介面（API），以FORTRAN或C语言编写应用程式，然后OPS会为不同的硬件目标平台生成定制代码。除了为不同的硬件定制外，还将采用另外两种优化方法。一种是使用“平铺”来重叠通常顺序执行的并行循环的执行。这通过重用该高速缓存内的数据，减少了数据在处理器和主内存之间移动的次数，从而提高了性能和能效。这在现代架构中变得越来越重要，因为数据移动所花费的能量成本和时间远远大于浮点运算。另一个优化是对长时间执行的应用程序使用运行时优化。后端实现是参数化的，参数控制方面，如线程块中的线程数量，或平铺优化中的“瓦片”大小。这些参数的最佳值是未知的先验，它可能会显着影响性能。通过动态地改变值，并对性能的相应变化进行计时，我们可以在执行过程中实现迭代改进参数值。新的OPS框架将通过将其应用于两个重要的学术CFD代码（由Chris艾伦教授在布里斯托开发的ROTOR和由Neil Sandham教授在南安普顿开发的SBLI）来评估其性能和易用性。除了本身是重要的代码外，这些代码也代表了CCP 12（计算工程），英国湍流联盟和英国应用空气动力学联盟内其他代码的需求。

For many years, increasing the clock frequency of microprocessors has led to steady improvements in performance of computer applications. This gave an almost free performance boost to the speed of applications without having to re-write software for each new generation of processors. However, increasing the performance of processors in this manner led to an unsustainable increase in energy consumption. Thus, to gain higher performance chip developers now rely on multiple cores operating in parallel. The latest CPUs have up to 10 cores, each with a vector unit producing up to 8 single precision floating point results per clock cycle, while the latest graphics processors (GPUs) have up to 2688 much simpler cores operating in groups of 32.This move into manycore computing has led to considerable hardware innovation, and it is likely that the next 10 years will see further rapid evolution in computer architectures. This poses huge challenges to application developers who naturally wish to concentrate on their engineering and scientific applications and how best to model them, without having to worry about the details of modern computer architectures. To address this, there are a range of efforts within scientific computing to develop high-level software packages or frameworks so that the application developer can specify what they want to be computed at a high level, and then the package takes care of the implementation details.Building on prior EPSRC-funded research to develop a framework called OP2 for unstructured grid applications, this proposal aims to develop a future-proof extension called OPS to handle the needs of multi-block structured grid applications. Developers' applications can be written in FORTRAN or C, using a carefully-designed application programming interface (API), and then OPS generates customised code for the implementation on different hardware target platforms.As well as customising for the different hardware, two other optimisation approaches will be adopted. One is the use of ``tiling'' to overlap the execution of parallel loops which are usually executed sequentially. This improves both performance and energy efficiency by reusing data within the cache, cutting down on the number of times data is moved between the processor and the main memory. This is something which is becoming increasingly important on modern architectures because the energy cost and time taken for data movement is much greater than for floating point operations. The other optimisation is the use of run-time optimisation for applications which execute for a long time. The backend implementations are parameterised, with parameters controlling aspects such as the number of threads in a thread block, or the size of a ``tile'' in the tiling optimisation. The optimal values for these parameters are not known a priori, and it could significantly affect the performance. By dynamically varying the values, and timing the consequential changes in performance, we can implement heuristics to iteratively improve the parameter values during the execution.The new OPS framework will be assessed, both for performance and ease-of-use, by applying it to two important academic CFD codes, ROTOR developed at Bristol by Prof. Chris Allen, and SBLI developed by at Southampton by Prof. Neil Sandham. As well as being important codes in their own right, these are also representative of the needs of other codes within CCP12 (Computational Engineering), the UK Turbulence Consortium, and the UK Applied Aerodynamics Consortium.