Advanced Computation and I/O Methods for Earth-System Simulations (AIMES)

地球系统模拟的高级计算和 I/O 方法 (AIMES)

• 批准号: 279335667
• 负责人: Professor Dr. Thomas Ludwig
• 金额: --
• 依托单位: Deutsches Klimarechenzentrum GmbH
• 依托单位国家: 德国
• 项目类别: Priority Programmes
• 财政年份: 2015
• 资助国家: 德国
• 起止时间: 2014-12-31 至 2020-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/279335667?language=en
• 关键词: Advanced; Computation; Methods; Earth; System

Dealing with extreme scale Earth-system models is challenging. Firstly, model code is continuously revised and extended by scientists to incorporate further levels of detail.This increases the burden of code maintenance and limits performance portability across systems.Secondly, the required storage capacity is steadily increasing as scientists perform runs with growing resolution or aggregate results from ensemble runs. Within the AIMES project, our interdisciplinary and international team addresses the key issues of programmability, computational efficiency and I/O limitations that are common in next-generation Icosahedral earth-system models. Firstly, we will derive a high-level DSL as representation for specifying key parts of these models that can be embedded into existing code. This high-level representation allows scientists to express their code in a terminology that is closer to the abstraction level of their specific scientific domain and, thus, more natural.From the abstract concepts, the teams will derive model-specific dialects for the DYNAMICO, ICON and NICAM model and implement them in a prototype.Secondly, a concept and light-weight tool for translating the high-level representation and its dialects into a variety of existing language constructs is developed. By choosing the appropriate back-end, suitable existing DSLs and library approaches can be created together with an appropriate memory layout and certain architecture-specific features of parallelization. While the high-level representation increases programmability significantly, performance-portability of scientific models across systems is increased, and both become orthogonal aspects to be taken care of by system experts.Data handling is improved by investigating suitable formats for icosahedral data and by advancing lossy compression strategies. During this process, we propose strategies to overcome the current limitations, implement selected prototypes and communicate these with the responsible consortia.To demonstrate the benefit of the developed concepts and components, a shared open-source benchmark suite will be extracted from all models and evaluated on small and large scale.Ultimately, we intend to foster development of best-practices and useful norms by cooperating on shared ideas and components but we also ensure that developed tools and high-level concepts can be applied to other domains.

处理极端尺度的地球系统模型是一项挑战。首先，模型代码由科学家不断修改和扩展，以纳入更多的细节层次。这增加了代码维护的负担，并限制了跨系统的性能可移植性。其次，随着科学家进行分辨率越来越高的运行，或者从集合运行中获得汇总结果，所需的存储容量也在稳步增加。在AIMES项目中，我们的跨学科和国际团队解决了下一代二十面体地球系统模型中常见的可编程性，计算效率和I/O限制的关键问题。首先，我们将派生一个高级DSL作为表示，用于指定这些模型的关键部分，这些关键部分可以嵌入到现有代码中。这种高层次的表示允许科学家用一种术语来表达他们的代码，这种术语更接近他们特定科学领域的抽象层次，因此更自然。从抽象概念中，团队将为DYNAMICO、ICON和NICAM模型派生特定于模型的方言，并在原型中实现它们。其次，提出了一个概念和轻量级的工具，用于将高级表示及其方言翻译成各种现有的语言结构。通过选择适当的后端，可以创建合适的现有dsl和库方法，以及适当的内存布局和某些特定于体系结构的并行化特性。虽然高级表示显著地提高了可编程性，但跨系统的科学模型的性能可移植性也得到了提高，并且这两个方面成为系统专家需要考虑的正交方面。通过研究适合二十面体数据的格式和改进有损压缩策略，改进了数据处理。在此过程中，我们提出克服当前限制的策略，实现选定的原型，并与负责的财团进行沟通。为了展示开发的概念和组件的好处，将从所有模型中提取一个共享的开源基准套件，并在小型和大型上进行评估。最终，我们打算通过在共享的想法和组件上进行合作来促进最佳实践和有用规范的发展，但我们也确保开发的工具和高级概念可以应用于其他领域。