SI2-SSE: Fast Dynamic Load Balancing Tools for Extreme Scale Systems

SI2-SSE：适用于超大规模系统的快速动态负载平衡工具

• 批准号: 1533581
• 负责人: Mark Shephard
• 金额: $ 50万
• 依托单位: Rensselaer Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1533581&HistoricalAwards=false
• 关键词: SI2; SSE; Fast; Dynamic; Load

Massively parallel computing combined with scalable simulation workflows that can reliably model systems of interest are central to the continued quest of scientists, engineers, and other practitioners to address advances in scientific discovery, engineering design, and medical treatment. However, to meet their potential, these methods must be able to operate efficiently and scale on massively parallel computers executing millions of processes. Reaching the goal of millions of parallel processes requires new methods in which the computational workload is extremely well balanced and interprocessor communications overheads are minimized. Attaining such parallel performance is greatly complicated in realistic simulation workflows where the models and their discrete computer representation must evolve to ensure simulation reliability, or to account for changing input streams. To address the need to obtain workload balance with controlled communications, various algorithms and associated software, referred to as load balancing procedures, have been, and continue to be, developed. To be effective in the execution of simulation workflows in which the workload evolves, the load balancing procedures must be applied dynamically at multiple points in the simulation. Current load balancing techniques demonstrate two deficiencies when applied as dynamic load balancing procedures at very large numbers of compute cores (e.g., greater than 100,000 cores): They become a major fraction of the total parallel computation (in some cases never finishing within an allocation) and they do not maintain good load balance for simulation steps that must balance based on multiple criteria. Building on initial efforts to improve dynamic load balancing methods for adaptive unstructured mesh applications, the goal of the proposed research is to develop fast multicriteria dynamic load balancing methods that are capable of quickly producing well balanced computations, with well controlled communications, for a wide variety of applications. An important characteristic of the dynamic load balancing procedures to be developed is generalizing the graph to account for multiple types of computational entities and interactions. The initial ideas for supporting multiple entity types came from consideration balancing finite element calculations that must consider multiple orders of mesh entities. These concepts will be refined and generalized to support multiple applications areas. An additional development will be fast hybrid dynamic load balancing methods that are combinations of "geometric", standard graph, and multicriteria graph methods in which the individual methods can be executed globally of at a more local level (such as at the node level). The dynamic load balancing method to be developed will be demonstrated on three applications in which the workload, and its distribution, is changing as the simulation proceeds. The applications will be adaptive mesh simulations, adaptive multiscale modeling, and massive scale free graphs. These applications will be carried out on available massively parallel computers where examples on 1 million cores will be demonstrated. A goal of the dynamic load balancing methods to be developed will be to attain scalability, and do so with controlled data movement such that the wall clock time and energy used is substantially less than that required for an equivalent accuracy non-adaptive calculation.The software produced by this project will be made available as open source components. These developments coupled with efforts to support users in applying them in the development of new simulation tools will impact many research communities. Based on past and present efforts, the PIs fully expect that technologies developed in this project will also be integrated into future industrial software systems.

大规模并行计算与可扩展的仿真工作流相结合，可以可靠地对感兴趣的系统进行建模，这是科学家，工程师和其他从业者不断追求的核心，以解决科学发现，工程设计和医疗方面的进步。然而，为了发挥其潜力，这些方法必须能够在执行数百万个进程的大规模并行计算机上有效地运行和扩展。要达到数百万个并行进程的目标，需要新的方法，其中计算工作量非常平衡，处理器间通信开销最小化。实现这种并行性能是非常复杂的，在现实的仿真工作流程中，模型和它们的离散计算机表示必须发展，以确保仿真的可靠性，或考虑到不断变化的输入流。为了解决利用受控通信来获得工作负载平衡的需要，已经并且继续开发被称为负载平衡过程的各种算法和相关联的软件。为了有效地执行工作负载不断变化的仿真工作流，必须在仿真中的多个点动态应用负载平衡过程。当前的负载平衡技术在作为动态负载平衡过程应用于非常大量的计算核时表现出两个缺陷（例如，大于100，000个核）：它们成为总并行计算的主要部分（在某些情况下，在分配内从未完成），并且它们不能为必须基于多个标准平衡的模拟步骤保持良好的负载平衡。 建立在最初的努力，以提高动态负载平衡方法的自适应非结构化网格应用程序，所提出的研究的目标是开发快速的多准则动态负载平衡方法，能够快速产生平衡的计算，良好的控制通信，为各种各样的应用程序。要开发的动态负载平衡过程的一个重要特征是将图概括为考虑多种类型的计算实体和交互。支持多个图元类型的最初想法来自于平衡有限元计算的考虑，因为有限元计算必须考虑多个网格图元阶数。这些概念将被细化和推广，以支持多个应用领域。另一个发展将是快速混合动态负载平衡方法，这些方法是“几何”，标准图和多标准图方法的组合，其中各个方法可以在更局部的级别（例如在节点级别）全局执行。动态负载平衡方法将在三个应用程序中进行演示，其中工作负载及其分布随着模拟的进行而变化。应用程序将是自适应网格模拟，自适应多尺度建模和大规模无尺度图。这些应用程序将在现有的大规模并行计算机上进行，其中将展示100万个核心的示例。开发动态负载平衡方法的一个目标是实现可扩展性，并通过受控的数据移动实现这一目标，从而使所使用的挂钟时间和能量大大低于同等精度的非自适应计算所需的时间和能量。这些发展加上努力支持用户在新的模拟工具的开发中应用它们将影响许多研究界。基于过去和现在的努力，PI完全期望该项目中开发的技术也将集成到未来的工业软件系统中。