Architecture Support for Advancing PGAS (ASAP)

推进 PGAS 的架构支持（尽快）

• 批准号: 1547980
• 负责人: Tarek El-Ghazawi
• 金额: $ 23万
• 依托单位: George Washington University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-08-15 至 2017-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1547980&HistoricalAwards=false
• 关键词: Architecture; Support; Advancing; PGAS; ASAP

Architectures of parallel computers and modern manycore processor chips, that contain tens and eventually hundreds of processors, are becoming quite complex for the programmers. Efficient programming of those systems is very important to achieve high-speed of processing while reducing power. To do so, programmers must ensure that: 1. the work in the program is broken into as many parallel activities as possible for fast processing; 2. data is located close to the processing cores that will manipulate them to avoid making the data travel long in the system thereby losing more time and wasting energy. Programming models are abstractions that provide the programmer with an easy-to-use logical view that hides the complexity of the underlying systems, while facilitating efficient programming. These are two conflicting requirements and while the current de facto programming methods can offer efficiency in the majority of the cases, they are not easy to use. The so called, PGAS or the Partitioned Global Address Space programming model has the promise of striking a balance between efficiency and ease-of-use. However, help is needed from the hardware particularly in simplifying and speeding up the process of finding where the data to be processed is physically located. This work is to investigate hardware solutions for this problem under the PGAS programming model. The outcome will improve productivity of domain scientists, thereby reducing the time from conceiving an application problem till the solution is attained, which in the long run can mean more rapid discoveries and innovations, as well reduction in the cost of developing the next generation software. The PIs propose to investigate a general hardware support for address translation for the PGAS programming model. PGAS strikes a balance between the locality-aware, but explicit, message-passing model (e.g. MPI) and the easy-to-use, but locality-agnostic, shared memory model (e.g. OpenMP). However, the PGAS rich memory model comes at a performance cost which can hinder its potential for scalability and performance. Current implementations can be orders of magnitude slower in accessing local shared space as compared to accessing their private space. Compiler optimizations only handle special cases and hand-tuning renders the PGAS ease-of-use advantage worthless. The proposed hardware solution can facilitate high-performance execution for out-of-the-box (i.e. non-hand-tuned) PGAS applications. The PIs are creating PAGS memory model translation architectural support, which can navigate the PGAS memory model converting PGAS shared references to system's virtual addresses efficiently on-the-fly. This eliminates the need for hand-tuning, while maintaining the performance and productivity of PGAS languages. The hardware support will be available to the compiler through instruction set extensions. A tool set integrating and adapting existing micro-architecture simulators with compiler and a run-time system will be used as the main testbed and distributed over a cluster for extensive experimentation. At the end of the project the PIs expect to release tools and the benchmarks utilized under this project.

并行计算机和现代多核处理器芯片的架构（包含数十个甚至数百个处理器）对于程序员来说变得相当复杂。 这些系统的高效编程对于在降低功耗的同时实现高速处理非常重要。 为此，程序员必须确保： 1. 程序中的工作被分解为尽可能多的并行活动，以便快速处理； 2. 数据位于靠近处理核心的位置，处理核心将对其进行操作，以避免数据在系统中传输较长时间，从而损失更多时间和浪费能源。编程模型是抽象概念，为程序员提供易于使用的逻辑视图，隐藏底层系统的复杂性，同时促进高效编程。这是两个相互冲突的要求，虽然当前事实上的编程方法可以在大多数情况下提供效率，但它们并不易于使用。 所谓的 PGAS 或分区全局地址空间编程模型有望在效率和易用性之间取得平衡。 然而，需要硬件的帮助，特别是在简化和加速查找要处理的数据的物理位置的过程方面。这项工作是在 PGAS 编程模型下研究该问题的硬件解决方案。 其结果将提高领域科学家的生产力，从而缩短从构思应用程序问题到获得解决方案的时间，从长远来看，这意味着更快的发现和创新，并降低开发下一代软件的成本。 PI 建议研究对 PGAS 编程模型地址转换的通用硬件支持。 PGAS 在局部性感知但显式的消息传递模型（例如 MPI）和易于使用但与局部性无关的共享内存模型（例如 OpenMP）之间取得了平衡。 然而，PGAS 丰富内存模型的性能成本可能会阻碍其可扩展性和性能的潜力。与访问其私有空间相比，当前的实现在访问本地共享空间时可能慢几个数量级。 编译器优化仅处理特殊情况，手动调整会使 PGAS 的易用性优势变得毫无价值。 所提出的硬件解决方案可以促进开箱即用（即非手动调整）PGAS 应用程序的高性能执行。 PI 正在创建 PAGS 内存模型转换架构支持，该支持可以导航 PGAS 内存模型，从而高效地将 PGAS 共享引用即时转换为系统的虚拟地址。这消除了手动调整的需要，同时保持了 PGAS 语言的性能和生产力。编译器将通过指令集扩展获得硬件支持。 集成和调整现有微架构模拟器与编译器和运行时系统的工具集将用作主要测试平台，并分布在集群上以进行广泛的实验。 在项目结束时，PI 希望发布该项目下使用的工具和基准。