CSR-PSCE, TM: A Declarative Approach to Managing the Complexity of Massively Parallel Programs

CSR-PSCE, TM：管理大规模并行程序复杂性的声明式方法

• 批准号: 0834722
• 负责人: Andrew Lumsdaine
• 金额: $ 85万
• 依托单位: Indiana University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-09-01 至 2013-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0834722&HistoricalAwards=false
• 关键词: CSR; PSCE; TM; Declarative; Approach

Parallel programs are typically written using a style in which independent processes are expressed sequentially and use locally-expressed message passing as a means of data exchange as well as a means of inter-process synchronization. From the network relationships that are implied by messaging among processes arise implicit data structures and implicit algorithms - that is, global parallel data structures and global parallel algorithms for which there is no explicit global representation. Limited only to a local approach for creating parallel programs, achieving correctness and performance of large-scale parallel algorithms is rapidly moving beyond our reasoning abilities. To address this shortcoming, this project develops a declarative language approach for describing new high-level communication operations, a means for composing these operations with computations, and a means for expressing transformations for optimizing the resulting compositions.This project's implementation plan is based on aggressive evolution of the technology that is currently most effective in large-scale parallel computing - namely, explicitly managed shared data. In the distributed-memory case this is achieved with message passing, but the same discipline can be applied in the shared memory case as well. This project's approach may enable higher levels of expressiveness and abstraction for data management, communication, and coordination. Moreover, the separation of concerns that is naturally imposed between communication and computation greatly simplifies the mental model and implementation effort for programmers. In order not to sacrifice performance because of this division, this scheme's composition and transformation mechanisms will allow communication and computation to be (automatically) combined in an optimized fashion so that high performance and high scalability are achieved. To facilitate adoption by practicing programmers of the paradigms and tools that are developed, integration with education is essential. Accordingly, this project will directly train undergraduate, graduate, and post-doctoral researchers and will develop supporting curricula and materials to train both students and practicing programmers. Close collaboration with large-scale real-world scientific applications will further increase the practical relevance of this work.

并行程序通常使用一种风格来编写，在这种风格中，独立进程被顺序地表达，并且使用本地表达的消息传递作为数据交换的手段以及进程间同步的手段。从进程间消息传递所隐含的网络关系中产生隐式数据结构和隐式算法--即全局并行数据结构和全局并行算法，它们没有显式的全局表示。仅限于创建并行程序的本地方法，实现大规模并行算法的正确性和性能正在迅速超越我们的推理能力。为了解决这个问题，本项目开发了一种用于描述新的高级通信操作的声明性语言方法，一种将这些操作与计算组合在一起的方法，以及一种用于表达转换以优化结果组合的方法。本项目的实施计划基于对目前在大规模并行计算中最有效的技术的积极发展-即，明确管理共享数据。在分布式内存的情况下，这是通过消息传递来实现的，但同样的原则也可以应用于共享内存的情况。该项目的方法可以为数据管理、通信和协调提供更高级别的表达性和抽象性。此外，在通信和计算之间自然施加的关注点分离极大地简化了程序员的心理模型和实现工作。为了不因为这种划分而牺牲性能，该方案的组合和转换机制将允许通信和计算以优化的方式（自动）组合，从而实现高性能和高可扩展性。为了促进实践程序员采用所开发的范例和工具，与教育的整合是必不可少的。因此，该项目将直接培训本科生，研究生和博士后研究人员，并将开发支持课程和材料，以培训学生和实践程序员。与大规模现实世界科学应用的密切合作将进一步增加这项工作的实际意义。