CI-P: REFT - A Reconfigurable Execution Framework Testbed for data-driven and extreme scale computing

超级计算领域正在经历系统结构、编程模型和软件环境的快速变化，以响应应用程序需求和基础使能技术的进步。传统的并行编程方法依赖于通过MPI和OpenMP等编程接口进行静态资源分配和任务调度。这些方法正在达到它们在新兴系统类别上的效率和可扩展性极限，促使创新的动态战略和软件工具的创建，包括高级运行时系统软件和使用它们的编程接口。为了加速采用这些下一代方法，正在创建和运行一个独特的环境，该环境提供最先进的运行时系统软件和编程接口的全面集合。这些执行系统取自以前的研究和开发项目，其中一些来自主办机构印第安纳大学，另一些来自全国各地的一流研究机构，这些执行系统集成在一个支持的可重构执行框架测试床(REFT)中，供并行应用算法开发人员以及并行计算高级工具的研究人员使用。REFT的基本硬件功能包括具有多核插槽、高带宽互连和大容量存储的中型异类Linux集群；现场可编程门阵列；以及用于功率测量的仪器。总部设在Parallex的HPX-3，ETI Swarm，伯克利加斯网，莱斯大学？S，伊利诺伊州哈巴内罗？Charm++、Cray Chapel、IBM X-10和UPC等编程和执行模型构成了这一独特工具的主要组件。超级计算正在形式、功能和方法上发生急剧转变。不幸的是，该领域几乎没有人熟练地使用新兴的执行和编程模型，这些模型对于有效地利用超级计算机为极端规模的应用程序提供高质量的科学变得越来越关键-无论是那些处于性能谱最高端的应用程序(目前是Petaflop，到本世纪末是Exaflop)，还是强规模的固定大小问题。REFT通过极大地降低培训、实验和采用新的动态执行方法和系统的障碍，为NSF计算科学界服务。它为广大的美国HPC社区提供完整的文档、在线教程、内部课程和研讨会，用于技能发展和社区建设，以加快应用、评估和开发。作为相互竞争和互补的软件环境的储存库，它提供了一个单一站点，供最终用户进行比较研究，以确定最佳做法。作为国家科学基金会的一项资源，它能够有效应用具有数百万核的下一代千万亿次浮点运算级计算机系统，并最终实现亿级并发的亿级系统，从而加速和实现计算科学的目标。

The field of supercomputing is experiencing a rapid change in system structure, programming models, and software environments in response to advances in application requirements and in underlying enabling technologies. Traditional parallel programming approaches have relied on static resource allocation and task scheduling through programming interfaces such as MPI and OpenMP. These methods are reaching their efficiency and scalability limits on the new emerging classes of systems, spurring the creation of innovative dynamic strategies and software tools, including advanced runtime system software and programming interfaces that use them. To accelerate adoption of these next-generation methods, a unique environment is being created and operated that provides a comprehensive ensemble of state-of-the-art runtime system software and programming interfaces. Taken from previous research and development projects, some at the host institution, Indiana University, and others from premiere research organizations across the nation, these execution systems are integrated in a single supported Reconfigurable Execution Framework Testbed (REFT) and made available to parallel application algorithm developers as well as researchers in advanced tools for parallel computing. The basic REFT hardware capabilities include a medium- scale heterogeneous Linux cluster with multi-core sockets, high-bandwidth interconnect, and mass storage; field-programmable gate arrays; and instrumentation for power measurement. ParalleX-based HPX-3, ETI SWARM, Berkeley GasNet, Rice University?s Habanero, Illinois? Charm++, Cray Chapel, IBM X-10, and UPC among other programming and execution models comprise the major components of this unique facility.Supercomputing is making a sharp corner turn in form, function, and methodologies. Unfortunately, few in the field are skilled in the use of the emerging execution and programming models that are becoming increasingly critical to effectively utilizing supercomputers to deliver quality science for extreme-scale applications?either those at the highest end of the performance spectrum (Petaflops currently and Exaflops at the end of the decade) or strong-scaled fixed-size problems. REFT serves the NSF computational science community by dramatically lowering the barrier to training, experimentation, and adoption of new dynamic execution methods and systems. It provides full documentation, on-line tutorials, in-house classes, and workshops for skill development and community building for the broad US HPC community to accelerate application, evaluation, and exploitation. As a repository for competing and complementary software environments it provides a single site for conducting comparative studies by end-users to establish best practices. As an NSF resource, it serves to expedite and further goals of computational science by enabling effective application of the next generation Petaflops-class computer systems of millions of cores and eventual Exascale systems with billion-way concurrency.