CSR: Small: Towards Realizing Cloud HPC: An Adaptive Programming Model for Accelerator-based Clusters

诸如云计算设置之类的高端计算系统正越来越多地使用多核计算资源和计算加速器，例如GPU和IBM Cell处理器，以获得高性能。然而，这些组件的使用会导致性能和通信不匹配，进而使具有不同资源的大型系统难以设计、构建和编程。此外，现代高级应用对数据需求的增加，加上计算速度和数据传输速度之间的不对称，威胁到在这种环境中使用加速器的好处。该项目通过设计一个灵活、可扩展和易于使用的编程模型AMOCA来解决上述问题。AMOCA支持创新的工作负载分配技术，使其能够用于在包括异类加速器类型计算节点的高端非对称云上扩展现代科学和企业应用程序。此外，AMOCA将组件能力匹配和自适应组件间数据传输用于并行编程模型，自动处理异构资源，并自动调整模型参数以适应运行它的特定资源实例。AMOCA为适应高性能计算的云计算范例奠定了基础，为可扩展的任意核心系统架构创建了开源和变革性技术，并有望提高包括计算物理、生物和化学在内的广泛学科的高级应用程序的效率和性能。AMOCA采用综合研究和教育方法来培训本科生和研究生研究人员，特别是来自代表性不足群体的研究人员。培训将灌输关键的系统开发技能，并增加基于加速器的云在HPC中的使用。

High-End Computing systems, such as cloud computing setups, are increasingly employing many-core compute resources and computational accelerators, e.g., GPUs and IBM Cell processors, for high performance. However, the use of such components results in a performance and communication mismatch, which in turn makes large-scale systems with heterogeneous resources difficult to design, build and program. Moreover, the increased data demand of modern advanced applications, coupled with the asymmetry between computation speed and data transmission speed, threaten the benefits of employing accelerators in such setups.This project addresses the above problems by designing a flexible, scalable, and easy-to-use programming model, AMOCA. AMOCA supports innovative workload distribution techniques, which enables it to be used toward scaling modern scientific and enterprise applications on high-end asymmetric clouds comprising heterogeneous accelerator-type compute nodes. Moreover, AMOCA utilizes component-capability matching and adaptive inter-component data transfers for parallel programming models, automatically handles heterogeneous resources, and auto-tunes the model parameters to the specific instance of resources on which it is run.AMOCA lays the foundation for adapting the cloud computing paradigm for HPC, creates open source and transformative technologies for scalable any-core system architectures, and is expected to improve the efficiency and performance of advanced applications in a broad range of disciplines that perform simulation-based experimentation including computational physics, biology, and chemistry. AMOCA employs an integrated research and education approach for training both undergraduate and graduate researchers, especially from underrepresented groups. The training will instill critical system development skills and increase the use of accelerator-based clouds in HPC.