CSR: Small: Towards Realizing Cloud HPC: An Adaptive Programming Model for Accelerator-based Clusters

高端计算系统，如云计算设置，越来越多地采用多核计算资源和计算加速器，如gpu和IBM Cell处理器，以实现高性能。然而，这些组件的使用导致性能和通信不匹配，这反过来又使具有异构资源的大型系统难以设计、构建和编程。此外，现代先进应用的数据需求增加，加上计算速度和数据传输速度之间的不对称，威胁到在这些设置中使用加速器的好处。本项目通过设计一个灵活、可扩展且易于使用的编程模型AMOCA来解决上述问题。AMOCA支持创新的工作负载分布技术，这使它能够用于在高端非对称云上扩展现代科学和企业应用程序，这些云包括异构加速器类型的计算节点。此外，AMOCA为并行编程模型利用组件能力匹配和自适应组件间数据传输，自动处理异构资源，并自动将模型参数调整到运行它的特定资源实例。AMOCA为适应HPC的云计算范式奠定了基础，为可扩展的任何核心系统架构创建了开源和变革性技术，并有望提高包括计算物理、生物学和化学在内的广泛学科中执行基于模拟的实验的高级应用程序的效率和性能。AMOCA采用综合研究和教育方法来培训本科生和研究生研究人员，特别是来自代表性不足的群体的研究人员。培训将灌输关键的系统开发技能，并增加HPC中基于加速器的云的使用。

High-End Computing systems, such as cloud computing setups, are increasingly employing many-core compute resources and computational accelerators, e.g., GPUs and IBM Cell processors, for high performance. However, the use of such components results in a performance and communication mismatch, which in turn makes large-scale systems with heterogeneous resources difficult to design, build and program. Moreover, the increased data demand of modern advanced applications, coupled with the asymmetry between computation speed and data transmission speed, threaten the benefits of employing accelerators in such setups.This project addresses the above problems by designing a flexible, scalable, and easy-to-use programming model, AMOCA. AMOCA supports innovative workload distribution techniques, which enables it to be used toward scaling modern scientific and enterprise applications on high-end asymmetric clouds comprising heterogeneous accelerator-type compute nodes. Moreover, AMOCA utilizes component-capability matching and adaptive inter-component data transfers for parallel programming models, automatically handles heterogeneous resources, and auto-tunes the model parameters to the specific instance of resources on which it is run.AMOCA lays the foundation for adapting the cloud computing paradigm for HPC, creates open source and transformative technologies for scalable any-core system architectures, and is expected to improve the efficiency and performance of advanced applications in a broad range of disciplines that perform simulation-based experimentation including computational physics, biology, and chemistry. AMOCA employs an integrated research and education approach for training both undergraduate and graduate researchers, especially from underrepresented groups. The training will instill critical system development skills and increase the use of accelerator-based clouds in HPC.