Skyway: A Seamless Solution for Bursting Workloads from On-Premises HPC Clusters to Commercial Clouds
Skyway: A Seamless Solution for Bursting Workloads from On-Premises HPC Clusters to Commercial Clouds
复制标题
Skyway：将工作负载从本地 HPC 集群爆发到商业云的无缝解决方案
DOI：
10.1145/3437359.3465607
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
H. Runesha
中科院分区：
文献类型：
--
作者：
Yuxing Peng;J. Skone;Callista Christ;H. Runesha
高性能计算（HPC）社区对云计算的兴趣持续增长，但由于对成本、低延迟网络应用程序支持和数据管理的担忧，广泛采用云计算的障碍仍然存在。尽管存在这些障碍，云计算仍然存在巨大的潜力，通过其提供的高可扩展性和弹性来增强HPC。HPC工作负载和硬件技术继续快速发展并变得越来越多样化，这对生产中的内部部署资源构成了挑战，因为它们不容易适应或立即扩展。具有“突发到云”能力的混合基础架构可以联合收割机结合本地和云资源空间的优势，以克服各自存在的挑战和障碍。芝加哥大学的研究计算中心（RCC）开发了一种名为Skyway的解决方案，该解决方案将多云计算资源作为其内部HPC基础设施的弹性扩展。还开发了一个系统级软件包，用于与Simple Linux Utility for Resource Management（SLURM）调度程序和云SDK对接，可以将HPC工作负载突发到云，为用户提供与本地和云系统交互时的无缝体验。Skyway提供了与一个或多个云提供商接口的灵活性，当前用例通过Skyway使用Amazon AWS和Google GCP。其他云提供商，如Microsoft Azure和Oracle，也可以通过Skyway使用，我们计划在不久的将来进一步探索。
Interest in cloud computing within the High Performance Computing (HPC) community continues to grow, but barriers to wide-spread adoption remain over concerns of cost, support of low-latency network applications, and data management. Despite these barriers, tremendous potential still exists for cloud computing to enhance HPC through the high scalability and elasticity it provides. HPC workloads and hardware technologies continue to rapidly evolve and become increasingly diversified, which poses a challenge for on-premises resources in production since they are not easily adaptable or immediately expandable. A hybrid infrastructure, with the ability of “burst-to-cloud”, can combine advantages from the on-premises and cloud resource spaces to overcome the challenges and barriers present with each. The Research Computing Center (RCC) at The University of Chicago has developed such a solution, named Skyway, that incorporates multi-cloud computing resources as elastic extensions of its on-premises HPC infrastructure. A system-level software package is also developed to interface with the Simple Linux Utility for Resource Management (SLURM) scheduler and cloud SDKs, that can burst HPC workloads to the cloud, providing users a seamless experience when interacting with both on-premises and cloud systems. Skyway offers the flexibility in interfacing with one or more cloud providers, with current use cases utilizing both Amazon AWS and Google GCP via Skyway. Other cloud providers, such as Microsoft Azure and Oracle, can also be utilized through Skyway, which we plan to explore further in the near future.
云和本地数据中心的使用、支出和投资回报方法：学术研究计算组织的调查
DOI：
10.1145/3311790.3396642
发表时间：
2020
期刊：
PEARC '20: Practice and Experience in Advanced Research Computing
影响因子：
--
作者：
Chalker, Alan;Hillegas, Curtis W.;Sill, Alan;Broude Geva, Sharon;Stewart, Craig A.
通讯作者：
Stewart, Craig A.