Interactive HPC Gateways with Jupyter and Jupyterhub
Interactive HPC Gateways with Jupyter and Jupyterhub
复制标题
使用 Jupyter 和 Jupyterhub 的交互式 HPC 网关
DOI：
10.1145/3093338.3104159
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
M. Milligan
中科院分区：
文献类型：
--
作者：
M. Milligan
明尼苏达大学的MSI已将支持交互式HPC作为一流服务的目标。本文介绍了一个网关的实施，用户友好的，可再生的计算在HPC环境中使用的笔记本电脑服务器和xueyterhub。在这个项目中，我们开发了新的组件和技术，实现了HPC与机构HPC中心的独特要求的互操作性。这些模块包括提供与批处理作业调度集成、作业配置文件控制以及与中央身份验证服务集成的模块。为了实现软件的可持续性，我们设计了这些元素的通用适用性，其中一些已经被接受为开源项目的组件。
MSI at the University of Minnesota has adopted a goal of supporting Interactive HPC as a first class service. This paper describes the implementation of a gateway for user-friendly, reproducible computing in an HPC environment using the Jupyter notebook server and Jupyterhub. For this project, we developed novel components and techniques enabling interoperability of Jupyter with the distinct requirements of an institutional HPC center. These include modules providing integration with batch job scheduling, control of job profiles, and integration with a central authentication service. To achieve software sustainability, we designed these elements for generic applicability, and several have now been accepted as components of the Jupyterhub open source project.