Hybrid Reusable Computational Analytics Workflow Management with Cloudmesh
Hybrid Reusable Computational Analytics Workflow Management with Cloudmesh
复制标题
使用 Cloudmesh 进行混合可重用计算分析工作流程管理
DOI：
10.48550/arxiv.2210.16941
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
G. Fox
中科院分区：
文献类型：
--
作者：
G. Laszewski;J. Fleischer;G. Fox
在本文中，我们总结了创建和利用一个简单的框架来协调计算分析任务的工作，我们的设计基于一种简约的方法，同时允许访问所有者提供的计算资源计算机，HPC计算中心，云资源和分布式系统一般。命令行接口以及Python接口。对于成千上万的计算机，作为本地和云基础结构的一部分。 GitHub中的开源项目基于一个易于启动的工具，称为CloudMesh。
In this paper, we summarize our effort to create and utilize a simple framework to coordinate computational analytics tasks with the help of a workflow system. Our design is based on a minimalistic approach while at the same time allowing to access computational resources offered through the owner’s computer, HPC computing centers, cloud resources, and distributed systems in general. The access to this framework includes a simple GUI for monitoring and managing the workflow, a REST service, a command line interface, as well as a Python interface. The resulting framework was developed for several examples targeting benchmarks of AI applications on hybrid compute resources and as an educational tool for teaching scientists and students sophisticated concepts to execute computations on resources ranging from a single computer to many thousands of computers as part of on-premise and cloud infrastructure. We demonstrate the usefulness of the tool on a number of examples. The code is available as an open-source project in GitHub and is based on an easy-to-enhance tool called cloudmesh.
使用 Cloudmesh GAS 快速生成混合多云自动生成的 AI 服务
DOI：
10.1109/compsac51774.2021.00032
发表时间：
2021
期刊：
and Applications Conference (COMPSAC
影响因子：
--
作者：
Laszewski, Gregor von;Orlowski, Anthony;Otten, Richard H.;Markowitz, Reilly;Gandhi, Sunny;Chai, Adam;Fox, Geoffrey C.;Chang, Wo L.
通讯作者：
Chang, Wo L.