MultiCloud Resource Management using Apache Mesos with Apache Airavata

MultiCloud Resource Management using Apache Mesos with Apache Airavata
复制标题

使用 Apache Mesos 和 Apache Airavata 进行多云资源管理

DOI:
--
复制
发表时间:
2019
期刊:
arXiv.org
影响因子:
--
通讯作者:
M. Pierce
M. Pierce
中科院分区:
--
文献类型:
--
作者:
Pankaj Saha;M. Govindaraju;S. Marru;M. Pierce

文献摘要

被引文献

相似文献

我们讨论了初步的结果和我们计划的方法,将Apache Mesos的资源管理,这将使设计和开发的调度策略的Apache Airavata的工作,使他们可以在多个云,其中几个虚拟机没有公共IP地址启动。我们目前的初步工作和下一步的设计使用Apache Mesos的元调度程序。Apache Mesos提供了跨多个云和集群的可用资源的统一视图。我们的元调度器可以潜在地检查和识别多个小作业由同一科学家提交的情况,然后将作业从同一社区帐户或用户重定向到不同的集群。我们的方法使用NAT防火墙使节点/虚拟机,没有公共IP,可见的Mesos的统一视图。
We discuss initial results and our planned approach for incorporating Apache Mesos based resource management that will enable design and development of scheduling strategies for Apache Airavata jobs so that they can be launched on multiple clouds, wherein several VMs do not have Public IP addresses. We present initial work and next steps on the design of a meta-scheduler using Apache Mesos. Apache Mesos presents a unified view of resources available across several clouds and clusters. Our meta-scheduler can potentially examine and identify the cases where multiple small jobs have been submitted by the same scientists and then redirect job from the same community account or user to different clusters. Our approach uses a NAT firewall to make nodes/VMs, without a Public IP, visible to Mesos for the unified view.