Mochi: Composing Data Services for High-Performance Computing Environments
Mochi: Composing Data Services for High-Performance Computing Environments
复制标题
Mochi：为高性能计算环境构建数据服务
DOI：
10.1007/s11390-020-9802-0
复制
发表时间：
2020
影响因子：
1.9
通讯作者：
Qing Zheng
中科院分区：
文献类型：
--
作者：
R. Ross;George Amvrosiadis;P. Carns;C. Cranor;Matthieu Dorier;K. Harms;G. Ganger;G. Gibson;S. Gutierrez;R. Latham;R. Robey;Dana Robinson;Bradley W. Settlemyer;G. Shipman;Shane Snyder;Jérome Soumagne;Qing Zheng
技术的增强和在高性能计算 (HPC) 平台上运行的应用程序工作流程的不断扩大，推动了新数据服务的开发，这些服务在这些新平台上提供高性能，为各种应用程序提供功能强大且高效的接口和抽象，并且在部署新技术时很容易进行调整。 Mochi 框架支持从可连接模块和子服务的集合中组合出专门的分布式数据服务。 Mochi 不是强迫所有应用程序使用通用的数据暂存和 I/O 软件配置，而是允许每个应用程序使用专门适合其需求和访问模式的数据服务。本文介绍了 Mochi 框架和方法。描述了 Mochi 核心组件和微服务。详细介绍了将 Mochi 方法应用于开发四种专业服务的示例。最后，对 Mochi 核心组件、Mochi 微服务和提供对象模型的组合服务进行性能评估。本文最后对 Mochi 与 HPC 领域相关工作的定位并指出了未来工作的方向。
Technology enhancements and the growing breadth of application workflows running on high-performance computing (HPC) platforms drive the development of new data services that provide high performance on these new platforms, provide capable and productive interfaces and abstractions for a variety of applications, and are readily adapted when new technologies are deployed. The Mochi framework enables composition of specialized distributed data services from a collection of connectable modules and subservices. Rather than forcing all applications to use a one-size-fits-all data staging and I/O software configuration, Mochi allows each application to use a data service specialized to its needs and access patterns. This paper introduces the Mochi framework and methodology. The Mochi core components and microservices are described. Examples of the application of the Mochi methodology to the development of four specialized services are detailed. Finally, a performance evaluation of a Mochi core component, a Mochi microservice, and a composed service providing an object model is performed. The paper concludes by positioning Mochi relative to related work in the HPC space and indicating directions for future work.
GekkoFS - 用于 HPC 应用程序的临时分布式文件系统
DOI：
10.1109/cluster.2018.00049
发表时间：
2018
期刊：
2018 IEEE International Conference on Cluster Computing (CLUSTER)
影响因子：
--
作者：
Miranda;Cortes;Brinkmann
通讯作者：
Brinkmann
DOI：
10.1145/3307681.3325405
发表时间：
2019-06
期刊：
Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing
影响因子：
--
作者：
Anthony Kougkas;H. Devarajan;J. Lofstead;Xian-He Sun
通讯作者：
Anthony Kougkas;H. Devarajan;J. Lofstead;Xian-He Sun