LabStor: A Modular and Extensible Platform for Developing High-Performance, Customized I/O Stacks in Userspace
LabStor: A Modular and Extensible Platform for Developing High-Performance, Customized I/O Stacks in Userspace
复制标题
DOI：
10.1109/sc41404.2022.00028
复制
发表时间：
2022-11
期刊：
影响因子：
--
通讯作者：
Luke Logan;Jaime Cernuda Garcia;J. Lofstead;Xian-He Sun;Anthony Kougkas
中科院分区：
文献类型：
--
作者：
Luke Logan;Jaime Cernuda Garcia;J. Lofstead;Xian-He Sun;Anthony Kougkas
传统上，I/O系统是在集中式操作系统内核的范围内开发的。这导致了单一和刚性的存储系统，这些系统受到低开发速度，表现力和性能的限制。强加了各种假设，包括依赖于UNIX文件抽象、POSIX标准和一组狭窄的I/O策略。然而，这种单片设计理念使得开发和部署新的I/O方法以满足现代科学应用快速发展的I/O需求变得困难。为此，我们提出了LabVIEW：一个模块化和可扩展的平台，用于开发高性能，定制的I/O堆栈。单一用途的I/O模块（例如I/O插件）可以在用户空间中开发并作为插件发布，而最终用户可以组合这些模块以形成特定于工作负载和硬件的I/O堆栈。评估表明，通过切换到完全模块化的设计，定制的I/O堆栈可以在各种应用中产生高达60%的性能提升。
Traditionally, I/O systems have been developed within the confines of a centralized OS kernel. This led to monolithic and rigid storage systems that are limited by low development speed, expressiveness, and performance. Various assumptions are imposed including reliance on the UNIX-file abstraction, the POSIX standard, and a narrow set of I/O policies. However, this monolithic design philosophy makes it difficult to develop and deploy new I/O approaches to satisfy the rapidly-evolving I/O requirements of modern scientific applications. To this end, we propose LabStor: a modular and extensible platform for developing high-performance, customized I/O stacks. Single-purpose I/O modules (e.g, I/O schedulers) can be developed in the comfort of userspace and released as plug-ins, while end-users can compose these modules to form workload- and hardware-specific I/O stacks. Evaluations show that by switching to a fully modular design, tailored I/O stacks can yield performance improvements of up to 60% in various applications.