CAREER: In-Kernel Execution of Storage Functions

职业：存储函数的内核执行

• 批准号: 2143868
• 负责人: Asaf Cidon
• 金额: $ 50.84万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-01-01 至 2026-12-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2143868&HistoricalAwards=false
• 关键词: CAREER; Kernel; Execution; Storage; Functions

Emerging hardware storage devices can achieve millions of operations per second. They can also access data in as little as 2-3 microseconds, representing an order of magnitude improvement over legacy flash memory and hard disk technologies. However, at such low latencies, the overhead of the operating and file system becomes a significant bottleneck to end-to-end storage performance. Storage requests may slow down by 2x or more. The project designs XRP (eXpress Resubmission Path), a Linux-supported framework that allows applications to write storage functions that can be executed by the operating system. XRP allows applications to bypass almost entirely the overhead of the operating and file system. The main research challenge is that by bypassing the operating system’s storage layers, XRP lacks important context about the user’s request, such as who owns the block it is accessing, and how to traverse the application’s data structure safely and concurrently. The project organizes four primary research thrusts: (a) adding support for XRP in the Linux kernel and file system, (b) supporting a variety of storage operations and integrating with real-world storage systems, (c) enforcing quality of service, isolation and fairness of in-kernel storage functions, and (d) implementing in-kernel handling of over-the-network storage requests. Fast storage devices will fundamentally change the way software systems are built, and will require a redesign of the entire storage stack underpinning these systems. By eliminating the software overhead when accessing such devices, while maintaining operating system support, XRP will enable systems to achieve both high throughput and low and predictable tail latency, while leaving intact the existing isolation, security and safety guarantees of the Linux kernel. The immediate benefits will include high-performing datacenter data systems at a reduced cost, which will in turn translate to cost-effective cloud services for end users. Software artifacts will be released under open-source licenses to enable other researchers, and work with hardware and cloud providers to transition our research into practice. The project repository will be available via the principal investigator’s website: https://www.asafcidon.comThis award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

新兴的硬件存储设备可以实现每秒数百万次的操作。 它们还可以在短短2-3微秒内访问数据，与传统的闪存和硬盘技术相比，这是一个数量级的改进。然而，在如此低的延迟下，操作和文件系统的开销成为端到端存储性能的显著瓶颈。 存储请求可能会减慢2倍或更多。该项目设计了XRP（eXpress Resubmission Path），这是一个Linux支持的框架，允许应用程序编写可由操作系统执行的存储功能。 XRP允许应用程序几乎完全绕过操作系统和文件系统的开销。主要的研究挑战是，通过绕过操作系统的存储层，XRP缺乏关于用户请求的重要上下文，例如谁拥有它正在访问的块，以及如何安全并发地遍历应用程序的数据结构。该项目组织了四个主要的研究重点：（a）在Linux内核和文件系统中添加对XRP的支持，（B）支持各种存储操作并与现实世界的存储系统集成，（c）加强服务质量，隔离和公平的内核存储功能，以及（d）实现内核处理网络存储请求。快速存储设备将从根本上改变软件系统的构建方式，并需要重新设计支撑这些系统的整个存储堆栈。通过消除访问此类设备时的软件开销，同时保持操作系统支持，XRP将使系统能够实现高吞吐量和低且可预测的尾部延迟，同时保持Linux内核的现有隔离，安全和安全保证。直接的好处将包括以更低的成本获得高性能的数据中心数据系统，这反过来又将转化为面向最终用户的具有成本效益的云服务。软件工件将在开源许可证下发布，以支持其他研究人员，并与硬件和云提供商合作，将我们的研究转化为实践。项目存储库将通过主要研究者的网站：https://www.asafcidon.comThis奖项反映了NSF的法定使命，并被认为值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估来支持。

项目成果

XRP: In-Kernel Storage Functions with eBPF

• 发表时间: 2022
• 期刊: 2022 IEEE International Conference on Cluster Computing (CLUSTER)
• 作者: Yuhong Zhong;Hao Li;Y. Wu;Ioannis Zarkadas;Jeffrey Tao;Evan Mesterhazy;Michael Makris;Junfeng Yang;Amy Tai;Ryan Stutsman;Asaf Cidon