SPX: Collaborative Research: Scaling the Software-Defined Data Center with Network-Storage Stack Co-Design

SPX：协作研究：通过网络存储堆栈协同设计扩展软件定义的数据中心

• 批准号: 1918757
• 负责人: Soudeh Ghorbani
• 金额: $ 40万
• 依托单位: Johns Hopkins University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1918757&HistoricalAwards=false
• 关键词: SPX; Collaborative; Research; Scaling; Software

Computer data centers today are experiencing a disruptive trend by virtue of becoming software-defined and programmable. Software-defined networking (SDN) and software-defined storage (SDS) have been widely deployed in today's data centers to provide multi-tenant network and storage services. However, due to the lack of coordination between the network and storage software, there are still performance, scalability, and reliability challenges in data centers. As the data center is evolving with software-defined functions (hitherto done through hardware devices), it is the right time to fundamentally address these classical challenges. This project leverages a cross-layer research approach to conduct the fundamental systems and architecture study on the software-defined network and storage. The proposed research activities will benefit the infrastructure and platform development for large-scale data centers. The project will involve active industrial collaborations to carve a path for technology transition to practice. Furthermore, the project will integrate the research developments into new courses that center around network and storage techniques. This project will also recruit and train underrepresented and high school students through various research programs and summer camps.This project investigates a new software-defined architecture that co-designs the system stacks of both SDN and SDS while refining the functionalities of each component. If successful, the project will fundamentally advance design principles and techniques of software-defined data centers. First, the project proposes to refine the functionalities of the control and data plane in SDN and SDS. Such a new architecture enables state sharing between SDN and SDF, which facilitates the global resource management and I/O scheduling to address the performance challenge. Second, to overcome scalability challenges, this project rethinks the design and implementation of concurrency control in the storage stack and proposes an in-network lock manager to scale the concurrent storage accesses. The project further exploits the hardware parallelism available in multi-core CPU chips to speed up the network packet processing. Third, the project analyzes the limitation of existing data replication protocols and proposes an in-network conflict detection scheme to achieve both linear scalability and strong data consistency for replicated storage. Finally, the project applies the proposed techniques to representative multi-tenant storage services such as distributed databases and key-value stores, and new distributed applications.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

如今的计算机数据中心正经历着一种颠覆性的趋势，即软件定义和可编程。软件定义网络（SDN）和软件定义存储（SDS）已被广泛部署在当今的数据中心中，以提供多租户网络和存储服务。然而，由于网络和存储软件之间缺乏协调，数据中心仍然存在性能、可扩展性和可靠性方面的挑战。随着数据中心不断发展软件定义功能（迄今为止通过硬件设备完成），现在是从根本上解决这些经典挑战的正确时机。该项目利用跨层研究方法，对软件定义的网络和存储进行基础系统和架构研究。拟议的研究活动将有利于大型数据中心的基础设施和平台开发。该项目将涉及积极的工业合作，为技术向实践的过渡开辟道路。此外，该项目还将把研究成果整合到以网络和存储技术为中心的新课程中。该项目还将通过各种研究项目和夏令营招募和培训代表性不足的高中学生。该项目研究了一种新的软件定义架构，该架构共同设计SDN和SDS的系统堆栈，同时细化每个组件的功能。如果成功，该项目将从根本上推进软件定义数据中心的设计原则和技术。首先，该项目建议完善SDN和SDS中控制和数据平面的功能。这种新架构实现了SDN和SDF之间的状态共享，这有助于全局资源管理和I/O调度，以解决性能挑战。其次，为了克服可扩展性的挑战，该项目重新考虑了存储堆栈中并发控制的设计和实现，并提出了一个网络锁管理器来扩展并发存储访问。该项目进一步利用多核CPU芯片中可用的硬件并行性来加速网络数据包处理。第三，分析了现有数据复制协议的局限性，提出了一种网络内冲突检测方案，以实现线性可扩展性和高数据一致性的复制存储。最后，该项目将所提出的技术应用于代表性的多租户存储服务，如分布式数据库和键值存储，以及新的分布式应用程序。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

项目成果

NetVRM: Virtual Register Memory for Programmable Networks

• 发表时间: 2022
• 作者: Hang Zhu;Tao Wang;Yi Hong;Dan R. K. Ports;Anirudh Sivaraman;Xin Jin

Jaqen: A High-Performance Switch-Native Approach for Detecting and Mitigating Volumetric DDoS Attacks with Programmable Switches

• 发表时间: 2021
• 作者: Zaoxing Liu;Hun Namkung;G. Nikolaidis;Jeongkeun Lee;Changhoon Kim;Xin Jin;V. Braverman;Minlan Yu-Minlan

Pegasus: Tolerating Skewed Workloads in Distributed Storage with In-Network Coherence Directories

• 发表时间: 2020-10
• 作者: Jialin Li;J. Nelson;Ellis Michael;Xin Jin;Dan R. K. Ports

Runtime Recovery of Web Applications under Zero-Day ReDoS Attacks

零日 ReDoS 攻击下 Web 应用程序的运行时恢复

• DOI: 10.1109/sp40001.2021.00077
• 发表时间: 2021
• 期刊: 2021 IEEE Symposium on Security and Privacy (SP
• 作者: Bai, Zhihao;Wang, Ke;Zhu, Hang;Cao, Yinzhi;Jin, Xin
• 通讯作者: Jin, Xin

NetLock: Fast, Centralized Lock Management Using Programmable Switches

• DOI: 10.1145/3387514.3405857
• 发表时间: 2020-07
• 期刊: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication
• 作者: Zhuolong Yu;Yiwen Zhang;V. Braverman;Mosharaf Chowdhury;Xin Jin