CSR: NeTS: Small: In-Network Resource Management for Rack-Scale Computers

CSR：NetS：小型：机架级计算机的网络内资源管理

• 批准号: 1813487
• 负责人: Vladimir Braverman
• 金额: $ 50万
• 依托单位: Johns Hopkins University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2022-10-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1813487&HistoricalAwards=false
• 关键词: CSR; NeTS; Small; Network; Resource

Datacenters are a critical infrastructure to support modern Internet services like search, social networking and e-commerce. Rack-scale computers are emerging to fundamentally change how datacenters are designed, built and managed. Rack-scale computers disaggregate resources in each rack of servers into separate pools and organize them at the rack level. Such resource disaggregation can enable fine-grained resource allocation and increase resource utilization. Resource management is essential for rack-scale computers to realize fully these benefits. Yet, the densely-packed resources and the rise of millisecond-scale and microsecond-scale tasks pose unprecedented requirements on the throughput and latency for the resource manager. Today's server-based solutions fall short to meet these requirements. This project investigates a new architecture that leverages the power and flexibility of new-generation programmable switches for resource management in rack-scale computers. This project explores the boundary of in-network computing. While networks are traditionally designed for packet forwarding, this project exploits the capability of new-generation programmable switches to realize application-level functionalities that go beyond traditional packet processing. This project uses in-network resource management to exemplify how networks and systems can be deeply integrated and co-designed for next-generation rack-scale computers. This project will not only improve resource management for rack-scale computers in practice, but also provide new architectural and theoretical insights on computer system designs and principles. While the new architecture directly benefits from switch hardware for high performance, the core challenge is to realize generic resource management policies with limited switch functionalities and resources. To address this challenge, this project will exploit compact data structures to efficiently store resource consumption and utilization information with minimal switch resources, and leverage randomized and approximation algorithms to design light-weight mechanisms for the switch data plane to make near-optimal resource management decisions. A prototype system will be implemented with commodity servers and switches and evaluated with microbenchmarks and end-to-end system experiments under a wide range of workloads. This project will provide extensive research, training and educational opportunities for both undergraduate and graduate students, and actively engage women and minorities, with research projects and new course materials. This project will release open-source software for other researchers to leverage and reproduce the results and for the industry to adopt the solutions in practice.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

数据中心是支持搜索、社交网络和电子商务等现代互联网服务的关键基础设施。机架级计算机的出现从根本上改变了计算机中心的设计、构建和管理方式。机架规模的计算机将每个服务器机架中的资源分解到单独的池中，并在机架级别对其进行组织。这种资源分解可以实现细粒度的资源分配并提高资源利用率。资源管理对于机架级计算机充分实现这些好处至关重要。然而，密集封装的资源以及毫秒级和微秒级任务的增加对资源管理器的吞吐量和延迟提出了前所未有的要求。如今基于服务器的解决方案无法满足这些要求。本项目研究了一种新的架构，该架构利用新一代可编程交换机的功能和灵活性，用于机架级计算机的资源管理。这个项目探索了网络计算的边界。虽然网络传统上是为数据包转发而设计的，但该项目利用新一代可编程交换机的能力来实现超越传统数据包处理的应用级功能。该项目使用网络内资源管理来验证如何为下一代机架级计算机深度集成和共同设计网络和系统。 该项目不仅将在实践中改善机架规模计算机的资源管理，而且还将为计算机系统设计和原理提供新的架构和理论见解。虽然新架构直接受益于交换机硬件的高性能，但核心挑战是在有限的交换机功能和资源下实现通用资源管理策略。为了应对这一挑战，该项目将利用紧凑的数据结构，以最少的交换机资源有效地存储资源消耗和利用信息，并利用随机化和近似算法来设计轻量级的交换机数据平面的机制，使接近最佳的资源管理决策。将使用商品服务器和交换机实现原型系统，并在各种工作负载下通过微基准测试和端到端系统实验进行评估。该项目将为本科生和研究生提供广泛的研究、培训和教育机会，并通过研究项目和新的课程材料积极吸引妇女和少数民族参与。该项目将发布开源软件，供其他研究人员利用和复制结果，并供行业在实践中采用解决方案。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Pegasus: Tolerating Skewed Workloads in Distributed Storage with In-Network Coherence Directories

• 发表时间: 2020-10
• 作者: Jialin Li;J. Nelson;Ellis Michael;Xin Jin;Dan R. K. Ports

NetLock: Fast, Centralized Lock Management Using Programmable Switches

• DOI: 10.1145/3387514.3405857
• 发表时间: 2020-07
• 期刊: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication
• 作者: Zhuolong Yu;Yiwen Zhang;V. Braverman;Mosharaf Chowdhury;Xin Jin

Harmonia: Near-Linear Scalability for Replicated Storage with In-Network Conflict Detection

• DOI: 10.14778/3368289.3368301
• 发表时间: 2019-04
• 期刊: Proc. VLDB Endow.
• 作者: Hang Zhu;Zhihao Bai;Jialin Li;Ellis Michael;Dan R. K. Ports;I. Stoica;Xin Jin

Is Network the Bottleneck of Distributed Training?

• DOI: 10.1145/3405671.3405810
• 发表时间: 2020-06
• 期刊: Proceedings of the Workshop on Network Meets AI & ML
• 作者: Zhen Zhang;Chaokun Chang;Haibin Lin;Yida Wang-;R. Arora;Xin Jin

Multitenancy for Fast and Programmable Networks in the Cloud

• 发表时间: 2020-06
• 作者: Tao Wang;Hang Zhu;Fabian Ruffy;Xin Jin;Anirudh Sivaraman;Dan R. K. Ports;Aurojit Panda