CSR: NeTS: Small: In-Network Resource Management for Rack-Scale Computers

数据中心是支持搜索、社交网络和电子商务等现代互联网服务的关键基础设施。机架式计算机的出现从根本上改变了数据中心的设计、建造和管理方式。机架式计算机将每个服务器机架中的资源分解到单独的池中，并在机架级别对其进行组织。这样的资源分解可以实现细粒度的资源分配，提高资源利用率。要让机架式计算机充分实现这些优势，资源管理至关重要。然而，密集的资源以及毫秒级和微秒级任务的增加对资源管理器的吞吐量和延迟提出了前所未有的要求。今天的基于服务器的解决方案不能满足这些要求。该项目研究了一种新的架构，该架构利用新一代可编程交换机的功能和灵活性在机架式计算机中进行资源管理。这个项目探索了网络内计算的边界。虽然网络传统上是为分组转发而设计的，但该项目利用新一代可编程交换机的能力来实现超出传统分组处理的应用层功能。该项目使用网络内资源管理来演示如何为下一代机架式计算机深度集成和共同设计网络和系统。该项目不仅将在实践中改进机架式计算机的资源管理，而且还将为计算机系统设计和原理提供新的架构和理论见解。虽然新的体系结构直接受益于交换机硬件的高性能，但核心挑战是在有限的交换机功能和资源的情况下实现通用资源管理策略。为了应对这一挑战，该项目将利用紧凑的数据结构，以最少的交换机资源高效地存储资源消耗和利用率信息，并利用随机化和近似算法来设计轻量级机制，使交换机数据平面做出接近最佳的资源管理决策。原型系统将使用商用服务器和交换机实施，并在各种工作负载下通过微基准和端到端系统实验进行评估。该项目将为本科生和研究生提供广泛的研究、培训和教育机会，并通过研究项目和新的课程材料积极吸引妇女和少数群体的参与。该项目将发布开源软件，供其他研究人员利用和复制结果，并供业界在实践中采用解决方案。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Datacenters are a critical infrastructure to support modern Internet services like search, social networking and e-commerce. Rack-scale computers are emerging to fundamentally change how datacenters are designed, built and managed. Rack-scale computers disaggregate resources in each rack of servers into separate pools and organize them at the rack level. Such resource disaggregation can enable fine-grained resource allocation and increase resource utilization. Resource management is essential for rack-scale computers to realize fully these benefits. Yet, the densely-packed resources and the rise of millisecond-scale and microsecond-scale tasks pose unprecedented requirements on the throughput and latency for the resource manager. Today's server-based solutions fall short to meet these requirements. This project investigates a new architecture that leverages the power and flexibility of new-generation programmable switches for resource management in rack-scale computers. This project explores the boundary of in-network computing. While networks are traditionally designed for packet forwarding, this project exploits the capability of new-generation programmable switches to realize application-level functionalities that go beyond traditional packet processing. This project uses in-network resource management to exemplify how networks and systems can be deeply integrated and co-designed for next-generation rack-scale computers. This project will not only improve resource management for rack-scale computers in practice, but also provide new architectural and theoretical insights on computer system designs and principles. While the new architecture directly benefits from switch hardware for high performance, the core challenge is to realize generic resource management policies with limited switch functionalities and resources. To address this challenge, this project will exploit compact data structures to efficiently store resource consumption and utilization information with minimal switch resources, and leverage randomized and approximation algorithms to design light-weight mechanisms for the switch data plane to make near-optimal resource management decisions. A prototype system will be implemented with commodity servers and switches and evaluated with microbenchmarks and end-to-end system experiments under a wide range of workloads. This project will provide extensive research, training and educational opportunities for both undergraduate and graduate students, and actively engage women and minorities, with research projects and new course materials. This project will release open-source software for other researchers to leverage and reproduce the results and for the industry to adopt the solutions in practice.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.