NeTS: CSR: Large: Collaborative Research: Co-Design of Network, Storage and Computation Fabrics for Disaggregated Datacenters

传统的数据中心是使用服务器构建的，每个服务器都将少量的CPU（中央处理单元）、内存和存储紧密集成到单个主板上。然而，Dennard扩展的终结和摩尔定律的放缓导致了这种以服务器为中心的架构的几个基本限制的浮现（例如，内存容量墙使得cpu -内存共定位不可持续）。因此，一种新的计算范式正在出现——一种分解的体系结构，其中每种资源类型都被构建为一个独立的“刀片”，网络结构将机架内部和机架之间的资源刀片互连起来。计算机体系结构社区已经建立了这种分解体系结构的许多好处，包括拥有10-100倍大的资源容量的潜力。虽然从计算机体系结构的角度来看是有益的，但分解的体系结构改变了一些曾经指导现有网络、系统和应用程序设计和优化的假设（例如，cpu -存储托管、高cpu -内存带宽、存储层次、数据局域性、故障模型等）。因此，利用分解体系结构的好处将需要重新构建遗留系统和网络。该项目旨在共同设计用于分解数据中心的网络、存储和计算结构。在网络方面，该项目将设计超低延迟机架内和机架间结构，包括一个新的网络软件堆栈，该网络软件堆栈结合了高效的拥塞控制、容错和调度机制。网络和存储结构的协同设计将带来用于分解存储的新的（分布式）内存和存储管理堆栈，以及一个资源管理器，它可以跨共享分解存储和网络结构的多个应用程序提供必要的隔离、共享和弹性保证。最后，该项目将构建新的分布式编程框架，并重新构建现有应用程序，以便在分解的体系结构上高效、正确地运行。该项目将为围绕这一新兴计算范式的一些最困难和最重要的技术问题提供解决方案，并将主要通过教育和推广活动以及技术转让产生广泛的社区影响。这个项目产生的软件工件将公开发布，以确保可重复性并促进后续研究。该项目还包含大量教育内容，包括新课程和公开发布教材。最后，该项目将通过对研究生和博士后学者的指导、年度研讨会和行业务静会，为建立一个跨学科研究社区提供必要的推动力，以弥合工业发展与学术研究之间的差距。

Traditional datacenters are built using servers, each of which tightly integrates a small amount of CPU (central processing unit), memory and storage onto a single motherboard. However, the end of Dennard's scaling and the slowdown of Moore's Law has led to surfacing of several fundamental limitations of such server-centric architectures (e.g., the memory-capacity wall making CPU-memory co-location unsustainable). Consequently, a new computing paradigm is emerging -- a disaggregated architecture, where each resource type is built as a standalone 'blade' and a network fabric interconnects the resource blades within and across racks. The computer architecture community has established a number of benefits of such disaggregated architectures, including the potential to have 10-100x larger resource capacity. While beneficial from the computer architecture perspective, disaggregated architectures alter several assumptions that once guided the design and optimization of existing networks, systems and applications (e.g., CPU-storage colocation, high CPU-memory bandwidth, storage hierarchy, data locality, failure models, etc.). Capitalizing on the benefits of disaggregated architectures will thus require re-architecting legacy systems and networks. This project aims to co-design the network, storage and compute fabrics for disaggregated datacenters.On the network front, the project will design ultra-low latency intra-rack and inter-rack fabrics including a new network software stack that incorporates efficient congestion control, failure tolerance and scheduling mechanisms. The co-design of network and storage fabrics will lead to new (distributed) memory and storage management stacks for disaggregated storage, and a resource manager that provides essential isolation, sharing and elasticity guarantees across multiple applications sharing disaggregated storage and network fabrics. Finally, the project will build new distributed programming frameworks and re-architect existing applications to efficiently and correctly operate on disaggregated architectures. This project will provide solutions to some of the most difficult and important technical questions surrounding this emerging computing paradigm and will have broad community impact primarily through educational and outreach activities, and technology transfer. Software artifacts resulting from this project will be publicly released to ensure repeatability and to foster follow up research. The project also has a substantial educational component including new courses and public release of teaching materials. Finally, the project will provide the necessary thrust to build an inter-disciplinary research community via mentoring of graduate students and postdoctoral scholars, yearly workshops and industry retreats to bridge the gap between industrial development and academic research.