CSR: Medium: Scale, Isolation, and Performance in Data Center Networks

现代数据中心在数千台机器上运行着各种各样的操作，如飞行计划、药物发现和互联网搜索。这些服务通常受到底层网络协调并行数据访问的速度的限制。在当前的数据中心中，网络I/O仍然是主要的瓶颈，也是资本支出的重要组成部分（每年100亿美元）。使问题复杂化的是服务之间的干扰、故障导致的停机时间以及违反性能要求所引起的操作问题。该项目将开发具有以下功能的硬件/软件架构：i)数十万台主机的非阻塞带宽；Ii)以最小带宽保证跨服务“切片”；Iii)检测细粒度的性能违规；Iv)容忍一系列故障情况；V)支持终端主机虚拟化和迁移。我们的目标是实现网络基础设施的模块化部署和管理，以跟上数据中心迅速增长的计算和存储爆炸的步伐。这项工作将产生一个功能齐全的可虚拟化数据中心网络结构原型，以支持更高级别的服务。更广泛的影响包括：i)通过加州大学圣地亚哥分校COSMOS计划向代表性不足的少数民族伸出援助之手；Ii)公开发布我们开发的数据中心通信工作负载、协议和算法；Iii)与我们的工业伙伴和顾问委员会合作，解决国家计算基础设施关键部分的关键性能和可靠性问题。一个重要的成果将是培养数据中心网络和云计算方面的学生。

Modern data centers host operations as varied as flight planning, drug discovery, and Internet search running on thousands of machines. These services are often limited by the speed of the underlying network to coordinate parallel data access. In current data centers, network I/O remains a primary bottleneck and a significant fraction of capital expenditure ($10B/year). Compounding the problem are operational issues caused by interference between services, down times due to failures, and violations of performance requirements.This project will develop a hardware/software architecture with the following capabilities: i) non-blocking bandwidth to hundreds of thousands of hosts; ii) ``slicing'' across services with minimum bandwidth guarantees; iii) detecting fine-grained performance violations; iv) tolerating a range of failure scenarios; v) supporting end host virtualization and migration. Our goal is to enable modular deployment and management of networking infrastructure to keep pace with the burgeoning computation and storage explosion in data centers. This work will result in a prototype fully functional virtualizable data center network fabric to support higher-level services.Broader impacts include: i) outreach to under-represented minorities through the UCSD COSMOS program; ii) a public release of the data center communication workloads, protocols, and algorithms we develop; iii) working with our industrial partners and advisory board to address key performance and reliability issues in a critical portion of the national computation infrastructure. A significant outcome will be students trained in data center networking and cloud computing.