CRII: NeTS: A Coordinate System based Network for Data Plane Scalability and High Throughput

云服务和大数据处理的日益普及要求设计高带宽网络，为成千上万台服务器提供可扩展性，并为网络规模的增量增长提供灵活性。最近的工作是研究新的网络架构和协议，以实现大型数据中心的三个重要设计目标，即增量增长的灵活性、大型网络的可伸缩性和高吞吐量。不幸的是，现有的数据中心网络架构只关注上述一个或两个属性，而很少关注其他属性。本研究系统地研究了一种新的基于坐标的网络的架构和设计问题。设计创新包括：(i)网络交换机的随机和密集互连，以实现灵活性；（ii）在虚拟坐标上新颖的贪婪路由协议，以取代基于地址的路由，实现转发平面的可扩展性；（iii）扩展贪婪路由协议，以实现高吞吐量的多路径路由。此外，设计创新提供了支持重要数据中心服务的网络功能，如键值操作和多播。与现有的工作相比，基于坐标的网络为实现这些服务提供了新的机会，而不会耗尽数据平面内存。研究目标包括：(i)设计、实现和评估所提议的网络架构和协议；（ii）在拟议的网络中设计和实施可扩展的数据中心服务，包括键值操作和多播；（iii）设计更新和恢复方法，以保持网络的一致性；（iv）为数据中心网络协议开发一个统一的模拟器，并对所提议的网络进行原型设计。本文的研究成果有助于提高当前数据中心网络的性能和可扩展性，创建一种新的基于虚拟坐标的贪婪路由协议，以及对本科生和研究生进行网络协议设计的教育。鉴于大数据应用和云计算的重要性日益增加，本研究有可能影响学术界、工业、商业和政府的网络运营。这项研究的结果将被纳入肯塔基大学PI教授的本科课程计算机网络和数据库系统导论以及研究生课程高级计算机网络和数据中心网络，云计算和未来互联网。通过本项目训练的学生将能够开发新的协议并在各种测试工具中进行网络实验。PI也在努力融入代表性不足的少数民族。最后，为这项工作构建的模拟器将以开源原型的形式传播。

The growing popularity of cloud services and big data processing requires design of high-bandwidth networks that provide scalability for tens of thousands of servers and flexibility for incremental growth of network size. Recent work has been investigating new network architecture and protocols to achieve three important design goals of large data centers, namely, flexibility for incremental growth, scalability for large networks, and high throughput. Unfortunately, existing data center network architectures focus on one or two of the above properties and pay little attention to the others.This research entails a systematic study of the architecture and design issues of a novel coordinate-based network. The design innovations include (i) a random and dense interconnect of network switches to achieve flexibility, (ii) a novel greedy routing protocol on virtual coordinates to replace address-based routing and achieve forwarding plane scalability, and (iii) extension of the greedy routing protocol for high-throughput multi-path routing.In addition, the design innovations provide network capabilities to support important data center services, such as key-value operations and multicast. Compared to existing work, the coordinate-based network provides new opportunities to achieve these services without exhausting data plane memory.The research objectives include the following: (i) design, implementation, and evaluation of the proposed network architecture and protocols; (ii) design and implementation of scalable data center services in the proposed network, including key-value operations and multicast; (iii) design of the update and recovery methods to maintain a consistent network; and (iv) development of a unified simulator for data center network protocols and prototyping the proposed network.The results of this research contribute towards enhancing the performance and scalability of current data center networks, the creation of a novel greedy routing protocol using virtual coordinates, and the education of undergraduate and graduate students on network protocol design. Given the growing importance of big data applications and cloud computing, the proposed research has the potential to influence network operation in academia, industry, business, and government. The results of this research will be incorporated into the undergraduate course Computer Networking and Introduction to Database Systems and graduate courses Advanced Computer Networking and Data Center Networks, Cloud Computing, and Future Internet taught by the PI at the University of Kentucky. Students trained in this project will be capable to develop new protocols and conduct network experiments in various test tools. The PI is also making effort to integrate under-represented minorities. Finally, the simulator built for this work will be disseminated in the form of an open-source prototype.