CRII: NeTS: A Coordinate System based Network for Data Plane Scalability and High Throughput

云服务和大数据处理的日益普及要求设计高带宽网络，为数万台服务器提供可扩展性，并为网络规模的增量增长提供灵活性。最近的工作一直在研究新的网络体系结构和协议，以实现大型数据中心的三个重要设计目标，即增量增长的灵活性、大型网络的可扩展性和高吞吐量。遗憾的是，现有的数据中心网络体系结构只关注上述一种或两种特性，而对其他特性关注较少。设计创新包括：(1)网络交换机的随机密集互联以实现灵活性；(2)基于虚拟坐标的新的贪婪路由协议，以取代基于地址的路由并实现转发平面的可扩展性；(3)扩展贪婪路由协议以实现高吞吐量的多路径路由；此外，设计创新提供了网络能力来支持重要的数据中心服务，如键值操作和组播。与现有的工作相比，基于坐标的网络提供了在不耗尽数据平面存储的情况下实现这些服务的新机会。研究目标包括：(1)设计、实现和评估所提出的网络体系结构和协议；(2)设计和实现所提出的网络中可扩展的数据中心服务，包括键-值操作和多播；(3)设计更新和恢复方法以维护网络的一致性；开发了数据中心网络协议的统一模拟器，并对提出的网络进行了原型设计。研究结果有助于提高现有数据中心网络的性能和可扩展性，创建一种使用虚拟坐标的新型贪婪路由协议，并对本科生和研究生进行网络协议设计教育。鉴于大数据应用和云计算的重要性与日俱增，拟议中的研究有可能影响学术界、工业界、商界和政府的网络运营。这项研究的结果将被纳入肯塔基大学PI教授的本科课程计算机网络和数据库系统入门以及研究生课程高级计算机网络和数据中心网络、云计算和未来互联网。接受本项目培训的学生将能够开发新协议并使用各种测试工具进行网络实验。国际和平协会也在努力融合代表不足的少数民族。最后，为这项工作建立的模拟器将以开放源码原型的形式发布。

The growing popularity of cloud services and big data processing requires design of high-bandwidth networks that provide scalability for tens of thousands of servers and flexibility for incremental growth of network size. Recent work has been investigating new network architecture and protocols to achieve three important design goals of large data centers, namely, flexibility for incremental growth, scalability for large networks, and high throughput. Unfortunately, existing data center network architectures focus on one or two of the above properties and pay little attention to the others.This research entails a systematic study of the architecture and design issues of a novel coordinate-based network. The design innovations include (i) a random and dense interconnect of network switches to achieve flexibility, (ii) a novel greedy routing protocol on virtual coordinates to replace address-based routing and achieve forwarding plane scalability, and (iii) extension of the greedy routing protocol for high-throughput multi-path routing.In addition, the design innovations provide network capabilities to support important data center services, such as key-value operations and multicast. Compared to existing work, the coordinate-based network provides new opportunities to achieve these services without exhausting data plane memory.The research objectives include the following: (i) design, implementation, and evaluation of the proposed network architecture and protocols; (ii) design and implementation of scalable data center services in the proposed network, including key-value operations and multicast; (iii) design of the update and recovery methods to maintain a consistent network; and (iv) development of a unified simulator for data center network protocols and prototyping the proposed network.The results of this research contribute towards enhancing the performance and scalability of current data center networks, the creation of a novel greedy routing protocol using virtual coordinates, and the education of undergraduate and graduate students on network protocol design. Given the growing importance of big data applications and cloud computing, the proposed research has the potential to influence network operation in academia, industry, business, and government. The results of this research will be incorporated into the undergraduate course Computer Networking and Introduction to Database Systems and graduate courses Advanced Computer Networking and Data Center Networks, Cloud Computing, and Future Internet taught by the PI at the University of Kentucky. Students trained in this project will be capable to develop new protocols and conduct network experiments in various test tools. The PI is also making effort to integrate under-represented minorities. Finally, the simulator built for this work will be disseminated in the form of an open-source prototype.