CRII: NeTS: A Coordinate System based Network for Data Plane Scalability and High Throughput

云服务和大数据处理的日益普及要求设计高带宽网络，为数万台服务器提供可扩展性，并为网络规模的增量增长提供灵活性。最近的工作一直在研究新的网络架构和协议，以实现大型数据中心的三个重要设计目标，即增量增长的灵活性，大型网络的可扩展性和高吞吐量。现有的数据中心网络体系结构只关注其中的一个或两个属性，而对其他属性关注较少，因此本文对一种新型的基于坐标的数据中心网络体系结构和设计问题进行了系统的研究。设计创新包括（i）网络交换机的随机和密集互连以实现灵活性，（ii）虚拟坐标上的新颖贪婪路由协议以取代基于地址的路由并实现转发平面可扩展性，以及（iii）贪婪路由协议的扩展以用于高吞吐量多路径路由。此外，设计创新提供了支持重要数据中心服务的网络能力，例如键值操作和多播。与现有的工作相比，基于坐标的网络提供了新的机会，以实现这些服务，而不耗尽数据平面内存。研究的目标包括以下几个方面：（i）设计，实现，并评估所提出的网络体系结构和协议，（ii）设计和实现可扩展的数据中心服务，在拟议的网络，包括键值操作和组播，㈢设计更新和恢复方法，以保持网络的一致性;以及（iv）开发数据中心网络协议的统一模拟器并对所提出的网络进行原型设计。本研究的结果有助于提高当前数据中心网络的性能和可扩展性，创建一种新的使用虚拟坐标的贪婪路由协议，以及本科生和研究生的网络协议设计教育。鉴于大数据应用和云计算的重要性日益增长，拟议的研究有可能影响学术界，工业界，商业界和政府的网络运营。这项研究的结果将被纳入本科课程计算机网络和数据库系统介绍和研究生课程高级计算机网络和数据中心网络，云计算和未来互联网由PI在肯塔基州大学教授。在这个项目中培训的学生将能够开发新的协议，并在各种测试工具中进行网络实验。PI也在努力融合代表性不足的少数民族。最后，为这项工作建立的模拟器将以开放源码原型的形式传播。

The growing popularity of cloud services and big data processing requires design of high-bandwidth networks that provide scalability for tens of thousands of servers and flexibility for incremental growth of network size. Recent work has been investigating new network architecture and protocols to achieve three important design goals of large data centers, namely, flexibility for incremental growth, scalability for large networks, and high throughput. Unfortunately, existing data center network architectures focus on one or two of the above properties and pay little attention to the others.This research entails a systematic study of the architecture and design issues of a novel coordinate-based network. The design innovations include (i) a random and dense interconnect of network switches to achieve flexibility, (ii) a novel greedy routing protocol on virtual coordinates to replace address-based routing and achieve forwarding plane scalability, and (iii) extension of the greedy routing protocol for high-throughput multi-path routing.In addition, the design innovations provide network capabilities to support important data center services, such as key-value operations and multicast. Compared to existing work, the coordinate-based network provides new opportunities to achieve these services without exhausting data plane memory.The research objectives include the following: (i) design, implementation, and evaluation of the proposed network architecture and protocols; (ii) design and implementation of scalable data center services in the proposed network, including key-value operations and multicast; (iii) design of the update and recovery methods to maintain a consistent network; and (iv) development of a unified simulator for data center network protocols and prototyping the proposed network.The results of this research contribute towards enhancing the performance and scalability of current data center networks, the creation of a novel greedy routing protocol using virtual coordinates, and the education of undergraduate and graduate students on network protocol design. Given the growing importance of big data applications and cloud computing, the proposed research has the potential to influence network operation in academia, industry, business, and government. The results of this research will be incorporated into the undergraduate course Computer Networking and Introduction to Database Systems and graduate courses Advanced Computer Networking and Data Center Networks, Cloud Computing, and Future Internet taught by the PI at the University of Kentucky. Students trained in this project will be capable to develop new protocols and conduct network experiments in various test tools. The PI is also making effort to integrate under-represented minorities. Finally, the simulator built for this work will be disseminated in the form of an open-source prototype.