NeTS: Small: RDMA over Ethernet: A Control Theoretic Approach

数据中心应用程序--无论是云存储、大数据处理还是桌面虚拟化--都需要高带宽（40千兆比特/秒或更高）来满足不断增长的需求，以支持国家需求。传统的互联网协议栈不能以这样的速度扩展，因为它们具有非常高的处理要求。 本项目将从控制理论的角度分析正在现场部署的新协议。行业和标准机构对该主题非常感兴趣;调查人员正在与行业合作，并将利用他们的资源进行实施和测试平台评估。 融合以太网上的远程直接内存访问（RDMA）技术正在被部署在数据中心中，以提供超低延迟和高吞吐量的应用程序，具有非常低的CPU开销。 然而，最初的设计缺乏任何正式的控制理论分析。 该机制易于在队列大小和波动的流量振荡。 如何选择算法的各种参数，以及参数选择如何随流的数量或链路容量而变化，这些都不是显而易见的。虽然现有的部署使用40千兆/秒以太网链路，但对100千兆/秒以太网链路的模拟显示了队列的不稳定性、振荡和利用率损失。 本计画的目的是提供一个正式的控制理论分析，以探讨在数据中心的融合式乙太网路上，RDMA协定的拥塞控制。 该提案的主要智力价值是开发拥塞控制协议的正式控制理论模型，以在融合以太网上传输RDMA。 研究人员将利用研究成果为哥伦比亚大学的学生提供创业培训，并正在制定一项试点计划，将创业培训扩展到高中生。

Datacenter applications -- be it cloud storage, big data processing, or desktop virtualization -- need high bandwidth (40 Gigabits/second or more) to meet rising demand in support of national needs. Traditional Internet Protocol stacks don't scale at such speeds, since they have very high processing demands. This project will analyze new protocols being deployed in the field from the point of view of control theory. The topic is of great interest to industry and standards bodies; the investigator is collaborating with industry and will be leveraging their resources for implementation and testbed evaluations. Remote Direct Memory Access (RDMA) over Converged Ethernet technology is being deployed in datacenters to provide ultra-low latency and high throughput to applications, with very low CPU overhead. However, initial designs lack any formal control theoretic analysis. The mechanisms are prone to oscillations in the queue size and fluctuating flow rates. It is not immediately obvious how to choose the various parameters for the algorithms, and how the parameter choices change with the number of flows or link capacities. While existing deployments operate with 40 Gigabit/second Ethernet links, simulations on 100Gigabit/second Ethernet links show instability of the queue, oscillations and loss of utilization. This project aims to provide a formal control theoretic analysis of congestion control in RDMA protocols over converged ethernet in the datacenter. The main intellectual merit of the proposal is to develop formal, control theoretic models of Congestion Control Protocols to transport RDMA over Converged Ethernet. The investigator will leverage the research efforts to deliver entrepreneurship training to Columbia University students, and is developing a pilot program to extend entrepreneurship training to high school students.