NeTS: Small: RDMA over Ethernet: A Control Theoretic Approach

数据中心应用--无论是云存储、大数据处理还是桌面虚拟化--都需要高带宽(40 Gb/秒或更高)来满足不断增长的需求，以支持国家需求。传统的互联网协议栈不会以这样的速度扩展，因为它们有非常高的处理要求。本项目将从控制理论的角度对现场部署的新协议进行分析。行业和标准机构对该主题非常感兴趣；调查员正在与行业合作，并将利用他们的资源进行实施和试验台评估。融合以太网上的远程直接内存访问(RDMA)技术正在数据中心部署，以极低的CPU开销为应用程序提供超低延迟和高吞吐量。然而，最初的设计缺乏正式的控制理论分析。这种机制容易引起队列大小的波动和流量的波动。目前还不清楚如何为算法选择各种参数，以及参数选择如何随流的数量或链路容量而变化。虽然现有部署使用40 Gb/秒的以太网链路运行，但对100 Gb/秒的以太网链路的模拟显示队列不稳定、振荡和利用率损失。本项目旨在为数据中心RDMA协议在融合以太网上的拥塞控制提供形式化的控制理论分析。该方案的主要智能优点是开发了形式化的拥塞控制协议的控制理论模型，以在融合的以太网上传输RDMA。调查人员将利用这些研究努力为哥伦比亚大学的学生提供创业培训，并正在开发一项试点计划，将创业培训扩展到高中生。

Datacenter applications -- be it cloud storage, big data processing, or desktop virtualization -- need high bandwidth (40 Gigabits/second or more) to meet rising demand in support of national needs. Traditional Internet Protocol stacks don't scale at such speeds, since they have very high processing demands. This project will analyze new protocols being deployed in the field from the point of view of control theory. The topic is of great interest to industry and standards bodies; the investigator is collaborating with industry and will be leveraging their resources for implementation and testbed evaluations. Remote Direct Memory Access (RDMA) over Converged Ethernet technology is being deployed in datacenters to provide ultra-low latency and high throughput to applications, with very low CPU overhead. However, initial designs lack any formal control theoretic analysis. The mechanisms are prone to oscillations in the queue size and fluctuating flow rates. It is not immediately obvious how to choose the various parameters for the algorithms, and how the parameter choices change with the number of flows or link capacities. While existing deployments operate with 40 Gigabit/second Ethernet links, simulations on 100Gigabit/second Ethernet links show instability of the queue, oscillations and loss of utilization. This project aims to provide a formal control theoretic analysis of congestion control in RDMA protocols over converged ethernet in the datacenter. The main intellectual merit of the proposal is to develop formal, control theoretic models of Congestion Control Protocols to transport RDMA over Converged Ethernet. The investigator will leverage the research efforts to deliver entrepreneurship training to Columbia University students, and is developing a pilot program to extend entrepreneurship training to high school students.