MONet: heterogeneous Memory over Optical Network for large-scale data center resource disaggregation
MONet: heterogeneous Memory over Optical Network for large-scale data center resource disaggregation
复制标题
DOI：
10.1364/jocn.419145
复制
发表时间：
2021-05
期刊：
影响因子：
--
通讯作者：
Vaibhawa Mishra;Joshua L. Benjamin;G. Zervas
中科院分区：
文献类型：
--
作者：
Vaibhawa Mishra;Joshua L. Benjamin;G. Zervas
光网络存储(MONet)系统是一种分散的数据中心体系结构，其中可以通过机架内部和机架之间的光交换互连访问串行(HMC)/并行(DDR4)存储资源。基于FPGA/ASIC的定制硬件IP(REMAT)支持异类内存池，支持用于远程访问的光电转换，执行所需的串/并转换，并托管必要的本地内存控制器。通过嵌入在计算卡中的存储控制器访问光学互连的基于HMC(串行I/O类型)的存储卡，从而简化了存储模块附近的硬件。这大大降低了延迟、成本、功耗和空间方面的管理费用。我们通过实验演示了距离、交换跳数、收发器、通道绑定和每个收发器的比特率对误码率、功耗、额外延迟、持续远程内存带宽/吞吐量(使用行业标准基准流)和云工作负载性能(如每秒操作数、平均增加的延迟和每秒失效指令数随YCSB云工作负载缓存)的影响，从而表征了CPU内存性能。Monet将CPU-Memory的操作限制从几厘米提高到几十米，但与直接连接的同等应用程序相比，应用程序的性能损失最低可达10%(36米)。使用所提出的并行拓扑，一个系统可以支持多达100,000张分解卡。
The memory over optical network (MONet) system is a disaggregated data center architecture where serial (HMC)/parallel (DDR4) memory resources can be accessed over optically switched interconnects within and between racks. An FPGA/ASIC-based custom hardware IP (ReMAT) supports heterogeneous memory pools, accommodates optical-to-electrical conversion for remote access, performs the required serial/parallel conversion, and hosts the necessary local memory controller. An optically interconnected HMC-based (serial I/O type) memory card is accessed by a memory controller embedded in the compute card, simplifying the hardware near the memory modules. This substantially reduces overheads on latency, cost, power consumption, and space. We characterize CPU–memory performance by experimentally demonstrating the impact of distance, number of switching hops, transceivers, channel bonding, and bit rate per transceiver on the bit error rate, power consumption, additional latency, sustained remote memory bandwidth/throughput (using industry standard benchmark STREAMS), and cloud workload performance (such as operations per second, average added latency, and retired instructions per second memcached with YCSB cloud workloads). MONet pushes the CPU–memory operational limit from a few centimeters to tens of meters, yet applications can experience as low as 10% performance penalty (at 36 m) compared to a direct-attached equivalent. Using the proposed parallel topology, a system can support up to 100,000 disaggregated cards.