GPU-Assisted Memory Expansion
GPU-Assisted Memory Expansion
复制标题
DOI：
10.1109/nas51552.2021.9605372
复制
发表时间：
2021-10
期刊：
影响因子：
--
通讯作者：
Pisacha Srinuan;Purushottam Sigdel;Xu Yuan;Lu Peng;Paul Darby;Christopher Aucoin;N. Tzeng
中科院分区：
文献类型：
--
作者：
Pisacha Srinuan;Purushottam Sigdel;Xu Yuan;Lu Peng;Paul Darby;Christopher Aucoin;N. Tzeng
最近的图形处理单元（GPU）通常带有大型板载物理内存，以加速具有常规访问模式的大型数据集上的各种并行程序执行，包括机器学习（ML）和数据挖掘（DM）。这样的GPU可能在冗长的ML模型训练或DM期间未充分利用其物理内存，从而可以将未使用的GPU内存借给在主机上同时执行的应用程序。这项工作探索了一种有效的方法，让内存密集型应用程序在主机CPU上运行，其内存动态扩展到可用的GPU板载DRAM上，称为GPU辅助内存扩展（GAME）。针对配备最新GPU的计算机系统，我们的GAME方法通过按需收集未使用的GPU板载内存进行交换，可以在占用大量内存的CPU上快速执行，远远超过竞争对手的GPU执行。在用户空间中实现，我们的GAME原型让GPU内存透明地容纳交换出的内存页面，而无需修改代码，以实现高可用性和可移植性。NAS-NPB基准测试应用程序的评估表明，当内存占用超过CPU DRAM大小，并且配备的GPU具有未使用的VDRAM可供交换使用时，GAME将单任务（或多任务）执行大大加快了2.1倍（或3.1倍）。
Recent graphic processing units (GPUs) often come with large on-board physical memory to accelerate diverse parallel program executions on big datasets with regular access patterns, including machine learning (ML) and data mining (DM). Such a GPU may underutilize its physical memory during lengthy ML model training or DM, making it possible to lend otherwise unused GPU memory to applications executed concurrently on the host machine. This work explores an effective approach that lets memory-intensive applications run on the host machine CPU with its memory expanded dynamically onto available GPU on-board DRAM, called GPU-assisted memory expansion (GAME). Targeting computer systems equipped with the recent GPUs, our GAME approach permits speedy executions on CPU with large memory footprints by harvesting unused GPU on-board memory on-demand for swapping, far surpassing competitive GPU executions. Implemented in user space, our GAME prototype lets GPU memory house swapped-out memory pages transparently, without code modifications for high usability and portability. The evaluation of NAS-NPB benchmark applications demonstrates that GAME expedites monotasking (or multitasking) executions considerably by up to 2.1× (or 3.1×), when memory footprints exceed the CPU DRAM size and an equipped GPU has unused VDRAM available for swapping use.