DLM: A distributed Large Memory System using remote memory swapping over cluster nodes
DLM: A distributed Large Memory System using remote memory swapping over cluster nodes
复制标题
DLM：在集群节点上使用远程内存交换的分布式大内存系统
DOI：
10.1109/clustr.2008.4663780
复制
发表时间：
2008
期刊：
影响因子：
--
通讯作者：
M. Sato
中科院分区：
文献类型：
--
作者：
H. Midorikawa;M. Kurokawa;R. Himeno;M. Sato
新兴的64 bitOSpsilas提供了大量的内存地址空间，这对于使用非常大数据的新应用程序至关重要。预计连接节点中的内存可以用于有效地存储交换页面，特别是在具有高速网络（如10 GbE和Infiniband）的专用集群中。在本文中，我们提出了分布式大内存系统（DLM），它提供了非常大的虚拟内存，通过使用远程存储器分布在一个集群中的节点。将使用远程内存的DLM程序的性能与使用本地内存的普通程序进行比较。STREAM、NPB和Himeno基准测试结果表明，DLM比其他使用块交换设备访问远程内存的远程分页方案具有更好的性能。除了性能之外，DLM还具有易于使用和高度可移植性的优点，因为它是一种用户级软件，无需特殊硬件。为了获得高性能，DLM可以独立于内核交换参数来调整其参数。我们还发现，DLMpsilas独立的内核交换提供了更稳定的行为。
Emerging 64 bitOSpsilas supply a huge amount of memory address space that is essential for new applications using very large data. It is expected that the memory in connected nodes can be used to store swapped pages efficiently, especially in a dedicated cluster which has a high-speed network such as 10 GbE and Infiniband. In this paper, we propose the distributed large memory system (DLM), which provides very large virtual memory by using remote memory distributed over the nodes in a cluster. The performance of DLM programs using remote memory is compared to ordinary programs using local memory. The results of STREAM, NPB and Himeno benchmarks show that the DLM achieves better performance than other remote paging schemes using a block swap device to access remote memory. In addition to performance, DLM offers the advantages of easy availability and high portability, because it is a user-level software without the need for special hardware. To obtain high performance, the DLM can tune its parameters independently from kernel swap parameters. We also found that DLMpsilas independence of kernel swapping provides more stable behavior.