SHARP: Software Hint-Assisted Memory Access Prediction for Graph Analytics
SHARP: Software Hint-Assisted Memory Access Prediction for Graph Analytics
复制标题
DOI：
10.1109/hpec55821.2022.9926307
复制
发表时间：
2022-09
期刊：
影响因子：
--
通讯作者：
Pengmiao Zhang;R. Kannan;Xiangzhi Tong;Anant V. Nori;V. Prasanna
中科院分区：
文献类型：
--
作者：
Pengmiao Zhang;R. Kannan;Xiangzhi Tong;Anant V. Nori;V. Prasanna
内存系统性能是大规模图分析中的主要瓶颈。数据预取的可以隐藏内存延迟；这依赖于对内存访问的准确预测。尽管最近的机器学习方法在内存访问预测方面表现良好，但它们仅限于构建通用模型，而忽略了软件中处理阶段变化后的内存访问模式的转移。我们提出了Sharp：在多核共享记忆平台上，在散点机范式下进行图形分析的新型软件辅助内存访问预测方法。我们介绍了由程序员插入生成的暗示软件提示，这些暗示明确表示图形处理程序的处理阶段，即散射或聚集。在软件提示的辅助下，我们开发了特定于阶段的预测模型，这些模型使用基于注意的神经网络，并通过记忆痕迹训练具有丰富的上下文信息。我们使用三种广泛使用的图形算法和各种数据集进行评估。关于FL得分，Sharp的表现优于散布阶段的广泛使用的Delta-LSTM模型，而散布阶段的表现为16.45％-18.93％，而收集阶段的差异为9.50％-22.25％散点阶段为3.66％-7.48％，聚集阶段为2.69％-7.59％。
Memory system performance is a major bottleneck in large-scale graph analytics. Data prefetching can hide memory latency; this relies on accurate prediction of memory accesses. While recent machine learning approaches have performed well on memory access prediction, they are restricted to building general models, ignoring the shift of memory access patterns following the change of processing phases in software. We propose SHARP: a novel Software Hint-Assisted memoRy access Prediction approach for graph analytics under Scatter-Gather paradigm on multi-core shared-memory platforms. We intro-duce software hints, generated from programmer insertion, that explicitly indicate the processing phase of a graph processing program, i.e., Scatter or Gather. Assisted by the software hints, we develop phase-specific prediction models that use attention-based neural networks, trained by memory traces with rich context information. We use three widely-used graph algorithms and a variety of datasets for evaluation. With respect to Fl-score, SHARP outperforms the widely-used Delta-LSTM model by 16.45%-18.93% for the scatter phase and 9.50%-22.25% for the Gather phase, and outperforms the state-of-the-art TransFetch model by 3.66%-7.48% for the scatter phase and 2.69%-7.59% for the Gather phase.