AREP: Adaptive Resource Efficient Prefetching for Maximizing Multicore Performance
AREP: Adaptive Resource Efficient Prefetching for Maximizing Multicore Performance
复制标题
AREP：自适应资源高效预取，可最大限度地提高多核性能
DOI：
--
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
D. Black
中科院分区：
文献类型：
--
作者：
Muneeb Khan;M. Laurenzano;Jason Mars;Erik Hagersten;D. Black
现代处理器广泛使用硬件预取来隐藏内存延迟。虽然激进的硬件预取器可以显著提高某些应用程序的性能，但它们可能会使片外带宽饱和并浪费末级缓存容量，从而限制高利用率多核处理器的整体性能。由于对这些共享资源的争用，共同执行的应用程序可能会变慢。这项工作引入了自适应资源高效预取(AREP)--一个动态组合软件预取和硬件预取以最大化高利用率多核处理器吞吐量的运行时框架。AREP通过以资源高效的方式预取数据来实现更好的性能--通过准确的预取节省片外带宽和末级高速缓存容量，并在可能的情况下应用高速缓存旁路。AREP动态探索硬件/软件预取策略的组合，然后选择并应用性能最佳的策略。AREP是阶段感知的，并(在运行时)重新探索在阶段边界处的最佳预取策略。在现代高性能多核上使用工作负载组合和并行应用程序进行的大量实验表明，AREP可以将吞吐量提高高达49%(平均为8.1%)。此外，还改善了公平性，使平均服务质量超过94%。
Modern processors widely use hardware prefetching to hide memory latency. While aggressive hardware prefetchers can improve performance significantly for some applications, they can limit the overall performance in highly-utilized multicore processors by saturating the offchip bandwidth and wasting last-level cache capacity. Co-executing applications can slowdown due to contention over these shared resources. This work introduces Adaptive Resource Efficient Prefetching (AREP) -- a runtime framework that dynamically combines software prefetching and hardware prefetching to maximize throughput in highly utilized multicore processors. AREP achieves better performance by prefetching data in a resource efficient way -- conserving offchip-bandwidth and last-level cache capacity with accurate prefetching and by applying cache-bypassing when possible. AREP dynamically explores a mix of hardware/software prefetching policies, then selects and applies the best performing policy. AREP is phase-aware and re-explores (at runtime) for the best prefetching policy at phase boundaries. A multitude of experiments with workload mixes and parallel applications on a modern high performance multicore show that AREP can increase throughput by up to 49% (8.1% on average). This is complemented by improved fairness, resulting in average quality of service above 94%.