Jumanji: The Case for Dynamic NUCA in the Datacenter

Jumanji: The Case for Dynamic NUCA in the Datacenter
复制标题

DOI:
10.1109/micro50266.2020.00061
复制
发表时间:
2020-10
期刊:
2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)
影响因子:
--
通讯作者:
Brian C. Schwedock;Nathan Beckmann
Brian C. Schwedock;Nathan Beckmann
中科院分区:
其他
文献类型:
--
作者:
Brian C. Schwedock;Nathan Beckmann

文献摘要

被引文献

相似文献

数据中心在尾部延迟和安全性方面为计算机系统带来了新的挑战。本文认为,动态NUCA技术是一个更好的解决方案,这些挑战比以前的缓存设计。我们表明,动态NUCA设计可以满足尾延迟的最后期限,更少的缓存空间比以前的工作,他们也提供了一个自然的防御缓存攻击。不幸的是,以前的动态NUCA已经错过了这些机会,因为他们专注于减少数据移动。我们提出了Jumanji,一个动态NUCA技术设计的尾部延迟和安全性。我们发现,以前的最后一级缓存设计容易受到新的攻击,并提供不完美的性能隔离。Jumanji解决了这些问题,同时显著提高了协同运行的批处理应用程序的性能。此外,Jumanji只需要轻量级的硬件和对系统软件的一些简单更改,类似于之前的D-NUCA。在20个核心上,Jumanji平均将批处理加权加速比提高了14%,而安全性较弱的非NUCA设计仅提高了2%,并且与理想化设计相差不到2%。
The datacenter introduces new challenges for computer systems around tail latency and security. This paper argues that dynamic NUCA techniques are a better solution to these challenges than prior cache designs. We show that dynamic NUCA designs can meet tail-latency deadlines with much less cache space than prior work, and that they also provide a natural defense against cache attacks. Unfortunately, prior dynamic NUCAs have missed these opportunities because they focus exclusively on reducing data movement.We present Jumanji, a dynamic NUCA technique designed for tail latency and security. We show that prior last-level cache designs are vulnerable to new attacks and offer imperfect performance isolation. Jumanji solves these problems while significantly improving performance of co-running batch applications. Moreover, Jumanji only requires lightweight hardware and a few simple changes to system software, similar to prior D-NUCAs. At 20 cores, Jumanji improves batch weighted speedup by 14% on average, vs. just 2% for a non-NUCA design with weaker security, and is within 2% of an idealized design.