ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data
ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data
复制标题
ReCache：用于对异构数据进行快速分析的反应式缓存
DOI：
--
复制
发表时间：
2017
影响因子：
2.5
通讯作者：
A. Ailamaki
中科院分区：
文献类型：
--
作者：
T. Azim;M. Karpathiotakis;A. Ailamaki
随着异构格式的数据继续以指数级增长的速度生成，快速分析以提取有意义的信息变得越来越重要。系统广泛使用内存缓存作为加速数据分析的主要技术之一。然而，数据分析系统中的缓存不能依赖于简单的缓存策略和固定的数据布局来实现良好的性能。不同的数据集和工作负载需要不同的布局和策略来实现最佳性能。
本文介绍了ReCache，一个基于缓存的性能加速器，是反应的成本和不同的原始数据格式的异构性。ReCache在查询计划中使用缓存操作和选择操作符的时间度量，考虑了阅读、解析和缓存嵌套格式和表格格式数据的各种成本。将这些度量与工作负载中频繁访问的数据字段的信息相结合，ReCache自动决定是嵌套布局还是面向关系列的布局会带来更好的查询性能。此外，ReCache跟踪常用的操作符，以做出明智的缓存准入和驱逐决策。合成和真实世界的数据集上的实验表明，我们的缓存技术减少了缓存开销为个人查询平均59%。此外，在整个工作负载中，与现有技术相比，ReCache将执行时间减少了19-75%。
As data continues to be generated at exponentially growing rates in heterogeneous formats, fast analytics to extract meaningful information is becoming increasingly important. Systems widely use in-memory caching as one of their primary techniques to speed up data analytics. However, caches in data analytics systems cannot rely on simple caching policies and a fixed data layout to achieve good performance. Different datasets and workloads require different layouts and policies to achieve optimal performance.
This paper presents ReCache, a cache-based performance accelerator that is reactive to the cost and heterogeneity of diverse raw data formats. Using timing measurements of caching operations and selection operators in a query plan, ReCache accounts for the widely varying costs of reading, parsing, and caching data in nested and tabular formats. Combining these measurements with information about frequently accessed data fields in the workload, ReCache automatically decides whether a nested or relational column-oriented layout would lead to better query performance. Furthermore, ReCache keeps track of commonly utilized operators to make informed cache admission and eviction decisions. Experiments on synthetic and real-world datasets show that our caching techniques decrease caching overhead for individual queries by an average of 59%. Furthermore, over the entire workload, ReCache reduces execution time by 19-75% compared to existing techniques.
为现代硬件高效编译高效的查询计划
DOI：
10.14778/2002938.2002940
发表时间：
2011
期刊：
Proc. VLDB Endow.
影响因子：
--
作者：
T. Neumann
通讯作者：
T. Neumann