Dynamic physiological partitioning on a shared-nothing database cluster
Dynamic physiological partitioning on a shared-nothing database cluster
复制标题
DOI：
10.1109/icde.2015.7113359
复制
发表时间：
2014-07
期刊：
影响因子：
--
通讯作者：
D. Schall;T. Härder
中科院分区：
文献类型：
--
作者：
D. Schall;T. Härder
运行在强大的单节点服务器上的传统数据库管理系统（DBMS）通常会为其大部分日常工作负载过度配置，并且由于它们没有显示出足够好的能量比例，因此在未充分利用的情况下浪费了大量能量。一个小型（弱）服务器集群，其大小可以根据当前工作负载动态调整，为这些工作负载提供更好的能量特性。然而，平衡节点之间的利用率所必需的数据迁移是一项重要且耗时的任务，可能会消耗节省的能量。出于这个原因，需要一个复杂且易于调整的分区方案来促进动态重组。在本文中，我们采用了一种最初为SMP系统创建的技术，称为生理分区，在节点之间分配数据，允许轻松地重新分区数据，而不中断事务。我们动态分区数据库表的基础上节点的利用率和给定的能量约束，并比较我们的方法与物理分区和逻辑分区方法。为了量化可能的节能和查询运行时，它可以想象的缺点，我们评估我们的实验集群上的实现，并比较结果w.r.t.性能和能耗。根据工作负载的不同，我们可以在不牺牲太多性能的情况下大幅节省能源。
Traditional database management systems (DBMSs) running on powerful single-node servers are usually over-provisioned for most of their daily workloads and, because they do not show good-enough energy proportionality, waste a lot of energy while underutilized. A cluster of small (wimpy) servers, where its size can be dynamically adjusted to the current workload, offers better energy characteristics for those workloads. Yet, data migration, necessary to balance utilization among the nodes, is a non-trivial and time-consuming task that may consume the energy saved. For this reason, a sophisticated and easy to adjust partitioning scheme fostering dynamic reorganization is needed. In this paper, we adapt a technique originally created for SMP systems, called physiological partitioning, to distribute data among nodes that allows to easily repartition data without interrupting transactions. We dynamically partition DB tables based on the nodes' utilization and given energy constraints and compare our approach with physical partitioning and logical partitioning methods. To quantify possible energy saving and its conceivable drawback on query runtimes, we evaluate our implementation on an experimental cluster and compare the results w.r.t. performance and energy consumption. Depending on the workload, we can substantially save energy without sacrificing too much performance.