DIverse DatabasE ReplicatiOn - Performance Comparison (DIDERO-PC)

多样化数据库复制 - 性能比较 (DIDERO-PC)

• 批准号: EP/J022128/1
• 负责人: Vladimir Stankovic
• 金额: $ 12.41万
• 依托单位: City, University of London
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2013
• 资助国家: 英国
• 起止时间: 2013 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FJ022128%2F1
• 关键词: DIverse; DatabasE; ReplicatiOn; Performance; Comparison

This proposal is about experimental evaluation of diverse database replication protocols. It aims at comparing the performance of several database replication protocols, which protect against non-crash failures and are based on use of diverse, i.e. different by design, database management systems (DBMSs). These DBMSs are developed by different vendors, and can be either commercial (e.g. Microsoft SQL Server, Oracle), or open-source products (e.g. MySQL, PostgreSQL). The experimental evaluation will be conducted using two approaches: a model-based approach and a direct experimentation on a testbed with "real" systems.Diverse database replication protocols have a potential of providing higher dependability assurance than traditional approaches that are based on the use of the DBMSs from the same vendor (research from the Centre for Software Reliability (CSR) at City University London has contributed significantly to that finding). However, besides achieving appropriate dependability level, system designers and other DBMS stakeholders are interested in the performance characteristics offered by alternative solutions. For many applications performance is, in fact, the dominant criterion in the selection process.A fair and thorough performance comparison between database replication protocols, including the ones studied in this proposal, is of great benefit to system designers when making decisions about which one is most suitable to integrate in their system. This is the main motivation of the proposal.The project aims at comparing the performance of three database replication protocols which guard against non-crash failures and are based on use of diverse DBMSs: our DivRep (the reference point), SES and Byzantium. There are two main objectives of the particular performance evaluation to be achieved:- Objective 1 - evaluation based on using "real" systems on an experimental testbed, i.e. using respective implementations of the replication protocols together with the real DBMSs.- Objective 2 - model-based evaluation, whereby each replication protocol, as well as DBMS resources, are represented with a suitable model (implemented in a particular tool of choice) and the protocol performance measured by simulation of the respective model.Performance comparison of DBMSs and related replication protocols is too often based only on the comparison that uses (synthetic) benchmarks, which in most cases do not reflect the operational profile of the system under test. In addition, there are limits to what one can achieve with performance comparison based only on experimental evaluation with "real" systems: one can feasibly explore only a limited range of parameter values (such as number of replicas, ratio between read and write operations, etc). In contrast, model-based approach offers greater flexibility by providing means for evaluation with a wide range of configuration parameters in a practical manner. Therefore, the proposal aims at satisfying the following objective:- Objective 3 - provision of a general-purpose methodology for model-based performance evaluation of database replication protocols.

这个建议是关于不同的数据库复制协议的实验评估。它旨在比较几种数据库复制协议的性能，这些协议可以防止非崩溃故障，并基于使用不同的数据库管理系统（DBMS）。这些DBMS由不同的供应商开发，可以是商业产品（例如Microsoft SQL Server，Oracle），也可以是开源产品（例如MySQL，PostgreSQL）。将采用两种方法进行实验评价：一种基于模型的方法和在“真实的”系统的试验台上的直接试验。与基于使用来自同一供应商的DBMS的传统方法相比，不同的数据库复制协议具有提供更高可靠性保证的潜力（伦敦城市大学软件可靠性中心（CSR）的研究对这一发现做出了重大贡献）。然而，除了达到适当的可靠性水平，系统设计人员和其他DBMS利益相关者感兴趣的是替代解决方案提供的性能特征。事实上，对于许多应用程序来说，性能是选择过程中的主要标准。数据库复制协议（包括本提案中研究的协议）之间的公平而彻底的性能比较对于系统设计人员在决定哪一个最适合集成到他们的系统中时非常有益。该项目旨在比较三种数据库复制协议的性能，这三种数据库复制协议可以防止非崩溃故障，并且基于使用不同的DBMS：我们的DivRep（参考点），SES和Byzantium。- 目标1 -基于在实验测试台上使用“真实的”系统的评估，即使用复制协议的相应实现以及真实的DBMS。目标2 -基于模型的评估，其中每个复制协议以及DBMS资源都用合适的模型表示（在选择的特定工具中实现）和通过模拟相应模型测量的协议性能。DBMS和相关复制协议的性能比较通常仅基于使用的比较（合成）基准，在大多数情况下，并不反映测试系统的操作概况。此外，仅基于“真实的”系统的实验评估的性能比较所能达到的效果是有限的：人们只能可行地探索有限范围的参数值（例如副本数量、读写操作之间的比率等）。相比之下，基于模型的方法提供了更大的灵活性，提供了一个实用的方式与广泛的配置参数的评估手段。因此，该提案旨在满足以下目标：-目标3 -提供一种通用的方法，用于基于模型的数据库复制协议的性能评估。

项目成果

Quantitative Evaluation of Systems - 12th International Conference, QEST 2015, Madrid, Spain, September 1-3, 2015, Proceedings

系统定量评估 - 第 12 届国际会议，QEST ​​2015，西班牙马德里，2015 年 9 月 1-3 日，会议记录

• DOI: 10.1007/978-3-319-22264-6_2
• 发表时间: 2015
• 作者: Popov P