SW-Store: a vertically partitioned DBMS for Semantic Web data management

SW-Store: a vertically partitioned DBMS for Semantic Web data management
复制标题

DOI:
10.1007/s00778-008-0125-y
复制
发表时间:
2009-04-01
期刊:
影响因子:
4.2
通讯作者:
Hollenbach, Kate
Hollenbach, Kate
中科院分区:
计算机科学2区
文献类型:
--
作者:
Abadi, Daniel J.;Marcus, Adam;Hollenbach, Kate

文献摘要

被引文献

相似文献

RDF数据的有效管理是实现语义Web愿景的重要前提。随着语义网技术应用于现实世界的应用,性能和可伸缩性问题变得越来越紧迫。在本文中,我们研究了当前RDF数据管理解决方案可伸缩性差的原因,并探讨了这些方法的基本可伸缩性限制。我们回顾了提高RDF数据库性能的最新技术,并考虑了最近提出的一个建议,即“属性表”。然后,我们实际地和经验地讨论了为什么该解决方案具有不受欢迎的特征。作为改进,我们提出了另一种解决方案:对RDF数据进行垂直分区。我们比较了垂直分区与现有技术在大规模(超过5000万个三元组)的库数据目录上由基于Web的RDF浏览器生成的查询上的性能。我们的结果表明,垂直分区模式实现了与属性表技术类似的性能,而设计要简单得多。此外,如果使用面向列的DBMS(专门为垂直分区情况设计的数据库)而不是面向行的DBMS,则可以观察到另一个数量级的性能改进,查询时间从几分钟下降到几秒。受这些结果的鼓舞,我们描述了SW-Store的体系结构,这是我们正在积极构建的一个新的DBMS,它实现了这些技术来实现高性能的RDF数据管理。
Efficient management of RDF data is an important prerequisite for realizing the Semantic Web vision. Performance and scalability issues are becoming increasingly pressing as Semantic Web technology is applied to real-world applications. In this paper, we examine the reasons why current data management solutions for RDF data scale poorly, and explore the fundamental scalability limitations of these approaches. We review the state of the art for improving performance of RDF databases and consider a recent suggestion, "property tables". We then discuss practically and empirically why this solution has undesirable features. As an improvement, we propose an alternative solution: vertically partitioning the RDF data. We compare the performance of vertical partitioning with prior art on queries generated by a Web-based RDF browser over a large-scale (more than 50 million triples) catalog of library data. Our results show that a vertically partitioned schema achieves similar performance to the property table technique while being much simpler to design. Further, if a column-oriented DBMS (a database architected specially for the vertically partitioned case) is used instead of a row-oriented DBMS, another order of magnitude performance improvement is observed, with query times dropping from minutes to several seconds. Encouraged by these results, we describe the architecture of SW-Store, a new DBMS we are actively building that implements these techniques to achieve high performance RDF data management.