BESDUI: A Benchmark for End-User Structured Data User Interfaces
BESDUI: A Benchmark for End-User Structured Data User Interfaces
复制标题
BESDUI：最终用户结构化数据用户界面的基准
DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
David R Karger
中科院分区：
文献类型：
--
作者：
Roberto García;Rosa Gil;J. M. Gimeno;Eirik Bakke;David R Karger
语义网社区在开发语义网搜索和探索系统方面投入了大量的研究工作。但是，虽然评估系统的计算效率很容易，但要评估不同语义系统的用户界面对用户的帮助要困难得多。在这篇文章中，我们提出并演示了使用一个基准来评估这样的用户界面，类似于TREC基准评估传统的搜索引擎。我们的基准测试包括一组典型的用户任务和一个定义良好的程序，用于将这些任务的性能指标分配给语义系统。我们证明了它的应用程序，两个这样的系统，Virtuoso和Rhizomer。我们打算为这项工作发起一个社区对话，这将导致一个普遍接受的框架，比较系统和测量，从而鼓励，朝着更好的语义搜索和探索工具的进展。
The Semantic Web Community has invested significant research efforts in developing systems for Semantic Web search and exploration. But while it has been easy to assess the systems’ computational efficiency, it has been much harder to assess how well different semantic systems’ user interfaces help their users. In this article, we propose and demonstrate the use of a benchmark for evaluating such user interfaces, similar to the TREC benchmark for evaluating traditional search engines. Our benchmark includes a set of typical user tasks and a well-defined procedure for assigning a measure of performance on those tasks to a semantic system. We demonstrate its application to two such system, Virtuoso and Rhizomer. We intend for this work to initiate a community conversation that will lead to a generally accepted framework for comparing systems and for measuring, and thus encouraging, progress towards better semantic search and exploration tools.