Designing search engine retrieval effectiveness tests with RAT
Designing search engine retrieval effectiveness tests with RAT
复制标题
使用 RAT 设计搜索引擎检索有效性测试
DOI：
--
复制
发表时间：
2013
影响因子：
--
通讯作者：
Sebastian Sünkler
中科院分区：
文献类型：
--
作者：
D. Lewandowski;Sebastian Sünkler
我们引入相关性评估工具RAT，它允许研究者设计复杂的搜索引擎检索有效性研究。这个基于网络的工具由不同的模块组成，研究人员可以使用这些模块来设计测试，使用屏幕抓取方法从不同的搜索引擎收集结果，并使用众包方法从众多陪审员那里收集判决。我们将软件设计为基于web的应用程序，它允许分布式收集相关判断，等等。使用相关性评估工具允许比以前进行的更大的搜索引擎研究。据我们所知，在学术背景下还没有开发出类似的工具。因此，到目前为止还没有关于这种软件设计的资料。
We introduce the Relevance Assessment Tool RAT, which allows researchers to design complex search engine retrieval effectiveness studies. This Web-based tool consists of different modules that researchers can use to design tests, to collect results from different search engines using a screen-scraping approach, and to collect judgments from a multitude of jurors using a crowdsourcing approach. We designed the software as a Web-based application, which allows for a distributed collection of relevance judgments, and the like. Using the Relevance Assessment Tool allows for much larger search engine studies than previously conducted. To our knowledge, there is no comparable tool that was developed in the academic context. Therefore, no information regarding the design of such software was available to-date.