Evaluating the effort involved in relevance assessments for images
Evaluating the effort involved in relevance assessments for images
复制标题
评估图像相关性评估所涉及的工作
DOI:
10.1145/2600428.2609466
复制
发表时间:
2014
期刊:
影响因子:
--
通讯作者:
Halvey M
中科院分区:
文献类型:
--
作者:
Halvey M
How assessors and end users judge the relevance of images has been studied in information science and information retrieval for a considerable time. The criteria by which assessors' judge relevance has been intensively studied, and there has been a large amount of work which has investigated how relevance judgments for test collections can be more cheaply generated, such as through crowd sourcing. Relatively little work has investigated the process individual assessors go through to judge the relevance of an image. In this paper, we focus on the process by which relevance is judged for images, and in particular, the degree of effort a user must expend to judge relevance for different topics. Results suggest that topic difficulty and how semantic/visual a topic is impact user performance and perceived effort.
登录
查看更多内容
DOI:
--
发表时间:
2013
期刊:
Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
影响因子:
--
作者:
L. Azzopardi;D. Kelly;Kathy Brennan
通讯作者:
Kathy Brennan
DOI:
10.1016/s0306-4573(98)00025-9
发表时间:
1998-09
期刊:
Inf. Process. Manag.
影响因子:
--
作者:
A. Spink;Howard Greisdorf;Judy Bateman
通讯作者:
A. Spink;Howard Greisdorf;Judy Bateman
影响因子:
1.5
作者:
B. Burford;P. Briggs;J. Eakins
通讯作者:
J. Eakins
DOI:
10.1145/2484028.2484150
发表时间:
2013
期刊:
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
影响因子:
--
作者:
R. Villa;Martin Halvey
通讯作者:
Martin Halvey