Why did you pick that? Visualising relevance criteria in exploratory search
Why did you pick that? Visualising relevance criteria in exploratory search
复制标题
你为什么选择那个？
DOI：
10.1007/s00799-011-0067-7
复制
发表时间：
2010
影响因子：
1.5
通讯作者：
Beresi U
中科院分区：
文献类型：
--
作者：
Beresi U
在这篇文章中，我们提出了一套分析探索性搜索系统试验期间收集的数据的方法，以及用户判断系统检索的信息的相关性的行为。我们提出了三种量化分析编码的定性数据的工具：相关性准则轮廓、相关性判断复杂性和会话可视化。相关性标准简档捕获每个标准使用相对于个人或选定用户组(例如，由用户从属关系和/或研究经验水平定义的组)的搜索会话的显著程度。另一方面，相关性判断的复杂性反映了单一判断过程中涉及的标准的数量。最后，会话可视化将这些结果结合在一起，以顺序表示整个会话中的标准使用和相关性判断，潜在地允许研究人员快速检测关于交互、相关性标准使用和复杂性的新模式。使用罗伯特戈登大学2008年进行的试点用户研究的结果演示了这些工具的使用。最后，我们强调如何使用这些工具来支持数字图书馆终端用户服务的改善。
In this article, we present a set of approaches in analysing data gathered during experimentation with exploratory search systems and users’ acts of judging the relevance of the information retrieved by the system. We present three tools for quantitatively analysing encoded qualitative data: relevance-criteria profile, relevance-judgement complexity and session visualisation. Relevance-criteria profiles capture the prominence of each criterion usage with respect to the search sessions of individuals or selected user groups (e.g. groups defined by the users affiliations and/or level of research experience). Relevance-judgement complexity, on the other hand, reflects the number of criteria involved in a single judgment process. Finally, session visualisation brings these results together in a sequential representation of criteria usage and relevance judgements throughout a session, potentially allowing the researcher to quickly detect emerging patterns with respect to interactions, relevance criteria usage and complexity. The use of these tools is demonstrated using results from a pilot-user study that was conducted at the Robert Gordon University in 2008. We conclude by highlighting how these tools might be used to support the improvement of end-user services in digital libraries.