Evaluation of an Information System in an Information Seeking Process
Evaluation of an Information System in an Information Seeking Process
复制标题
信息搜索过程中信息系统的评估
DOI：
--
复制
发表时间：
2004
期刊：
影响因子：
--
通讯作者：
Katriina Byström
中科院分区：
文献类型：
--
作者：
L. Blomgren;Helena Vallo;Katriina Byström
本文提出了一种采用布尔搜索技术的作战信息系统的整体评价方法。在系统及其用户运行的实际环境（上下文性）中，对系统（系统视角）及其用户（用户视角）给予同等的关注。除了这些研究目标之外，该研究还有一个方法学目标，即在现实生活环境中测试Borlund[1]开发的评估方法。我们的评估方法包括三角测量法（搜索前问卷，搜索日志，访谈后）以及新颖的互动性能测量，如排名半衰期测量和用户满意度和新新性感知，以补充传统的精度。本研究证实了前期研究的发现，揭示了系统视角评价结果与用户视角评价结果的差异。更具体地说，从用户角度评估系统比从系统角度评估系统性能更好。
This paper presents a holistic evaluation of an operational information system that employs the Boolean search technique. An equal focus is laid on both the system (system perspective) and its users (user perspective) in the actual environment where the system and its users are functioning (contextuality). In addition to these research objectives, the study has a methodological objective to test an evaluation approach developed by Borlund [1] in a real life setting. Our evaluation methodology involves triangulation (pre-search questionnaires; search log; post-interviewing) as well as novel interactive performance measures, such as the Ranked Half-Life measure and the Satisfaction and Novelty perception by users supplementing the traditional Precision. The study confirms the finding of earlier research and reveals the discrepancy between the evaluation results according to the system and the user perspectives. More specifically, the system performed better when evaluated from the user perspective than from the system perspective.