Investigating the Relationship between In‐Situ User Expectations and Web Search Behavior
Investigating the Relationship between In‐Situ User Expectations and Web Search Behavior
复制标题
DOI：
10.1002/pra2.740
复制
发表时间：
2022-10
影响因子：
--
通讯作者：
Ben Wang;Jiqun Liu
中科院分区：
文献类型：
--
作者：
Ben Wang;Jiqun Liu
采用前的期望通常作为用户对信息系统评估的一个隐含的参考点，与他们的交互目标、行为和总体满意度密切相关。以前的研究涉及模拟用户期望作为一个功能，在用户建模模型有偏见的搜索行为。然而，仍然有很少的直接证据揭示用户的期望和他们的实际搜索行为之间的关系。为了解决这一差距，我们从受控实验室用户期望研究的参与者那里收集了448个查询会话，并收集了关于他们预期信息增益的直接查询级反馈（例如，有用页面的数量）和预期的搜索努力（例如，点击和停留时间）。据我们所知，这是第一次尝试明确地检查原位搜索期望和用户行为的不同方面之间的联系。关于用户期望的发现促进了我们对用户搜索决策和评估策略的理解，也将促进期望感知用户模型、指标和IR系统的设计和评估。
Pre‐adoption expectations often serve as an implicit reference point in users' evaluation of information systems and are closely associated with their goals of interactions, behaviors, and overall satisfaction. Previous studies have involved simulated user expectation as a feature in user modeling to model biased search actions. However, there is still little direct evidence revealing the relationships between users' expectations and their actual search behaviors. To address the gap, we collected 448 query sessions from participants in a controlled‐lab user expectation study and gathered direct query‐level feedback on their expected information gains (e.g., number of useful pages) and expected search efforts (e.g., clicks and dwell time) under each query. To our knowledge, this is the first attempt to explicitly examine the connections between different aspects of in‐situ search expectations and user behaviors. Findings on user expectation advance our understanding of users' search decision‐making and evaluation strategies and will also facilitate the design and evaluation of expectation‐aware user models, metrics, and IR systems.