User adaptation: good results from poor systems
User adaptation: good results from poor systems
复制标题
用户适应：糟糕的系统带来好的结果
DOI：
--
复制
发表时间：
2008
期刊：
影响因子：
--
通讯作者：
P. Kantor
中科院分区：
文献类型：
--
作者：
Catherine L. Smith;P. Kantor
最近的几项研究发现，检索系统的性能和人类搜索者的“成功”之间只有微弱的关系。我们假设，搜索者之所以成功，正是因为他们改变了自己的行为。为了探索系统性能和搜索行为之间可能存在的因果关系，我们控制系统性能，希望能引发自适应搜索行为。36名受试者分别使用标准系统或两个降级系统之一来完成12次检索。使用一个一般的线性模型，我们隔离系统性能的主要影响，通过测量和消除主要影响，由于时间序列的变化，主题的难度，和每个搜索的位置。我们发现，使用我们的降级系统的搜索是成功的，因为那些使用标准系统，但在实现这一成功，他们改变自己的行为的方式，可以测量，在真实的时间，由一个适当的仪表系统。我们的研究结果表明，相当普遍的，行为动力学的某些方面可能会提供系统性能的不显眼的指标。
Several recent studies have found only a weak relationship between the performance of a retrieval system and the "success" achievable by human searchers. We hypothesize that searchers are successful precisely because they alter their behavior. To explore the possible causal relation between system performance and search behavior, we control system performance, hoping to elicit adaptive search behaviors. 36 subjects each completed 12 searches using either a standard system or one of two degraded systems. Using a general linear model, we isolate the main effect of system performance, by measuring and removing main effects due to searcher variation, topic difficulty, and the position of each search in the time series. We find that searchers using our degraded systems are as successful as those using the standard system, but that, in achieving this success, they alter their behavior in ways that could be measured, in real time, by a suitably instrumented system. Our findings suggest, quite generally, that some aspects of behavioral dynamics may provide unobtrusive indicators of system performance.