A Slow Algorithm Improves Users' Assessments of the Algorithm's Accuracy
A Slow Algorithm Improves Users' Assessments of the Algorithm's Accuracy
复制标题
慢速算法可以提高用户对算法准确性的评估
DOI：
10.1145/3359204
复制
发表时间：
2019
影响因子：
--
通讯作者：
Karrie Karahalios
中科院分区：
文献类型：
--
作者：
J. Park;Richard B. Berlin;A. Kirlik;Karrie Karahalios
随着计算算法代表我们做出越来越多的具有深远影响且往往有问题的判断，人们越来越有兴趣放慢技术速度，以鼓励用户反思算法做出的判断。之前在慢技术方面的工作已经将慢建立为反思和意外发现的代理;然而，目前还不清楚这种等待时间是否真的有助于用户在使用算法进行判断时获得有用的洞察力或任何其他好处。为此，我们进行了一系列在线和面对面的主题间用户研究，其中我们隔离了算法的速度对用户在简单的视觉识别任务的背景下做出判断时如何结合算法的建议的影响。我们发现，如果算法的响应时间较慢，我们的参与者更多地遵循高质量的算法，而更少地遵循低质量的算法。此外，对面对面研究访谈的定性分析表明，等待并不是浪费时间，而是经常用来反思任务和自己和算法的估计过程，并对两个过程进行比较和重新评估。基于这些发现，我们概述了未来算法系统的设计意义。
With computational algorithms making an increasing number of deeply consequential, and often problematic judgments on our behalf, there is a growing interest in slowing down technology to encourage users to reflect on judgments made by algorithms. Prior work in slow technology has established slowness as an agent of reflection and serendipity; however, it has been unclear whether this waiting time actually helps users gain useful insight or any other benefits as they make judgments using an algorithm. To this end, we conducted a series of online and in-person between-subject user studies in which we isolate the impact of an algorithm's speed on how users incorporate the algorithm's advice when making judgments in the context of simple visual recognition tasks. We find that our participants followed good quality algorithms more and bad quality algorithms somewhat less if the response time of the algorithm is slower. Furthermore, qualitative analysis of the in-person study interviews reveals that the waiting was not time wasted, but was often used to reflect on the task and the estimation process of themselves and the algorithm, and to compare and reevaluate the two processes. Based on these findings, we outline design implications of future algorithmic systems.