WingIt: Efficient Refinement of Unclear Task Instructions

WingIt: Efficient Refinement of Unclear Task Instructions
复制标题

WingIt:高效细化不明确的任务指令

DOI:
--
复制
发表时间:
2018
期刊:
AAAI Conference on Human Computation & Crowdsourcing
影响因子:
--
通讯作者:
Alexander J. Quinn
Alexander J. Quinn
中科院分区:
--
文献类型:
--
作者:
V. K. C. Manam;Alexander J. Quinn

文献摘要

参考文献

被引文献

相似文献

众包具有将单调乏味的工作从时间有限(或耐心有限)的请求者转移到按需劳动力的内在潜力。然而,请求者节省的时间被他们必须花在准备指令和改进指令以解决通常出现的歧义上的时间所抵消。仓促写下的指示应该受到欢迎和支持。本文提出了一组方法,使工人能够处理不清楚或模棱两可的指令,并产生高质量的结果,对请求者的依赖最小。工作人员对请求者需求的直觉被用来将回答问题和修改指令的责任转移给工作人员。我们的系统WingIt实现了这些方法,并演示了通过问题解决与直接编辑指令之间的相对权衡,以及等待请求者的即时响应与允许工作人员根据他们对请求者意图的最佳猜测继续进行之间的相对权衡。
Crowdsourcing has the inherent potential to shift tedious work from requesters with limited time (or patience) to an on-demand workforce. However, the time saved by requesters is offset by the time they must spend preparing instructions and refining them to address the ambiguities that typically arise. Hastily written instructions should be welcomed and supported. This paper presents a set of methods that enable workers to cope with unclear or ambiguous instructions and produce high quality results with minimal reliance on the requester. Workers’ intuition about the requester’s needs is leveraged to move onus for answering questions and revising instructions to workers. Our system, WingIt, implements these methods and demonstrates the relative tradeoffs between resolving by questions versus editing instructions directly, and between waiting for immediate response from the requester versus allowing workers to proceed based on their best guess of the requester’s intent.
不明确的术语如何影响调查数据。
DOI: 10.1086/269312
发表时间: 1992
影响因子: 3.4
作者:
FowlerJr,FJ
通讯作者: FowlerJr,FJ