How Crowdsourcable is Your Task
How Crowdsourcable is Your Task
复制标题
您的任务如何众包
DOI：
--
复制
发表时间：
2011
期刊：
影响因子：
--
通讯作者：
A. DeVries
中科院分区：
文献类型：
--
作者：
Carsten Eickhoff;A. DeVries
htmlabstract最近，众包已经成为一种为需要人类智慧的任务创建资源的公认方法。信息检索和相关领域经常将其用于系统构建和评估目的。然而，恶意员工往往试图通过产生通用答案而不是实际工作来最大化他们的经济利益。识别这些人是一个具有挑战性的过程，众包提供者和请求者都投入了大量的时间。在这项工作中，我们的目标是确定我们可以采取的措施，使众包任务更能抵抗欺诈企图。
htmlabstractLately, crowdsourcing has become an accepted means of creating resources for tasks that require human intelligence. Information Retrieval and related fields frequently exploit it for system building and evaluation purposes. However, malicious workers often try to maximise their financial gains by producing generic answers rather than actually working on the task. Identifying these individuals is a challenging process into which both crowdsourcing providers and requesters invest significant amounts of time. In this work we aim to identify measures that we can take to make a crowdsourced task more resistant to fraudulent attempts.