Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace
Understanding Workers, Developing Effective Tasks, and Enhancing Marketplace Dynamics: A Study of a Large Crowdsourcing Marketplace
复制标题
DOI：
10.14778/3067421.3067431
复制
发表时间：
2017-03-01
影响因子：
2.5
通讯作者：
Widom, Jennifer
中科院分区：
文献类型：
--
作者：
Jain, Ayush;Das Sarma, Akash;Widom, Jennifer
我们对2012-2016年间发布给一家大型众包市场的7万多名员工执行的2700多万项微任务的数据集进行了实验分析。使用这些以前从未在学术环境中分析过的数据，我们阐明了众包的三个关键方面：(1)任务设计-帮助请求者了解什么构成有效的任务，以及如何着手设计任务；(2)市场动态，帮助市场管理员和设计师了解任务和员工之间的交互，以及相应的市场负载；以及(3)员工行为-了解员工的注意力持续时间、生命周期和一般行为，以改善整个众包生态系统。
We conduct an experimental analysis of a dataset comprising over 27 million microtasks performed by over 70,000 workers issued to a large crowdsourcing marketplace between 2012-2016. Using this data-never before analyzed in an academic context-we shed light on three crucial aspects of crowdsourcing: (1) Task design - helping requesters understand what constitutes an effective task, and how to go about designing one; (2) Marketplace dynamics helping marketplace administrators and designers understand the interaction between tasks and workers, and the corresponding marketplace load; and (3) Worker behavior - understanding worker attention spans, lifetimes, and general behavior, for the improvement of the crowdsourcing ecosystem as a whole.