Design and Evaluation of new mechanisms for crowdsourcing as emerging paradigm for the organization of work in the Internet

作为互联网工作组织新兴范式的众包新机制的设计和评估

• 批准号: 239765193
• 负责人: Professor Dr. Tobias Hoßfeld, since 10/2018
• 金额: --
• 依托单位: Dezernat VI - Forschung und Transfer
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2014
• 资助国家: 德国
• 起止时间: 2013-12-31 至 2020-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/239765193?language=en
• 关键词: Design; Evaluation; new; mechanisms; crowdsourcing

Crowdsourcing is a newly emerging service platform and business model in the Internet. In contrast to outsourcing, where a job is performed by a designated worker or employee, crowdsourcing means to outsource a job to a large, anonymous crowd of workers in the form of an open call. This human crowd is abstracted by a crowdsourcing platform, which distributes the work submitted by an employer among the human worker resources and acts as mediator between worker and employer. The crowdsourcing paradigm is changing dramatically the future of work and work organization in the Internet [Hoß11]. The goal of the research project is to design and to evaluate new mechanisms in order to optimize crowdsourcing as emerging paradigm for the work organization in the Internet. A successful crowdsourcing platform requires a robust and high-performance operation as well as a balance of interests among employer and employees. Therefore, novel mechanisms being developed in the project need to consider all stakeholders. On one hand, the mechanisms aim at reducing job completion times while improving the quality of work which is the key motivation for a long-term usage of crowdsourcing by the employer. On the other hand, a fair and convenient distribution of jobs among the workers in the crowd is a major requirement by the employer. In this context, an appropriate formulation of jobs and the splitting of work into smaller jobs is a key aspect. Another major goal aims at the integration of job- and worker-recommendation systems for employees and employers into crowdsourcing platforms, respectively.Beyond the design of concrete mechanisms, abstract models will be derived for a unified description of crowdsourcing platform and relevant use cases. The models allow to analyze the impact of parameter changes on the performance of platforms and quality of work. Hence, the models are used for evaluation and optimization of the mechanisms designed in the project. Further, the models help to develop a basic understanding of the interaction of platform mechanism and to predict future developments. The fundamental of the models are semantic and statistical analysis of existing crowdsourcing platforms, their workers, and jobs. The project questions the applicability of a unified model for different platforms and use cases or the need for partly specialized models. In particular, the following use cases will be considered in the project: Fraktur recognition and digitization of historical documents, subjective user studies on Quality of Experience, evaluation of recommendation systems for e-learning, mobile crowdsourcing considering device features and its location.

众包是互联网新兴的服务平台和商业模式。外包是指一项工作由指定的工人或雇员完成，与之相反，众包是指将一项工作以公开征集的形式外包给一大群匿名的工人。这个人群被一个众包平台抽象出来，这个平台将雇主提交的工作分配到人力资源中，并充当工人和雇主之间的中介。众包模式正在戏剧性地改变着互联网工作和工作组织的未来[Hoß11]。研究项目的目标是设计和评估新机制，以优化众包作为互联网工作组织的新兴范例。一个成功的众包平台需要稳健、高效的运营，以及雇主和雇员之间的利益平衡。因此，在项目中开发的新机制需要考虑所有利益相关者。一方面，这些机制旨在减少工作完成时间，同时提高工作质量，这是雇主长期使用众包的关键动机。另一方面，在人群中的工人之间公平方便地分配工作是雇主的主要要求。在这方面，适当制订工作和把工作分成较小的工作是一个关键方面。另一个主要目标是将员工和雇主的工作推荐系统和工人推荐系统分别整合到众包平台中。在设计具体机制的基础上，推导抽象模型，统一描述众包平台和相关用例。这些模型可以分析参数变化对平台性能和工作质量的影响。因此，这些模型用于评估和优化项目中设计的机制。此外，这些模型有助于对平台机制的相互作用有一个基本的了解，并预测未来的发展。这些模型的基础是对现有众包平台及其工人和工作的语义和统计分析。该项目质疑统一模型对不同平台和用例的适用性，或者部分专门化模型的需求。该项目将特别考虑以下用例：德国尖角字体的识别和历史文献的数字化，体验质量的主观用户研究，电子学习推荐系统的评估，考虑设备特性及其位置的移动众包。