Not Everyone Writes Good Examples but Good Examples Can Come from Anywhere
Not Everyone Writes Good Examples but Good Examples Can Come from Anywhere
复制标题
不是每个人都能写出好的例子，但好的例子可以来自任何地方
DOI：
--
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
E. Brunskill
中科院分区：
文献类型：
--
作者：
Shayan Doroudi;Ece Kamar;E. Brunskill
在许多网络环境中，比如大规模开放式在线课程和众包平台，很多人解决类似的复杂任务。作为解决这些任务的一个副产品，会产生一批成果，这些成果可能有助于其他人在类似任务中表现得更好。在本文中，我们探讨众包工作者自然完成的工作是否可以用作示例，以帮助未来的众包工作者在类似任务中表现更好。我们在产品比较评价任务的背景下进行探讨，在该任务中，工作者必须对成对的相似产品进行比较和对比。我们首先表明，随机展示一两个同行生成的示例并不会显著提高未来任务的绩效。在第二个实验中，我们表明，展示质量足够高的示例会使未来工作者在近迁移任务中的绩效在统计上有显著提高。此外，我们的结果表明，即使在高质量的示例中，示例的有效性也存在差异，这表明质量并非教学价值的完美替代指标。
In many online environments, such as massive open online courses and crowdsourcing platforms, many people solve similar complex tasks. As a byproduct of solving these tasks, a pool of artifacts are created that may be able to help others perform better on similar tasks. In this paper, we explore whether work that is naturally done by crowdworkers can be used as examples to help future crowdworkers perform better on similar tasks. We explore this in the context of a product comparison review task, where workers must compare and contrast pairs of similar products. We first show that randomly presenting one or two peer-generated examples does not significantly improve performance on future tasks. In a second experiment, we show that presenting examples that are of sufficiently high quality leads to a statistically significant improvement in performance of future workers on a near transfer task. Moreover, our results suggest that even among high quality examples, there are differences in how effective the examples are, indicating that quality is not a perfect proxy for pedagogical value.