Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
复制标题
DOI：
10.1093/pan/mpr057
复制
发表时间：
2012-06-01
影响因子：
5.4
通讯作者：
Lenz, Gabriel S.
中科院分区：
文献类型：
--
作者：
Berinsky, Adam J.;Huber, Gregory A.;Lenz, Gabriel S.
我们研究了与使用Amazon.com的Mechanical Turk（MTurk）界面进行受试者招募相关的权衡。我们首先描述MTurk及其作为执行低成本和易于现场实验的工具的承诺。然后，我们评估使用MTurk进行的实验的内部和外部有效性，采用可用于评估其他主题池的框架。我们首先调查的MTurk人口的样本的特点。我们发现，以这种方式招募的受访者往往比亲自便利样本更能代表美国人口，这是已发表的实验政治科学中的模态样本，但比基于互联网的小组或国家概率样本中的受试者代表性较低。最后，我们使用MTurk样本复制了重要的已发表实验工作。
We examine the trade-offs associated with using Amazon.com's Mechanical Turk (MTurk) interface for subject recruitment. We first describe MTurk and its promise as a vehicle for performing low-cost and easy-to-field experiments. We then assess the internal and external validity of experiments performed using MTurk, employing a framework that can be used to evaluate other subject pools. We first investigate the characteristics of samples drawn from the MTurk population. We show that respondents recruited in this manner are often more representative of the U.S. population than in-person convenience samples-the modal sample in published experimental political science-but less representative than subjects in Internet-based panels or national probability samples. Finally, we replicate important published experimental work using MTurk samples.