Collecting Online Survey Data: A Comparison of Data Quality among a Commercial Panel & MTurk
Collecting Online Survey Data: A Comparison of Data Quality among a Commercial Panel & MTurk
复制标题
收集在线调查数据：商业样本组数据质量比较
DOI：
10.29115/sp-2020-0015
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Sherice Gearhart
中科院分区：
文献类型：
--
作者：
Bingbing Zhang;Sherice Gearhart
寻求在线数据收集的学者寻求专业小组的帮助，这些小组是招募潜在研究参与者的商业实体。虽然不是为了招募参与者，亚马逊的机械土耳其人（MTurk）服务是一个成本较低的众包平台。本研究比较了从MTurk （N = 760）和专业小组（N = 1,110）收集的数据，以评估数据质量和受访者特征方面。结果表明，基于完成率和通过操作检查的成功率，MTurk可以产生更好的数据质量。参与者在受教育程度、年龄和对某些参与设备的偏好方面也存在差异。总的来说，研究结果提供了研究人员在选择数据收集平台之前收集在线数据时应该考虑的问题。
Scholars seeking online data collection have sought the assistance of professional panels, which are commercial entities that recruit prospective research participants. Although not intended for recruiting participants, Amazon’s Mechanical Turk (MTurk) service is a crowdsourcing platform that is being utilized for a lower cost. This study compares data collected from MTurk (N = 760) and a professional panel (N = 1,110) to assess aspects of data quality and respondent features. Results show that MTurk may produce better data quality based on completion rate and success in passing manipulation checks. Participants also differ in terms of educational attainment, age, and preferences of certain devices used for participation. Overall, results provide insight that researchers collecting online data should take into consideration before choosing a data collection platform.