Online Worker Fraud and Evolving Threats to the Integrity of MTurk Data: A Discussion of Virtual Private Servers and the Limitations of IP-Based Screening Procedures
Online Worker Fraud and Evolving Threats to the Integrity of MTurk Data: A Discussion of Virtual Private Servers and the Limitations of IP-Based Screening Procedures
复制标题
DOI：
10.2308/bria-18-044
复制
发表时间：
2020-03-01
影响因子：
2.1
通讯作者：
Pearson, Christopher A.
中科院分区：
文献类型：
--
作者：
Dennis, Sean A.;Goodson, Brian M.;Pearson, Christopher A.
我们确定了一个普遍的，但以前没有记录的威胁MTurk数据的可靠性，并讨论这个问题是如何症状的机会和激励，促进在线招聘平台内的欺诈行为。在此过程中，我们解释了IP地址如何从未用于识别个人，并且可能不足以识别和缓解围绕数据完整性的紧急风险。我们讨论了MTurk样本的两项研究，其中包括令人震惊的比例的参与者谁规避了一整套传统的样本筛选方法，并提供令人不安的低质量的反应。这些“不良行为者”通过使用隐藏本地设备IP地址的虚拟专用服务器（VPS）来利用IP筛选程序的固有局限性。虽然服务提供商现在帮助打击这种滥用行为，但知识产权审查程序的潜在局限性仍然存在。我们的研究结果强调了研究界持续努力的重要性，以识别和减轻对数据完整性不断变化的威胁。
We identify a pervasive, yet previously undocumented threat to the reliability of MTurk data-and discuss how this issue is symptomatic of opportunities and incentives that facilitate fraudulent behavior within online recruitment platforms. In doing so, we explain how IP addresses were never intended to identify individuals and are likely insufficient to identify and mitigate emergent risks around data integrity. We discuss MTurk samples for two studies that include alarming proportions of participants who circumvent an entire set of conventional sample screening methods-and provide disturbingly low-quality responses. These "bad actors'' exploited inherent limitations of IP screening procedures by using virtual private servers (VPS) that concealed the IP address of their local devices. While service providers now help target this abuse, the underlying limitations of IP screening procedures remain. Our findings emphasize the importance of continued diligence within the research community to identify and mitigate evolving threats to data integrity.