Crowdsourcing and personality measurement equivalence: A warning about countries whose primary language is not English
Crowdsourcing and personality measurement equivalence: A warning about countries whose primary language is not English
复制标题
DOI：
10.1016/j.paid.2014.11.017
复制
发表时间：
2015-03-01
影响因子：
4.3
通讯作者：
Newman, Daniel A.
中科院分区：
文献类型：
--
作者：
Feitosa, Jennifer;Joseph, Dana L.;Newman, Daniel A.
在寻找更便宜、更快的数据收集方法的过程中，众包方法（即，在线劳动门户网站，允许独立工作者完成调查，以获得补偿）作为人格研究人员的一种工具越来越受欢迎，尽管缺乏证据表明众包与传统数据收集方法等同。本研究的目的是通过检查众包数据的测量等效性（即，来自Amazon.com的MTurk）与更传统的样本（即，大学生样本和组织雇员样本）。我们的研究结果（使用流行的大五人格测量）提供了所有三个样本测量等效的证据，但有一个重要的例外：众包数据（来自MTurk）仅在回答仅限于来自母语为英语的国家的参与者时，才表现出与传统数据收集方法的测量不变性。虽然MTurk似乎是一个简单的，具有成本效益的数据收集工具，我们的研究结果表明，MTurk的数据是类似的传统收集的数据，只有当MTurk样本仅限于来自英语国家的IP地址。(c)2014爱思唯尔有限公司版权所有。
In the search to find cheaper, faster approaches for data collection, crowdsourcing methods (i.e., online labor portals that allow independent workers to complete surveys for compensation) have risen in popularity as a tool for personality researchers, despite a lack of evidence regarding the equivalence of crowdsourcing with traditional data collection methods. The purpose of this study was to evaluate crowdsourcing as a data collection tool by examining the measurement equivalence of crowdsourced data (i.e., from Amazon.com's MTurk) with more traditional samples (i.e., an undergraduate sample and a sample of organizational employees). Our results (using a popular measure of Big Five personality) provided evidence of measurement equivalence across all three samples, with one important exception: crowdsourced data (from MTurk) only exhibited measurement invariance with traditional data collection methods when responses were restricted to participants from native-English speaking countries. Although MTurk appears to be an easy, cost-effective data collection tool, our results suggest that MTurk data are similar to traditionally-collected data only when the MTurk sample is restricted to IP addresses from English-speaking countries. (c) 2014 Elsevier Ltd. All rights reserved.