Survey Satisficing Inflates Reliability and Validity Measures: An Experimental Comparison of College and Amazon Mechanical Turk Samples
Survey Satisficing Inflates Reliability and Validity Measures: An Experimental Comparison of College and Amazon Mechanical Turk Samples
复制标题
DOI：
10.1177/0013164415627349
复制
发表时间：
2016-12-01
影响因子：
2.7
通讯作者：
Taylor, Wyn
中科院分区：
文献类型：
--
作者：
Hamby, Tyler;Taylor, Wyn
本研究考察了调查满意度的预测因素和心理测量结果，其中受访者提供快速，足够好的答案（满意）而不是仔细考虑的答案（优化）。我们对大学生和受访者进行了调查，其中一半人拥有有偿调查网站的大学学位，我们使用实验方法随机分配参与者的调查格式，可能是不同的任务难度。基于满足理论，我们预测能力、动机和任务难度会预测满足行为，而满足会人为地夸大内部一致性、信度以及收敛效度和判别效度的相关性。事实上，研究结果表明，任务难度和动机对预测调查满意度有影响，并且研究第一部分的满意度与研究第二部分的内部一致性信度和收敛效度的提高有关，但与区分效度的降低有关。讨论了研究设计和改进的意义。
This study examined the predictors and psychometric outcomes of survey satisficing, wherein respondents provide quick, good enough answers (satisficing) rather than carefully considered answers (optimizing). We administered surveys to university students and respondentshalf of whom held college degreesfrom a for-pay survey website, and we used an experimental method to randomly assign the participants to survey formats, which presumably differed in task difficulty. Based on satisficing theory, we predicted that ability, motivation, and task difficulty would predict satisficing behavior and that satisficing would artificially inflate internal consistency reliability and both convergent and discriminant validity correlations. Indeed, results indicated effects for task difficulty and motivation in predicting survey satisficing, and satisficing in the first part of the study was associated with improved internal consistency reliability and convergent validity but also worse discriminant validity in the second part of the study. Implications for research designs and improvements are discussed.