Understanding data quality: Instructional comprehension as a practical metric in crowdsourced investigations of behavioral economic cigarette demand.
Understanding data quality: Instructional comprehension as a practical metric in crowdsourced investigations of behavioral economic cigarette demand.
复制标题
DOI：
10.1037/pha0000579
复制
发表时间：
2022-08
影响因子：
2.3
通讯作者：
Bickel, Warren K.
中科院分区：
文献类型：
--
作者：
Freitas-Lemos, Roberta;Tegge, Allison N.;Craft, William H.;Tomlinson, Devin C.;Stein, Jeffrey S.;Bickel, Warren K.
关键词：
众包平台使研究人员能够快速招募和收集吸烟者等物质使用人群的行为经济指标。尽管具有广泛的实用性和灵活性，但数据质量问题一直是人们关注的对象。在两项招募吸烟者的独立研究中，我们试图调查实际质量控制措施（指导测验的准确性）、实验烟草市场（ETM；研究 1）和卷烟购买任务（CPT；研究 2）中每日吸烟数量的内部一致性和烟草制品购买模式之间的关联。参与者（研究 1 中的 N=312 人；研究 2 中的 N=119 人）是从 Amazon Mechanical Turk 招募的。这两项研究都包括任务说明、测验、购买任务、香烟使用和依赖性问题以及人口统计数据。结果显示，正确回答所有指示项目的参与者：1) 报告每天的香烟数量更加一致（部分 η2 = 0.11，p<0.001，研究 1；部分 η2 = 0.09，p=0.016，研究 2）2) 证明卷烟需求曲线之间的模型拟合度有所提高（部分 η2 = 0.23，p<0.001，研究 1；部分 η2 = 0.08，p=0.002，研究 2），并且在 ETM 中购买的烟草产品与当前的使用情况更加一致。我们的结论是，购买任务之前的指导测验可能对研究人员评估需求数据有用。包含多个项目的指导测验可以让研究人员选择适合其研究的数据质量水平。
Crowdsourcing platforms allow researchers to quickly recruit and collect behavioral economic measures in substance-using populations, such as cigarette smokers. Despite the broad utility and flexibility, data quality issues have been an object of concern. In two separate studies recruiting cigarette smokers, we sought to investigate the association between a practical quality control measure (accuracy on an instruction quiz), on internal consistency of number of cigarettes smoked per day and purchasing patterns of tobacco products in an Experimental Tobacco Marketplace (ETM; Study 1), and in a Cigarette Purchase Task (CPT; Study 2). Participants (N=312 in Study 1; N=119 in Study 2) were recruited from Amazon Mechanical Turk. Both studies included task instructions, a quiz, a purchase task, cigarette usage and dependence questions, and demographics. The results show that participants who answered all instruction items correctly: 1) reported the number of cigarettes per day more consistently (partial η2 = 0.11, p<0.001, Study 1; partial η2 = 0.09, p=0.016, Study 2) 2) demonstrated increased model fit among the cigarette demand curves (partial η2 = 0.23, p<0.001, Study 1; partial η2 = 0.08, p=0.002, Study 2), and purchased tobacco products in the ETM more consistently with their current usage. We conclude that instruction quizzes before purchase tasks may be useful for researchers evaluating demand data. Instruction quizzes with multiple items may allow researchers to choose the level of data quality appropriate for their studies.
登录
查看更多内容
影响因子：
2.3
作者：
DeHart WB;Kaplan BA;Pope DA;Mellis AM;Bickel WK
通讯作者：
Bickel WK
影响因子：
5.7
作者：
Chmielewski, Michael;Kucker, Sarah C.
通讯作者：
Kucker, Sarah C.
影响因子：
3.9
作者：
Kennedy, Ryan;Clifford, Scott;Winter, Nicholas J. G.
通讯作者：
Winter, Nicholas J. G.
影响因子：
2.3
作者：
Koffarnus, Mikhail N.;Franck, Christopher T.;Bickel, Warren K.
通讯作者：
Bickel, Warren K.
影响因子：
1.3
作者：
Brown, Jeremiah;Washington, Wendy Donlin;Kaplan, Brent A.
通讯作者：
Kaplan, Brent A.