Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self-Administered Surveys
Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self-Administered Surveys
复制标题
DOI：
10.1111/ajps.12081
复制
发表时间：
2014-07-01
影响因子：
4.2
通讯作者：
Sances, Michael W.
中科院分区：
文献类型：
--
作者：
Berinsky, Adam J.;Margolis, Michele F.;Sances, Michael W.
好的调查和实验研究需要受试者注意问题和治疗方法，但许多受试者没有。在本文中，我们将讨论“筛选器”作为这个问题的潜在解决方案。我们首先展示了筛选器揭示注意力不集中的受访者和减少噪音的能力。然后，我们检查重要但未被充分研究的问题筛选。我们表明，使用单个筛选器并不是提高数据质量的最有效方法。相反，我们建议使用多个项目来衡量注意力。我们还表明筛选者通过与政治相关的特征相关，这限制了排除失败者的研究的普遍性。我们的结论是，注意力最好使用多个Screener问题来测量，并且使用Screener的研究可以通过呈现不同注意力水平的结果来平衡内部效度和外部效度的目标。
Good survey and experimental research requires subjects to pay attention to questions and treatments, but many subjects do not. In this article, we discuss "Screeners" as a potential solution to this problem. We first demonstrate Screeners' power to reveal inattentive respondents and reduce noise. We then examine important but understudied questions about Screeners. We show that using a single Screener is not the most effective way to improve data quality. Instead, we recommend using multiple items to measure attention. We also show that Screener passage correlates with politically relevant characteristics, which limits the generalizability of studies that exclude failers. We conclude that attention is best measured using multiple Screener questions and that studies using Screeners can balance the goals of internal and external validity by presenting results conditional on different levels of attention.