Using Instructed Response Items as Attention Checks in Web Surveys: Properties and Implementation
Using Instructed Response Items as Attention Checks in Web Surveys: Properties and Implementation
复制标题
DOI：
10.1177/0049124118769083
复制
发表时间：
2021-02-01
影响因子：
6.3
通讯作者：
Silber, Henning
中科院分区：
文献类型：
--
作者：
Gummer, Tobias;Rossmann, Joss;Silber, Henning
在自我管理的调查中识别注意力不集中的受访者是调查研究人员的一个具有挑战性的目标。指导性回答项目（IRI）提供了一种易于实施的网格问题中注意力不集中的测量方法。本文通过解决三个研究目标，增加了对注意力检查的使用和实施的稀疏研究。在第一项研究中，我们提供的证据表明，IRI识别受访者谁表现出直线上升，超速，项目无反应，不一致的答案，并在整个调查难以置信的语句。然而，排除不注意的答复者并没有改变实质性分析的结果。我们的第二项研究表明，受访者的注意力不集中部分变化的背景下，他们完成了调查的变化。在第三项研究中，我们提出了实验证据，表明仅仅暴露于IRI不会对调查中的反应行为产生负面或正面影响。本文最后对使用IRI注意力检查进行了批判性讨论。
Identifying inattentive respondents in self-administered surveys is a challenging goal for survey researchers. Instructed response items (IRIs) provide a measure for inattentiveness in grid questions that is easy to implement. The present article adds to the sparse research on the use and implementation of attention checks by addressing three research objectives. In a first study, we provide evidence that IRIs identify respondents who show an elevated use of straightlining, speeding, item nonresponse, inconsistent answers, and implausible statements throughout a survey. Excluding inattentive respondents, however, did not alter the results of substantive analyses. Our second study suggests that respondents' inattentiveness partially changes as the context in which they complete the survey changes. In a third study, we present experimental evidence that a mere exposure to an IRI does not negatively or positively affect response behavior within a survey. A critical discussion on using IRI attention checks concludes this article.