Collaborative Research: Motivated Underreporting

本研究考察了调查测量误差的三种形式，并探讨了它们之间的关系。第一种形式的测量误差影响旨在确定符合特定调查条件的人口成员(例如，65岁以上的人)的问题。几项研究发现，合格人群中的成员在筛查面试中被低估了。虽然没有一项调查能完美覆盖其目标人群，但针对特定人群的调查似乎特别容易掩盖这一特定人群。第二种形式的测量误差涉及过滤问题。这些问题取决于如何回答，要么会导致额外的后续问题，要么会导致受访者跳过后续项目。许多调查研究人员认为，受访者很可能会对过滤后的问题给出虚假答案，以避免后续问题。因此，许多调查在问卷开始时提出筛选问题，并在以后管理后续问题，而不是将筛选问题和后续问题交织在一起。测量误差的最终形式涉及条件效应或样本中的时间效应。在过去的40年里，许多调查研究人员提出，在持续进行的小组调查中，受访者在小组调查的各个阶段和日记调查中报告的相关事件较少。这三种现象的共同点似乎是，出于减少填写问卷所需努力的愿望，受访者报告的相关事件较少。但目前还不清楚这些形式的错误是面试官做了什么，还是受访者做了什么，还是两者兼而有之。这项拟议的研究既使用了新的实验，又分析了现有的数据，试图找出这些影响的根源(采访者和受访者)，并探索不同方法减少这些错误的有效性。该项目将有助于改进根据受这些问题影响的调查项目得出的各种国家统计数据。该项目还将进一步培训研究生，并促进这两个机构的调查研究人员的专业培训。作为支持调查和统计方法研究的联合活动的一部分，这项研究得到了方法学、测量和统计计划和一个联邦统计机构联盟的支持。

This research examines three forms of survey measurement error and investigates the relations among them. The first form of measurement error affects questions designed to identify members of the population eligible for a given survey (for example, persons over 65 years old). Several studies find that members of the eligible population are underreported in screening interviews. Although no survey perfectly covers its target population, surveys aimed at specific subpopulations seem especially prone to undercover that particular population. The second form of measurement error involves filter questions. These are questions that, depending on how they are answered, either lead to additional follow-up questions or to the respondent's skipping out of the follow-up items. Many survey researchers believe that respondents are likely to give false answers to the filter questions in order to avoid the follow-up questions. As a result, many surveys ask the filter questions at the beginning of the questionnaire and administer the follow-up questions later on rather than interleaving the filter and follow-up questions. The final form of measurement error involves conditioning, or time-in-sample, effects. Over the last forty years, many survey researchers have suggested that respondents in ongoing panel surveys report fewer relevant events across waves of the panel survey and across time periods in a diary survey.What the three phenomena appear to have in common is underreporting motivated by the desire to reduce the effort needed to complete the questionnaire. But it is not clear whether these forms of error result from something the interviewers do, something the respondents do, or both. The proposed studies use both new experiments and analyze existing data to try to pinpoint the locus of these effects (interviewers versus respondents) and to explore the effectiveness of different methods for reducing these errors. The project will contribute to the improvement of various national statistics that are derived from survey items affected by these problems. The project also will further the training of graduate students and contribute to the professional training of survey researchers at both institutions. The research is supported by the Methodology, Measurement, and Statistics Program and a consortium of federal statistical agencies as part of a joint activity to support research on survey and statistical methodology.