Who Can You Count On? Understanding The Determinants of Reliability.
Who Can You Count On? Understanding The Determinants of Reliability.
复制标题
您可以信赖谁？
DOI：
10.1093/jssam/smz034
复制
发表时间：
2020
影响因子：
2.1
通讯作者：
Sun,Hanyu
中科院分区：
文献类型：
--
作者：
Tourangeau,Roger;Yan,Ting;Sun,Hanyu
使用路径信度和效度(Path-RV)研究的重访数据，我们检验了问题和受访者预测答案可靠性的特征。在Path-RV研究中，524名受访者完成了两次采访，时间间隔为5至24天。我们对一些问题特征进行了编码，并使用它们来预测每个问题的总差异率(GDR)和Kappas。我们还调查了与可靠性相关的受访者特征。最后，我们建立了交叉分类模型，同时考察了一系列受访者和问题的特征。尽管不同的模型得出的结论略有不同，但总的来说，较短的问题(特别是人口统计问题)、较短的问题、不使用量表的问题、回答选项较少的问题以及那些询问非中心主题的问题产生的答案比态度问题、较长的问题、使用序数表的问题、有更多回答选项的问题以及询问中心主题的问题产生的答案更可靠。一个令人惊讶的发现是，引发潜在社会可取性担忧的物品比没有引起这种担忧的物品产生了更可靠的答案。受访者水平模型和交叉分类模型表明，在两次访谈中，成人受访者的五个特征与给出相同答案有关--教育、尽职尽责的五大特征、吸烟、性别和收入。西班牙裔青年和非西班牙裔黑人青年在两次采访中给出相同答案的可能性较小。交叉分类模型还发现，单词越多，答案的可靠性就越低。结果与早期的发现基本一致，但仍然很重要，因为与早期的工作相比，它们对模型的依赖性要小得多。此外，本研究还首次将认知所需的人格特质和五大人格因素结合起来，考察了信度、条目无反应和反应潜伏期之间的关系。
Using reinterview data from the PATH Reliability and Validity (PATH-RV) study, we examine the characteristics of questions and respondents that predict the reliability of the answers. In the PATH-RV study, 524 respondents completed an interview twice, five to twenty-four days apart. We coded a number of question characteristics and used them to predict the gross discrepancy rates (GDRs) and kappas for each question. We also investigated respondent characteristics associated with reliability. Finally, we fitted cross-classified models that simultaneously examined a range of respondent and question characteristics. Although the different models yielded somewhat different conclusions, in general factual questions (especially demographic questions), shorter questions, questions that did not use scales, those with fewer response options, and those that asked about a noncentral topic produced more reliable answers than attitudinal questions, longer questions, questions using ordinal scales, those with more response options, and those asking about a central topic. One surprising finding was that items raising potential social desirability concerns yielded more reliable answers than items that did not raise such concerns. The respondent-level models and cross-classified models indicated that five adult respondent characteristics were associated with giving the same answer in both interviews—education, the Big Five trait of conscientiousness, tobacco use, sex, and income. Hispanic youths and non-Hispanic black youths were less likely to give the same answer in both interviews. The cross-classified model also found that more words were associated with less reliable answers. The results are mostly consistent with earlier findings but are nonetheless important because they are much less model-dependent than the earlier work. In addition, this study is the first to incorporate such personality traits as needed for cognition and the Big Five personality factors and to examine the relationships among reliability, item nonresponse, and response latency.