The Effect of Online and Mixed-Mode Measurement of Cognitive Ability
The Effect of Online and Mixed-Mode Measurement of Cognitive Ability
复制标题
DOI：
10.1177/0894439317746328
复制
发表时间：
2019-02-01
影响因子：
4.1
通讯作者：
Al Baghal, Tarek
中科院分区：
文献类型：
--
作者：
Al Baghal, Tarek
一些研究，特别是纵向调查，正在收集认知能力的直接衡量标准，因为它在社会科学研究中是一种重要的衡量标准。随着纵向研究越来越多地切换到混合模式的数据收集，经常包括网络组件，包括认知能力的调查结果的差异可能会导致模式效应。差异可能是由于应答者自我选择进入模式或由于模式导致差异测量而产生的。使用纵向调查，测量认知能力后，介绍了一个混合模式的设计与Web组件，本研究探讨了模式是否以及如何影响认知能力的结果。该调查允许控制几种可能的选择机制，包括在早期波中以单一模式收集的有限的一组直接认知能力测量。这里提出的调查结果清楚地表明，网络受访者在一些认知能力指标上做得更好。然而，这似乎并不能完全解释为不同能力的受访者自我选择进入特定的模式。相反，似乎认知能力的测量可能会因模式而异。这一结果可能存在问题，因为可比性是在进一步研究中使用认知能力的关键组成部分。
A number of studies, particularly longitudinal surveys, are collecting direct measures of cognitive ability, given its importance as a measure in social science research. As longitudinal studies increasingly switch to mixed-mode data collection, frequently including a web component, differences in survey outcomes including cognitive ability may result from mode effects. Differences may arise due to respondent self-selection into mode or due to the mode causing differential measurement. Using a longitudinal survey that measured cognitive ability after introducing a mixed-mode design with a web component, this research explores if and how mode affects cognitive ability outcomes. This survey allows for control of several possible selection mechanisms, including a limited set of direct cognitive ability measures collected in a single mode in an earlier wave. Findings presented here show clearly that web respondents do better on a number of cognitive ability indicators. However, it does not appear that this is wholly explainable by respondents of different ability self-selecting into particular modes. Rather, it appears that measurement of cognitive ability may differ across modes. This result is potentially problematic as comparability is a key component of using cognitive ability in further research.