Ascertaining the validity of individual protocols from Web-based personality inventories

Ascertaining the validity of individual protocols from Web-based personality inventories
复制标题

DOI:
10.1016/j.jrp.2004.09.009
复制
发表时间:
2005-02-01
影响因子:
3.3
通讯作者:
Johnson, JA
Johnson, JA
中科院分区:
心理学2区
文献类型:
--
作者:
Johnson, JA

文献摘要

被引文献

相似文献

本文中描述的研究估计了基于网络与纸笔人格测量中语言能力不足、注意力不集中和故意歪曲导致协议无效的相对发生率。对协议无效性的估计是从完成NEO-PI-R的300项IPIP表示的在线版本(Goldberg,1999年)的个人编写的23,994份协议中得出的。大约3.8%的方案被认为是重复参与者的产品,其中许多人显然是在改变了一些答案后重新提交的。在不重复的方案中,约有3.5%的人显然是在没有阅读项目的情况下重复选择了一个回答选项,而在纸笔方案中,这一比例为9%。缺失答复率为1.2%,比几个纸笔清单样本中的比例高2-10倍。两项措施的响应一致性表明,也许1%的协议是无效的,由于语言能力或不注意的反应,但网络参与者一致的个人响应纸和笔库存。不一致性并没有影响因素结构,并被发现与神经质和负向开放的经验。故意虚假陈述没有直接研究,但错误陈述的发生率低的参数。讨论了防止、检测和处理无效响应模式的方法。建议未来的研究,评估语言能力不足,注意力不集中,故意歪曲自我报告和熟人之间的协议对人格的判断的调节作用的研究。(C)2004年爱思唯尔公司All rights reserved.
The research described in this article estimated the relative incidence of protocols invalidated by linguistic incompetence, inattentiveness, and intentional misrepresentation in Web-based versus paper-and-pencil personality measures. Estimates of protocol invalidity were derived from a sample of 23,994 protocols produced by individuals who completed an online version of the 300-item IPIP representation of the NEO-PI-R (Goldberg, 1999). Approximately 3.8% of the protocols were judged to be products of repeat participants, many of whom apparently resubmitted after changing some of their answers. Among nonduplicate protocols, about 3.5% came from individuals who apparently selected a response option repeatedly without reading the item, compared to 9% in a sample of paper-and-pencil protocols. The missing response rate was 1.2%, which is 2-10 times higher than the rate found in several samples of paper-and-pencil inventories of comparable length. Two measures of response consistency indicated that perhaps 1% of the protocols were invalid due to linguistic incompetence or inattentive responding, but that Web participants were as consistent as individuals responding to a paper-and-pencil inventory. Inconsistency did not affect factorial structure and was found to be related positively to neuroticism and negatively to openness to experience. Intentional misrepresentation was not studied directly, but arguments for a low incidence of misrepresentation are presented. Methods for preventing, detecting, and handling invalid response patterns are discussed. Suggested for future research are studies that assess the moderating effects of linguistic incompetence, inattentiveness, and intentional misrepresentation on agreement between self-report and acquaintance judgments about personality. (C) 2004 Elsevier Inc. All rights reserved.