Automated Video Interview Personality Assessments: Reliability, Validity, and Generalizability Investigations
Automated Video Interview Personality Assessments: Reliability, Validity, and Generalizability Investigations
复制标题
DOI：
10.1037/apl0000695
复制
发表时间：
2021-06-10
影响因子：
9.9
通讯作者：
Woo, Sang Eun
中科院分区：
文献类型：
--
作者：
Hickman, Louis;Bosch, Nigel;Woo, Sang Eun
越来越多的组织采用自动视频面试（AVIs）来筛选求职者，尽管缺乏对其可靠性，有效性和普遍性的研究。在这项研究中，我们通过开发使用从视频访谈中提取的语言，准语言和非语言行为来评估大五人格特质的AVIs来解决这一差距。我们开发并验证了机器学习模型（使用嵌套交叉验证）和三个独立的模拟视频访谈样本（总N = 1，073）。此外，我们在第四个样本（N = 99）中检查了他们的重测信度。总的来说，我们发现，AVI人格评估表现出更强的有效性证据时，他们接受了采访者的报告，而不是自我报告的培训。当在其他样本中进行交叉验证时，在访谈报告上训练的AVI个性评估具有混合的可靠性证据，表现出一致的收敛和判别关系，使用似乎与焦点特征概念相关的预测因子，并预测学术成果。另一方面，几乎没有证据表明接受自我报告培训的AVIs的可靠性或有效性。我们讨论了未来工作的AVIs和个性理论的影响，并提供切实可行的建议，销售这种方法和组织考虑采用它们。
Organizations are increasingly adopting automated video interviews (AVIs) to screen job applicants despite a paucity of research on their reliability, validity, and generalizability. In this study, we address this gap by developing AVIs that use verbal, paraverbal, and nonverbal behaviors extracted from video interviews to assess Big Five personality traits. We developed and validated machine learning models within (using nested cross-validation) and across three separate samples of mock video interviews (total N = 1,073). Also, we examined their test-retest reliability in a fourth sample (N = 99). In general, we found that the AVI personality assessments exhibited stronger evidence of validity when they were trained on interviewer-reports rather than self-reports. When cross-validated in the other samples, AVI personality assessments trained on interviewer-reports had mixed evidence of reliability, exhibited consistent convergent and discriminant relations, used predictors that appear to be conceptually relevant to the focal traits, and predicted academic outcomes. On the other hand, there was little evidence of reliability or validity for the AVIs trained on self-reports. We discuss the implications for future work on AVIs and personality theory, and provide practical recommendations for the vendors marketing such approaches and organizations considering adopting them.