The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience.
The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience.
复制标题
DOI：
10.1155/2022/7402079
复制
发表时间：
2022
影响因子：
1.9
通讯作者：
中科院分区：
文献类型：
--
作者：
本研究调查了COVID-19旅行限制所需的面试形式变化（亲自到虚拟，一对一到多对一）对初步奖学金候选人排名变量的影响。 横断面观察性研究。 在2018年和2019年，青光眼奖学金面试是以一对一的形式进行的，而在2020年，面试是虚拟的，并以多（面试官）对一（候选人）的形式进行。我们比较了同一虚拟房间（WSR）和不在同一虚拟房间（NWSR）内的面试官的排名范围，以评估WSR与NWSR对排名变异性的影响。我们还比较了2018年，2019年和2020年之间的排名类别（“接受”，“替代”和“通过”）协议，以评估虚拟与面对面访谈对排名变量的影响。 NWSR和WSR平均排名相差1.33（95%置信区间差异0.61至2.04，p = 0.0003），WSR访谈者的变异性小于NWSR对。2018/2019年（面对面访谈）和2020年（虚拟访谈）之间的变异性显示，面对面访谈和虚拟访谈之间没有差异（2018年加权Kappa统计量为0.086，2019年为0.158，2020年为0.101;所有年份p < 0.05）。总体上最不吸引人的候选人具有最低的可变性;最有吸引力的候选人具有第二低的可变性。 在面试过程中，与NWSR相比，WSR的面试官减少了排名变异性，而从面对面到虚拟面试形式的变化并没有增加排名变异性。这表明，在虚拟面试中减少非语言互动并没有减少面试官的看法，适用于初步排名。
This study investigated the effect of interview format changes (in-person to virtual, one-to-one to multiple-to-one) necessitated by the COVID-19 travel restrictions on preliminary fellowship candidate ranking variabilities. Cross-sectional observational study. In 2018 and 2019, the glaucoma fellowship interviews were conducted in-person in a one-to-one format, whereas in 2020, interviews were virtual and in a multiple (interviewers)-to-one (candidate) format. We compared ranking ranges of interviewers within the same virtual room (WSR) and not within the same virtual room (NWSR) to assess the effect of WSR versus NWSR on ranking variabilities. We also compared ranking categories (“accept,” “alternate,” and “pass”) agreements between 2018, 2019, and 2020 to assess the effect of virtual versus in-person interviews on ranking variabilities. NWSR and WSR mean rankings differed by 1.33 (95% confidence interval difference 0.61 to 2.04, p = 0.0003), with WSR interviewers having less variability than NWSR pairs. The variability between 2018/2019 (in-person interviews) and 2020 (virtual interviews) showed no differences between in-person and virtual interviews (weighted Kappa statistic 0.086 for 2018, 0.158 for 2019, and 0.101 for 2020; p < 0.05 for all years). The overall least attractive candidate has the lowest variability; the most attractive candidate has the second lowest variability. Grouping interviewers WSR during the interview decreased ranking variabilities compared to NWSR, while a change from in-person to virtual interview format did not increase the ranking variabilities. This suggests that the decreased nonverbal interactions in virtual interviews do not decrease interviewers' perceptions as applied to preliminary rankings.