Predictive validity of the multiple mini-interview for selecting medical trainees
Predictive validity of the multiple mini-interview for selecting medical trainees
复制标题
DOI：
10.1111/j.1365-2923.2009.03407.x
复制
发表时间：
2009-08-01
影响因子：
6
通讯作者：
Norman, Geoffrey R.
中科院分区：
文献类型：
--
作者：
Eva, Kevin W.;Reiter, Harold I.;Norman, Geoffrey R.
Introduction在本文中，我们报告了进一步测试的有效性的多个小型面试（MMI）的选择过程中，MMI分数与那些实现了国家高风险的临床技能考试。我们还继续探索候选人的表现和稳定性的程度，所谓的“认知”和“非认知”的素质应被视为独立的another.MethodsTo检查预测效度，MMI数据匹配与执照考试数据为本科生（n = 34）和研究生（n = 22）样本的参与者。为了评估候选人表现的稳定性，为八个不同的样本生成了可靠性系数。最后，相关性进行了计算之间的“认知”和“非认知”的能力在招生程序中收集的措施，从医学院毕业，18个月到研究生training.ResultsThe中位数可靠性的8个管理的MMI在不同的队列是0.73时，12个10分钟的站，每个站一个考官使用。在MMI上的表现和通过基于客观结构化临床考试的执照考试的站点数量之间的相关性在研究生样本中为r = 0.43（P < 0.05），在参加执照考试前5年参加MMI的本科生样本中为r = 0.35（P < 0.05）。“认知”和“非认知”的评估工具之间的相关性随着时间的培训（即作为重点的评估变得更加适合医学的临床实践）。DiscussionFurther证据的有效性的MMI方法作出招生决定已提供。更一般地说，报告的调查结果进一步怀疑在何种程度上可以捕获与基于特征的能力模型的性能。最后，虽然互补的预测关系一直被观察到平均成绩和MMI的结果之间，在何种程度上认知和非认知素质是不同的似乎取决于范围内的两类素质进行评估的做法。
IntroductionIn this paper we report on further tests of the validity of the multiple mini-interview (MMI) selection process, comparing MMI scores with those achieved on a national high-stakes clinical skills examination. We also continue to explore the stability of candidate performance and the extent to which so-called 'cognitive' and 'non-cognitive' qualities should be deemed independent of one another.MethodsTo examine predictive validity, MMI data were matched with licensing examination data for both undergraduate (n = 34) and postgraduate (n = 22) samples of participants. To assess the stability of candidate performance, reliability coefficients were generated for eight distinct samples. Finally, correlations were calculated between 'cognitive' and 'non-cognitive' measures of ability collected in the admissions procedure, on graduation from medical school and 18 months into postgraduate training.ResultsThe median reliability of eight administrations of the MMI in various cohorts was 0.73 when 12 10-minute stations were used with one examiner per station. The correlation between performance on the MMI and number of stations passed on an objective structured clinical examination-based licensing examination was r = 0.43 (P < 0.05) in a postgraduate sample and r = 0.35 (P < 0.05) in an undergraduate sample of subjects who sat the MMI 5 years prior to sitting the licensing examination. The correlation between 'cognitive' and 'non-cognitive' assessment instruments increased with time in training (i.e. as the focus of the assessments became more tailored to the clinical practice of medicine).DiscussionFurther evidence for the validity of the MMI approach to making admissions decisions has been provided. More generally, the reported findings cast further doubt on the extent to which performance can be captured with trait-based models of ability. Finally, although a complementary predictive relationship has consistently been observed between grade point average and MMI results, the extent to which cognitive and non-cognitive qualities are distinct appears to depend on the scope of practice within which the two classes of qualities are assessed.