Objective structured assessment of technical skill (OSATS) for surgical residents
Objective structured assessment of technical skill (OSATS) for surgical residents
复制标题
DOI：
10.1002/bjs.1800840237
复制
发表时间：
1997-02-01
影响因子：
9.6
通讯作者：
Brown, M
中科院分区：
文献类型：
--
作者：
Martin, JA;Regehr, G;Brown, M
背景外科实习生的技术技能没有得到很好的评估。本研究的目的是（1）比较三个评分系统的可靠性，（2）比较现场和板凳格式和（3）评估结构效度的一个测试的操作skill.Methods平行考试的操作技能，一个使用活动物和一个使用模拟，开发。使用具体行动的检查表、详细的全球评级表和通过/失败判断对业绩进行评级。20名外科住院医师分别参加了两种格式。结果现场和板凳评分之间的衰减相关性很高（0.69-0.72）。各站点的平均评分员间可靠性范围为0.64至0.72。内部一致性是中度到高度（α：0.61-0.74）的现场格式使用清单和现场和板凳格式使用全球评级。两种格式的住院医师水平之间的总体评分区分（工作台：F（2，17）= 4.45，P < 0.05;现场：F（2，17）= 3.55，P < 0.05），检查表没有。结论初步研究表明，技术技能的客观结构化评估可以可靠和有效地评估手术技能。总体评级是比具体任务清单更好的评估方法。台架模型模拟给出了与该试验形式使用活体动物相同的结果。
Background The technical skill of surgical trainees is not well assessed. This study aimed (i) to compare the reliability of three scoring systems, (2) to compare live and bench formats and (3) to assess construct validity of a test of operative skill.Methods Parallel examinations of operative skill, one using live animals and one using simulations, were developed. Performance was graded using operation-specific checklists, detailed global rating forms and pass/fail judgements. Twenty surgical residents each took both formats.Results Disattenuated correlations between live and bench scores were high (0.69-0.72). Mean interrater reliability across stations ranged from 0.64 to 0.72. Internal consistency was moderate to high (alpha: 0.61-0.74) for the live format using the checklist and for live and bench formats using global ratings. Global ratings discriminated between resident levels for both formats (bench: F(2,17) = 4.45, P < 0.05; live: F(2,17) = 3.55, P < 0.05), checklists did not.Conclusion This preliminary study suggests that the Objective Structured Assessment of Technical Skill can reliably and validly assess surgical skills. Global ratings are a better method of assessment than task-specific checklists. Bench model simulation gives equivalent results to use of live animals for this test format.