Standardized assessment for evaluation of team skills: validity and feasibility.
Standardized assessment for evaluation of team skills: validity and feasibility.
复制标题
团队技能评估的标准化评估：有效性和可行性。
DOI：
10.1097/sih.0b013e318290a022
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
Taekman,JeffreyM
中科院分区：
文献类型：
--
作者：
Wright,MelanieC;Segall,Noa;Hobbs,Gene;Phillips-Bute,Barbara;Maynard,Laura;Taekman,JeffreyM
方法采用SAFE-TeamS对38名实习护生进行团队技能训练前后的测评。SAFE-TeamS培训前和培训后的分数进行了比较，并对参与者进行了调查。概化分析被用来估计与以下相关的分数的方差：考生，场景，评分员，培训前/培训后，考生类型，评分员类型（演员现场与外部评分员录像带），演员团队，和场景order.Results的SAFE-TeamS分数反映培训后的改善，对个体差异敏感。评分者之间的评分差异较低。由于方案的差异是中等的。2名评分员和8种情景的相对可靠性估计值范围为0.6至0.7。对于固定的场景和评分者，2名评分者和2个场景，可靠性大于0.8。评分者认为SAFE-TeamS评估了相关的团队技能。结论SAFE-TeamS对个体差异和团队技能训练敏感，为SAFE-TeamS的有效性提供了证据。不清楚不同的情景是否衡量不同的技能，也不清楚这些情景是否涵盖必要的技能广度。使用多种情景将支持对更广泛技能的评估。未来的研究需要确定使用SAFE-TeamS的评估是否会转化为临床实践中的性能。
Methods Thirty-eight medical and nursing students were assessed using SAFE-TeamS before and after team skills training. The SAFE-TeamS pretraining and posttraining scores were compared, and participants were surveyed. Generalizability analysis was used to estimate the variance in scores associated with the following: examinee, scenario, rater, pretraining/posttraining, examinee type, rater type (actor-live vs. external rater–videotape), actor team, and scenario order.Results The SAFE-TeamS scores reflected improvement after training and were sensitive to individual differences. Score variance due to rater was low. Variance due to scenario was moderate. Estimates of relative reliability for 2 raters and 8 scenarios ranged from 0.6 to 0.7. With fixed scenarios and raters, 2 raters and 2 scenarios, reliability is greater than 0.8. Raters believed SAFE-TeamS assessed relevant team skills. Examinees’ responses were mixed.Conclusions The SAFE-TeamS was sensitive to individual differences and team skill training, providing evidence for validity. It is not clear whether different scenarios measure different skills and whether the scenarios cover the necessary breadth of skills. Use of multiple scenarios will support assessment across a broader range of skills. Future research is required to determine whether assessments using SAFE-TeamS will translate to performance in clinical practice.