Brief Online Training with Standardised Vignettes Reduces Inflated Supervisor Ratings of Trainee Practitioner Competencies.
Brief Online Training with Standardised Vignettes Reduces Inflated Supervisor Ratings of Trainee Practitioner Competencies.
复制标题
DOI：
10.1111/ap.12250
复制
发表时间：
2017-04
影响因子：
1.9
通讯作者：
Deane FP
中科院分区：
文献类型：
--
作者：
Terry J;Gonsalvez C;Deane FP
主管评估学员能力是不可或缺的，以确保临床心理学学员达到能力基准。临床心理学实习能力评定量表（Clinical Psychology Practicum Competitum Rating Scale，C PPRS）被认为是一种夸大的能力评定量表。因此，本研究的目的是研究是否简短的主管培训，提供客观的标准，主管可以评估受训者的能力，降低评级。该评级包括来自9所澳大利亚大学临床课程的124名心理学实习生。在170名主管中，有32名在即将开始实施《企业社会责任战略》之前完成了在线培训。培训要求主管对五个标准化小插曲（初学者到胜任）中描述的能力水平进行评级。由专家监督小组确定的小插曲评级作为反馈提供。还对第六个校准插图进行了评级（未提供反馈）。首先，比较了培训和未经培训的主管的C. PRS评分。其次，在经过培训和未经培训的群体中比较了主管和专家对校准插图的评分之间的差异。经过培训的主管提供较低的C-10 PRS评级比未经培训的主管。此外，经过培训的监督员（与未经培训的监督员相比）提供的校准插图评级更准确地匹配专家小组提供的评级。使用标准化小插曲的简短在线培训与较低的C/PRS评分相关。标准化的小插曲有助于校准主管的评级，并可能使主管适应特定发展阶段所期望的技能和能力水平。因此，培训似乎降低了评级，可以说导致对受训者业绩的更准确评估。
Supervisor assessments of trainee competence are integral to ensuring that clinical psychology trainees reach competency benchmarks. The commonly used Clinical Psychology Practicum Competencies Rating Scale (CΨPRS) has been shown to elicit inflated ratings of competency. Hence, the aim of this study is to examine whether brief supervisor training reduces ratings by providing objective criteria with which supervisors can assess trainee competency. The ratings included were of 124 psychology trainees from nine Australian university clinical programmes. Of 170 supervisors, 32 completed the online training immediately prior to commencing the CΨPRS. Training required supervisors to rate the competency level described in five standardised vignettes (Beginner through to Competent). Vignette ratings, as determined by a panel of expert supervisors, were provided as feedback. A sixth calibration vignette was also rated (no feedback provided). Firstly, CΨPRS ratings from the trained and untrained supervisors were compared. Secondly, the difference between supervisor and expert ratings of the calibration vignettes were compared across trained and untrained groups. Trained supervisors provided lower CΨPRS ratings than untrained supervisors. In addition, trained supervisors (vs untrained supervisors) provided ratings of the calibration vignette that more accurately matched the ratings provided by the expert panel. Brief online training using standardised vignettes was associated with lower CΨPRS ratings. The standardised vignettes helped calibrate supervisors’ ratings and likely attuned supervisors to the skills and competency levels that are expected at particular developmental stages. As a consequence, training appeared to reduce ratings, arguably resulting in more accurate assessments of trainee performance.
登录
查看更多内容
影响因子：
2
作者：
Gonsalvez, Craig J.;Bushnell, John;Knight, Roslyn
通讯作者：
Knight, Roslyn
影响因子：
2.6
作者：
Chafouleas, Sandra M.;Riley-Tillman, T. Chris;Harrison, Sayward E.
通讯作者：
Harrison, Sayward E.
影响因子：
1.2
作者：
Bogo, Marion;Regehr, Cheryl;Regehr, Glenn
通讯作者：
Regehr, Glenn
影响因子：
1.9
作者：
Gonsalvez, Craig J.;Freestone, John
通讯作者：
Freestone, John
影响因子：
9.9
作者：
Jelley, RB;Goffin, RD
通讯作者：
Goffin, RD