The Americleft Speech Project: A Training and Reliability Study.
The Americleft Speech Project: A Training and Reliability Study.
复制标题
DOI：
10.1597/14-027
复制
发表时间：
2016-01
期刊：
影响因子：
--
通讯作者：
Sell D
中科院分区：
文献类型：
--
作者：
Chapman KL;Baylis A;Trost-Cardamone J;Cordero KN;Dixon A;Dobbelsteyn C;Thurmes A;Wilson K;Harding-Bell A;Sweeney T;Stoddard G;Sell D
描述两项信度研究的结果，并评估培训对评委间信度分数的影响。第一项研究(1)检验了评委间和评委内的可靠性分数(加权和未加权的Kappas)，以及(2)比较了英国英语儿童在使用语音增强的裂隙审计协议(CAPs-A)培训前后的评委间可靠性分数。第二项研究在美国和加拿大说英语的儿童身上测试了CAPS-A(CAPS-A americal Left修改)的修改版本的评分员间和评分员内的可靠性。最后，对研究1和研究2的评价者间和评价者内的信度分数进行了比较。参与者是美国左派语言项目的言语语言病理学家。在研究1中，在CAPS-A方案培训后，13个参数中的6个参数的评委间可靠性分数有所提高。两项研究的可靠性结果比较表明，研究2的得分低于研究1。然而，这似乎是由于研究2的可靠性样本变异性不足而产生的kappa统计结果。当计算百分比一致性分数时，研究1和研究2的评分似乎相似。这项研究的结果表明，经过系统的培训计划，评委之间的可靠性可以得到改善。然而，所有参数的改善并不是一致的。对于那些对评估腭咽闭合功能最重要的参数，达到了可接受的可靠性水平。
To describe the results of two reliability studies and to assess the effect of training on interrater reliability scores. The first study (1) examined interrater and intrarater reliability scores (weighted and unweighted kappas) and (2) compared interrater reliability scores before and after training on the use of the Cleft Audit Protocol for Speech–Augmented (CAPS-A) with British English-speaking children. The second study examined interrater and intrarater reliability on a modified version of the CAPS-A (CAPS-A Americleft Modification) with American and Canadian English-speaking children. Finally, comparisons were made between the interrater and intrarater reliability scores obtained for Study 1 and Study 2. The participants were speech-language pathologists from the Americleft Speech Project. In Study 1, interrater reliability scores improved for 6 of the 13 parameters following training on the CAPS-A protocol. Comparison of the reliability results for the two studies indicated lower scores for Study 2 compared with Study 1. However, this appeared to be an artifact of the kappa statistic that occurred due to insufficient variability in the reliability samples for Study 2. When percent agreement scores were also calculated, the ratings appeared similar across Study 1 and Study 2. The findings of this study suggested that improvements in interrater reliability could be obtained following a program of systematic training. However, improvements were not uniform across all parameters. Acceptable levels of reliability were achieved for those parameters most important for evaluation of velopharyngeal function.