Practical Advice Regarding the Reliability of the Patient Educational Materials Assessment Tool for Health Educators.
Practical Advice Regarding the Reliability of the Patient Educational Materials Assessment Tool for Health Educators.
复制标题
DOI：
10.1177/1524839920984790
复制
发表时间：
2022-01
影响因子：
1.9
通讯作者：
Chaney BH
中科院分区：
文献类型：
--
作者：
Lee JGL;Sesay M;Acevedo PA;Chichester ZA;Chaney BH
患者教育材料的质量是健康教育者、临床医生和社区卫生工作者的一个重要问题。我们描述了在2020年春季使用患者教育材料评估工具（PEMAT）评估农场工人健康材料时，编码器之间实现可靠评分的挑战。四名编码员在编码校准三次尝试后无法实现可靠性。进一步的调查确定了PEMAT码本的改进，并证明了以Krippendorff α的形式实现传统评分员间可靠性的困难。我们的解决方案是使用多个评分者和平均评分，以达到一个可接受的分数与组内相关系数。使用PEMAT评估材料的从业者应该考虑平均多个评分者的评分，因为PEMAT结果可能对谁进行评分高度敏感。不这样做可能会无意中导致使用次优的患者教育材料。
The quality of patient education materials is an important issue for health educators, clinicians, and community health workers. We describe a challenge achieving reliable scores between coders when using the Patient Educational Materials Assessment Tool (PEMAT) to evaluate farmworker health materials in spring 2020. Four coders were unable to achieve reliability after three attempts at coding calibration. Further investigation identified improvements to the PEMAT codebook and evidence of the difficulty of achieving traditional interrater reliability in the form of Krippendorff’s alpha. Our solution was to use multiple raters and average ratings to achieve an acceptable score with an intraclass correlation coefficient. Practitioners using the PEMAT to evaluate materials should consider averaging the scores of multiple raters as PEMAT results otherwise may be highly sensitive to who is doing the rating. Not doing so may inadvertently result in the use of suboptimal patient education materials.
登录
查看更多内容
影响因子：
3.5
作者：
Shoemaker, Sarah J.;Wolf, Michael S.;Brach, Cindy
通讯作者：
Brach, Cindy
影响因子：
1.9
作者：
Baur, Cynthia;Prue, Christine
通讯作者：
Prue, Christine
影响因子：
11.4
作者：
Hayes, Andrew F.;Krippendorff, Klaus
通讯作者：
Krippendorff, Klaus
影响因子：
2
作者：
Salama, Amr;Panoch, Janet;Chan, Katherine H.
通讯作者：
Chan, Katherine H.
影响因子：
2.7
作者：
Lipari, Melissa;Berlie, Helen;Moser, Lynette
通讯作者：
Moser, Lynette