Bayesian random effects for interrater and test-retest reliability with nested clinical observations
Bayesian random effects for interrater and test-retest reliability with nested clinical observations
复制标题
DOI：
10.1016/j.jclinepi.2010.10.015
复制
发表时间：
2011-07-01
影响因子：
7.2
通讯作者：
Kao, Wen-Hsin
中科院分区：
文献类型：
--
作者：
Hsiao, Chuhsing K.;Chen, Pei-Chun;Kao, Wen-Hsin
目的：评价者间和评价者内的信度通常涉及收集的数据中的多个层次的嵌套结构，其中由多个评价者进行重复观察。然而，大多数方法的设计，以适应间和intrarater的可靠性共同，更不用说进一步的困难时，二分法的反应建模。由于嵌套结构和协变量的存在的依赖性的多个来源，可能会导致在inference.Study设计和设置的复杂性：我们首先建立相关性和Kappa之间的等价性下共同的正相关模型的多个评分员，然后应用贝叶斯广义线性混合效应模型，同时解释这两种类型的再现性，通过不同的注释相似。除了边际相关，评分者之间的相关随机效应被用来推断评分者之间的相似性，而随机时间效应的相关性可能有助于重测信度。结果：该模型考虑了个体协变量和随机效应，因为主题，评分者，和时间，它涵盖了各种各样的数据结构和类型。结论：贝叶斯层次相关模型在牙体牙髓放射学检查中的应用具有广泛的适用性、灵活性和可行性。(C)2011 Elsevier Inc. All rights reserved.
Objective: The assessment of inter- and intrarater reliability usually involves more than one level of nesting structures in the collected data, where repeated observations are made by multiple raters. Most approaches, however, are not designed to accommodate both inter- and intrarater reliability jointly, not to mention further difficulties arising when modeling with dichotomous responses. The multiple sources of dependence because of nesting structures and the existence of covariates can result in complexity in inference.Study Design and Setting: We first establish the equivalence between correlation and kappa under common positive correlation models for multiple raters and then apply a Bayesian generalized linear mixed-effects model to interpret simultaneously both types of reproducibility through different annotations of similarity. In addition to marginal correlations, the correlated random effects among raters are adopted to infer similarity between raters, whereas the correlation for random time effects may contribute to test retest reliability.Results: This model accounts for individual covariates and random effects because of subjects, raters, and time, and it covers a wide variety of data structures and types. An application of endodontic radiographic examinations is illustrated.Conclusion: This Bayesian hierarchical correlation model offers a wide applicability, flexibility, and feasibility in modeling inter- and intrarater reliability together. (C) 2011 Elsevier Inc. All rights reserved.