Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies.
Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies.
复制标题
DOI：
10.1002/sim.7679
复制
发表时间：
2018-08-15
影响因子：
2
通讯作者：
Koch G
中科院分区：
文献类型：
--
作者：
Mehta S;Bastero-Caballero RF;Sun Y;Zhu R;Murphy DK;Hardas B;Koch G
许多已发表的量表验证研究使用类内相关系数确定了等级间的信度。但是，使用此统计数据必须考虑其优点、局限性和适用性。本文评估了受试者分布、样本量和评分不一致水平的相互作用如何影响，并提供了在次优条件下获得相关估计的方法。仿真结果表明，对于固定数量的受试者，从凸分布的角度小于均匀分布的角度，均匀分布的角度小于凹分布的角度。方差分量估计还表明，分布之间的差异归因于受试者变异性的研究设计（即受试者的分布）成分，而不是评分误差变异性的量表质量成分。对受试者分布的依赖性使得在可靠性研究中比较结果变得困难。因此，有人建议，可靠性研究应该设计使用受试者的均匀分布，因为它提供了代表客观分歧的标准化。在不均匀分布的情况下，提出了一种减少非均匀性的采样方法。此外，正如预期的那样，高水平的分歧导致低，并且当分布类型固定时，任何超出适度大规格的主题数量的增加都不会对。
Many published scale validation studies determine inter‐rater reliability using the intra‐class correlation coefficient . However, the use of this statistic must consider its advantages, limitations, and applicability. This paper evaluates how interaction of subject distribution, sample size, and levels of rater disagreement affects and provides an approach for obtaining relevant estimates under suboptimal conditions. Simulation results suggest that for a fixed number of subjects, from the convex distribution is smaller than for the uniform distribution, which in turn is smaller than for the concave distribution. The variance component estimates also show that the dissimilarity of among distributions is attributed to the study design (ie, distribution of subjects) component of subject variability and not the scale quality component of rater error variability. The dependency of on the distribution of subjects makes it difficult to compare results across reliability studies. Hence, it is proposed that reliability studies should be designed using a uniform distribution of subjects because of the standardization it provides for representing objective disagreement. In the absence of uniform distribution, a sampling method is proposed to reduce the non‐uniformity. In addition, as expected, high levels of disagreement result in low , and when the type of distribution is fixed, any increase in the number of subjects beyond a moderately large specification such as does not have a major impact on .
登录
查看更多内容
影响因子：
2.4
作者：
Carruthers, Alastair;Carruthers, Jean;Buchner, Larry
通讯作者：
Buchner, Larry
影响因子：
3.6
作者：
Kane, Michael A. C.;Lorenc, Z. Paul;Smith, Stacy R.
通讯作者：
Smith, Stacy R.
DOI：
10.1111/j.1468-3083.2010.03816.x
发表时间：
2011-05-01
影响因子：
9.2
作者：
Rossi, A. B.;Nkengne, A.;Bertin, C.
通讯作者：
Bertin, C.
影响因子：
2.7
作者：
FLEISS, JL;COHEN, J
通讯作者：
COHEN, J
影响因子：
2.4
作者：
Carruthers, Alastair;Donofrio, Lisa;Dill, Sara
通讯作者：
Dill, Sara