Using retest-adjusted correlations as indicators of the semantic similarity of items.
Using retest-adjusted correlations as indicators of the semantic similarity of items.
复制标题
使用重新测试调整的相关性作为项目语义相似性的指标。
DOI：
10.1037/pspp0000441
复制
发表时间：
2023
影响因子：
7.6
通讯作者：
Harms, P. D.
中科院分区：
文献类型：
--
作者：
Wood, Dustin;Lowman, Graham H.;Armstrong, Benjamin F.;Harms, P. D.
在确定不同的尺度或结构是否重叠或冗余时，确定不同的项目是否提供相同的信息或在总体中意味着相同的事情是一个核心问题。在本研究中，我们认为，重测调整的相关性提供了一个有价值的手段调整项目水平的不可靠性。更确切地说，我们建议将在测量间隔psp_125_2_437_math174上测量的项目X和Y之间的估计相关性分开。gif由相同测量间隔内项目的平均重测相关性表示。例如，如果我们将相隔1周测量的项目X和Y的分数相关联，则通过使用其1周重测相关性来估计其重测调整相关性。使用来自四个库存的数据，我们提供的证据表明，重新测试调整的相关性是显着更好的预测是否两个项目被一致认为是“同一件事”的法官比原始分数的相关性。结果可能提供了第一个经验证据，斯皮尔曼的（1904年，1910年）建议的可靠性调整做在一定的（也许非常有限！）环境-改进原始分数相关性，作为不同测试的信息或语义等效性的指标。
Determining whether different items provide the same information or mean the same thing within a population is a central concern when determining whether different scales or constructs are overlapping or redundant. In the present study, we suggest that retest-adjusted correlations provide a valuable means of adjusting for item-level unreliability. More exactly, we suggest dividing the estimated correlation between items X and Y measured over measurement interval psp_125_2_437_math174. gif by the average retest correlations of the items over the same measurement interval. For instance, if we correlate scores from items X and Y measured 1 week apart, their retest-adjusted correlation is estimated by using their 1-week retest correlations. Using data from four inventories, we provide evidence that retest-adjusted correlations are significantly better predictors of whether two items are consensually regarded as “meaning the same thing” by judges than raw-score correlations. The results may provide the first empirical evidence that Spearman’s (1904, 1910) suggested reliability adjustment do—in certain (perhaps very constrained!) circumstances—improve upon raw-score correlations as indicators of the informational or semantic equivalence of different tests.