Multipoint rank-order study methodology: observer issues.
Multipoint rank-order study methodology: observer issues.
复制标题
多点排序研究方法:观察者问题。
DOI:
10.1097/00004424-200002000-00006
复制
发表时间:
2000
影响因子:
6.7
通讯作者:
Gur,D
中科院分区:
文献类型:
--
作者:
Towers,JD;Holbert,JM;Britton,CA;Costello,P;Sciulli,R;Gur,D
Towers JD, Holbert JM, Britton CA, Costello P, Sciulli R, Gur D. Multipoint rank-order study methodology: Observer issues. Invest Radiol 2000; 35: 125–130.RATIONALE AND OBJECTIVES.We performed a multipoint rank-order experiment to evaluate variability in observers’ sensitivity to small differences in image presentation and to assess observers’ performance as a function of the type and number of tasks included.METHODS.Five experienced observers were presented with four sets of chest images that had been compressed at five different levels. Each set contained six images ranging from noncompressed to approximately 60: 1-compressed images. Observers were asked to review all images of each case side by side and rank-order the “quality” of each to enable determination of the presence or absence of interstitial disease and/or pneumothoraces.RESULTS.Observers varied significantly in their ability to detect very small differences among the images (P< 0.001). Those who performed well did so regardless of whether they ranked a specific abnormality in a multidisease or a single-disease setting.CONCLUSIONS.Selected observers can reliably detect very small differences among similar images. These readers could be used to confirm or rule out the need for objective observer-performance–type studies.