Relationships among performance scores of four diagnostic decision support systems.
Relationships among performance scores of four diagnostic decision support systems.
复制标题
四种诊断决策支持系统的性能分数之间的关系。
DOI：
10.1136/jamia.1996.96310634
复制
发表时间：
1996
期刊：
影响因子：
--
通讯作者：
Algina,J
中科院分区：
文献类型：
--
作者：
Berner,ES;Jackson,JR;Algina,J
目的：研究四种诊断决策支持系统（DDSS）的不同绩效评分之间的关系。设计：四种DDSS中每种DDSS的一组105例病例的七个绩效评分之间的相关性方法：每例病例的操作评分反映：（1）DDSS知识库中有无病例诊断; 2）DDSS诊断列表上任何地方是否存在正确诊断; 3）前十名诊断中是否存在正确诊断; 4）DDSS诊断列表的相关性; 5）DDSS诊断列表的全面性; 6）DDSS是否建议对专家列表进行额外诊断;结果：DDSS的前10名正确诊断得分和总正确诊断得分与知识库中正确诊断的存在、综合性得分和相互之间存在显著相关。四个DDSS之间在以下各项之间的关系的大小和/或方向上存在显著差异：1）两个正确诊断评分; 2）相关性和长度评分;以及3）相关性和附加诊断评分。给定病例的正确诊断与DDSS建议的诊断数量无关，并且在不同的DDSS中，与其他业绩衡量标准并不一致。这些数据表明，需要多种措施来充分描述DDSS的性能。
Objective: To examine the relationships among different performance scores for each of four diagnostic decision support systems (DDSSs).Design: Intercorrelations among seven performance scores on a set of 105 cases for each of four DDSSs (DXplain, Iliad, Meditel, QMR) were computed.Methods: The performance scores for each case reflected: 1) presence or absence of the case diagnosis in the DDSS knowledge base; 2) presence or absence of the correct diagnosis anywhere on the DDSS diagnosis list; 3) presence or absence of the correct diagnosis in the top ten diagnoses; 4) relevance of the DDSS diagnosis list; 5) comprehensiveness of the DDSS diagnosis list; 6) whether the DDSS suggested additional diagnoses to the experts' list; and 7) the length of the DDSS diagnosis list.Results: For all DDSSs, the two Correct Diagnosis scores (top ten and total list) were significantly related: 1) to the presence of the correct diagnosis in the knowledge base; 2) to the Comprehensiveness score; and 3) to each other. There were significant differences among the four DDSSs on the magnitude and/or direction of the relationships between: 1) the two Correct Diagnosis scores; 2) the Relevance and Length scores; and 3) the Relevance and Additional Diagnoses scores.Conclusion: The production of a correct diagnosis for a given case is not related to the number of diagnoses suggested by the DDSS and, across different DDSSs, is not consistently related to other measures of performance. These data indicate that multiple measures are needed to fully describe the performance of a DDSS.