INDEXES OF DISCRIMINATION OR DIAGNOSTIC-ACCURACY - THEIR ROCS AND IMPLIED MODELS
INDEXES OF DISCRIMINATION OR DIAGNOSTIC-ACCURACY - THEIR ROCS AND IMPLIED MODELS
复制标题
DOI：
10.1037/0033-2909.99.1.100
复制
发表时间：
1986-01-01
影响因子：
22.4
通讯作者：
SWETS, JA
中科院分区：
文献类型：
--
作者：
SWETS, JA
在心理学实验中，以观察作为区分两个可混淆的选项的基础的任务被广泛使用。类似的任务经常发生在许多实际环境中，其中的目标是某种诊断。已经提出了几个指标来量化识别的准确性，无论重点是观察者的能力或技能，还是为帮助观察者而设计的工具的有用性，还是全自动设备的能力。本文建议通过计算候选指标的相对运行特征（roc）来评价候选指标。指数ROC的形式确定了指数所隐含的歧视过程的模型，并且理论形式可以与经验ROC的形式进行比较。如果一个指数及其模型产生的ROC形式与数据中观察到的完全不同，则该模型无效，该指数不可靠。大多数现有的指数意味着无效的模型。有几个指标是合适的；推荐一个。
Tasks in which an observation is the basis for discriminating between two confusable alternatives are used widely in psychological experiments. Similar tasks occur routinely in many practical settings in which the objective is a diagnosis of some kind. Several indices have been proposed to quantify the accuracy of discrimination, whether the focus is on an observer''s capacity or skill, on the usefulness of tools designed to aid an observer, or on the capability of a fully automated device. The suggestion treated here is that candidate indices be evaluated by calculating their relative operating characteristics (ROCs). The form of an index''s ROC identifies the model of the discrimination process that is implied by the index, and that theoretical form can be compared with the form of empirical ROCs. If an index and its model yield a grossly different form of ROC than is observed in the data, then the model is invalid and the index will be unreliable. Most existing indices imply invalid models. A few indices are suitable; one is recommended.