Inductive creation of an annotation schema for manually indexing clinical conditions from emergency department reports
Inductive creation of an annotation schema for manually indexing clinical conditions from emergency department reports
复制标题
DOI：
10.1016/j.jbi.2005.06.004
复制
发表时间：
2006-04-01
影响因子：
4.5
通讯作者：
Dowling, JN
中科院分区：
文献类型：
--
作者：
Chapman, WW;Dowling, JN
评估自动索引应用程序需要将自动索引的术语与手动参考标准注释进行比较。然而，没有标准的指导方针，以确定哪些词从文本文档中包括在手动注释，和模糊的任务可能会导致大量的变化之间的手动索引。我们将扎根理论应用于急诊科报告，以创建一个注释模式，表示在索引临床条件时可以注释的语法和语义变量。我们描述了注释模式，其中包括表示医学概念的变量（例如，症状、人口统计学）、语言形式（例如，名词、形容词）和修饰语类型（例如..解剖位置、严重程度）。我们测量了该模式的质量，发现：（1）该模式足够全面，可以应用于20份未见过的报告，而无需更改模式;（2）应用该模式的作者注释者之间的一致性很高，F测量值为93%;（3）作者在应用该模式时犯了互补性错误，表明该模式结合了语言学和医学专业知识。(c)2005年爱思唯尔公司All rights reserved.
Evaluating automated indexing applications requires comparing automatically indexed terms against manual reference standard annotations. However, there are no standard guidelines for determining which words from a textual document to include in manual annotations, and the vague task can result in substantial variation among manual indexers. We applied grounded theory to emergency department reports to create an annotation schema representing syntactic and semantic variables that could be annotated when indexing clinical conditions. We describe the annotation schema, which includes variables representing medical concepts (e.g., symptom, demographics), linguistic form (e.g... noun, adjective), and modifier types (e.g... anatomic location, severity). We measured the schema's quality and found: (1) the schema was comprehensive enough to be applied to 20 unseen reports without changes to the schema; (2) agreement between author annotators applying the schema was high, with an F measure of 93%; and (3) the authors made complementary errors when applying the schema, demonstrating that the schema incorporates both linguistic and medical expertise. (c) 2005 Elsevier Inc. All rights reserved.