NLPReViz: an interactive tool for natural language processing on clinical text.
NLPReViz: an interactive tool for natural language processing on clinical text.
复制标题
NLPReViz：一种用于临床文本自然语言处理的交互式工具。
DOI：
10.1093/jamia/ocx070
复制
发表时间：
2018
期刊：
影响因子：
--
通讯作者：
Hochheiser,Harry
中科院分区：
文献类型：
--
作者：
Trivedi,Gaurav;Pham,Phuong;Chapman,WendyW;Hwa,Rebecca;Wiebe,Janyce;Hochheiser,Harry
领域专家和自然语言处理专家之间的差距是从临床文本中提取理解的障碍。我们描述了一个原型工具，用于交互式审查和修订从临床笔记中提取的二进制概念的自然语言处理模型。我们在一项涉及9名医生的用户研究中评估了我们的原型，他们使用我们的工具为2个结肠镜检查质量变量构建和修改模型。我们报告相对于反馈量的性能变化。使用小至10份文件的初始训练集，专家评审导致“顶孔”变量的最终F1评分在0.78和0.91之间（改善范围为13.26%至29.90%）。“活检”的F1在0.88和0.94之间（改善-1.52%至11.74%）。系统可用性量表的平均得分为70.56。主观反馈还建议可能的设计改进。
The gap between domain experts and natural language processing expertise is a barrier to extracting understanding from clinical text. We describe a prototype tool for interactive review and revision of natural language processing models of binary concepts extracted from clinical notes. We evaluated our prototype in a user study involving 9 physicians, who used our tool to build and revise models for 2 colonoscopy quality variables. We report changes in performance relative to the quantity of feedback. Using initial training sets as small as 10 documents, expert review led to finalF1scores for the “appendiceal-orifice” variable between 0.78 and 0.91 (with improvements ranging from 13.26% to 29.90%).F1for “biopsy” ranged between 0.88 and 0.94 (−1.52% to 11.74% improvements). The average System Usability Scale score was 70.56. Subjective feedback also suggests possible design improvements.