Scalable and Robust Clinical Text De-Identification Tools

可扩展且强大的临床文本去识别工具

• 批准号: 8345041
• 负责人: DAVID S. CARRELL
• 金额: $ 31.88万
• 依托单位: KAISER FOUNDATION HEALTH PLAN OF WASHINGTON
• 依托单位国家: 美国
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-01 至 2015-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/8345041
• 关键词: Address; Age; Applied Research; Cardiac; Clinical; Detection; Disclosure; Evaluation; Excision; Foundations; Generations; Health; Health Insurance Portability and Accountability Act; Healthcare; Human; Information Theory; Institutional Review Boards; Left; Machine Learning; Manuals; Marketing; Methods; Modeling; Monitor; Names; Natural Language Processing; Patients; Penetration; Performance; Pilot Projects; Plant Roots; Privacy; Process; Publishing; Reader; Reporting; Research; Research Personnel; Research Project Grants; Residual state; Risk; Scoring Method; Simulate; Son; Source; System; Technology; Testing; Text; Validation; Vision; Work; base; efficacy testing; male; novel; open source; patient privacy; prevent; programs; repository; software systems; tool; transmission process

DESCRIPTION (provided by applicant): Exploiting the full potential of information rich and rapidly growing repositories of patient clinical text is hampered by the absence of scalable and robust de-identification tools. Clinical text contains protected health information (PHI), and the Health Insurance Portability and Accountability Act (HIPAA) restricts research use of patient information containing PHI to specific, limited, IRB-approved projects. As a result, vast repositories of clinical text remain under-used by internal researchers, and are even less available for external transmission to outside collaborators or for centralized processing by state-of-the-art natural language processing (NLP) technologies. De-identification, which is the removal of PHI from clinical text, is challenging. Despite their availability for over a decade, commercially available automated systems are expensive, require local tailoring, and have not gained widespread market penetration. Manual methods are costly and do not scale, yet continue to be used despite the small amount of residual PHI they leave behind. Open source de-identification tools based on state-of-the-art machine learning technologies can perform at or above the level of manual approaches but also suffer from the residual PHI problem. Current de-identification approaches, then, also severely limit the use and mobility of clinical text while exposing patients to privacy risks. These approaches redact PHI, blacking it out or replacing it with symbols (e.g., "Here for cardiac eval is Mr. **PT_NAME<AA>, a **AGE<60s> yo male with his son Doug ..."). Traditional approaches leave residual PHI ("Doug" in this example) to be easily noticed by readers of the text, as it remains plainly visible among the prominent redactions. We developed and pilot tested an alternative approach we believe addresses the residual PHI problem. Our approach uses the strategy of concealing, rather than trying to eliminate, residual PHI. We call it the "Hiding In Plain Sight" (HIPS) approach. HIPS replaces all known PHI with "surrogate" PHI- fictional names, ages, etc.-that look real but do not refer to any actual patient. A HIPS version of the above text is: "Here for cardiac eval is Mr. Jones, a 64 yo male with his son Doug ..." where the name "Jones" and age "64" are fictional surrogates, but the name "Doug" is residual PHI. To a reader, the surrogates and the residual PHI are indistinguishable. This prevents the reader from detecting the latter, avoiding disclosure. Our preliminary studies suggest that HIPS can reduce the risk of disclosure of residual PHI by a factor of 10. This yields overall performance that far surpasses the performance attainable by manual methods, and is unlikely to be matched, we believe, by additional incremental improvements in PHI tagging models (i.e., efforts to reduce residual PHI). Our pilot studies indicate IRBs would welcome the HIPS approach if it were shown to be effective through rigorous evaluation. To expand usage of clinical text and enhance patient privacy, we propose to formalize rules of effective surrogate generation (Aim 1), extend related de-identification confidence scoring methods (Aim 2), and conduct rigorous efficacy testing of HIPS in diverse institutional settings (Aim 3).

描述(由申请人提供)：由于缺乏可扩展和强大的识别工具，患者临床文本的丰富和快速增长的信息库的全部潜力受到阻碍。临床文本包含受保护的健康信息(PHI)，而《健康保险携带和责任法案》(HIPAA)将包含PHI的患者信息的研究使用限制在特定的、有限的、IRB批准的项目中。因此，大量的临床文本仍未被内部研究人员充分利用，更不能用于外部合作者的外部传输或通过最先进的自然语言处理(NLP)技术进行集中处理。去身份识别，即从临床文本中删除PHI，是具有挑战性的。尽管已有十多年的历史，但商业上可用的自动化系统价格昂贵，需要本地定制，而且尚未获得广泛的市场渗透率。人工方法成本高，规模小，但仍在继续使用，尽管它们留下了少量残留的PHI。基于最先进的机器学习技术的开放源码识别工具的性能可以达到或高于手动方法的水平，但也存在残存的PHI问题。因此，当前的去身份识别方法也严重限制了临床文本的使用和移动性，同时 使患者面临隐私风险。这些方法修改了PHI，将其涂黑或代之以符号(例如，“这里用于心脏评估的是**PT_NAME&lt；AA&gt；先生，一个**年龄60岁的男性和他的儿子Doug……”)。传统的方法使剩余的PHI(在本例中为“Doug”)很容易被文本的读者注意到，因为它在显著的密文中仍然清晰可见。我们开发并试行了一种替代方法，我们认为可以解决PHI的残留问题。我们的方法使用的是隐藏而不是试图消除残余PHI的策略。我们称其为“隐藏在视线中”(HIPS)方法。HIPS用“代理”PHI--虚构的名字、年龄等--取代了所有已知的PHI，这些看起来像真的，但并不是指任何实际的病人。上面这段文字的髋关节版本是：“琼斯先生，一个男，和他的儿子道格……来做心脏评估。”其中，名字“琼斯”和年龄“”是虚构的代孕，但名字“道格”是残存的PHI。对于读者来说，代理人和剩余的PHI是难以区分的。这防止了读者发现后者，从而避免了泄露。我们的初步研究表明，HIPS可以将剩余PHI的泄露风险降低10倍。这产生的总体性能远远超过人工方法所能达到的性能，我们认为，PHI标记模型的额外增量改进(即努力减少剩余PHI)不太可能与之相匹配。我们的初步研究表明，如果HIPS方法通过严格的评估被证明是有效的，IRBs将欢迎它。为了扩大临床文本的使用和增强患者隐私，我们建议正式制定有效替代品生成的规则(目标1)，扩展相关的去身份置信度评分方法(目标2)，并在不同的机构环境中对髋关节进行严格的疗效测试(目标3)。