Radiologist-Centered Artificial Intelligence (RCAI) for Lung Cancer Screening and Diagnosis

以放射科医生为中心的人工智能（RCAI）用于肺癌筛查和诊断

• 批准号: 10640048
• 负责人: Ulas Bagci
• 金额: $ 44.75万
• 依托单位: NORTHWESTERN UNIVERSITY AT CHICAGO
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-07-01 至 2025-05-31
• 项目状态: 未结题
• 来源: https://reporter.nih.gov/project-details/10640048
• 关键词: Address; Adopted; Artificial Intelligence; Benign; Cancer Etiology; Cessation of life; Classification; Clinical; Cognitive; Collaborations; Communication; Computer-Assisted Diagnosis; Cues; Data; Detection; Devices; Diagnosis; Diagnostic; Diagnostic Procedure; Event; Feedback; Glass; Goals; Human; Image; Intuition; Label; Learning; Learning Module; Length; Location; Lung Neoplasms; Lung nodule; Mainstreaming; Malignant - descriptor; Malignant neoplasm of lung; Measurement; Measures; Methodology; Modeling; Nodule; Outcomes Research; Pattern; Pennsylvania; Performance; Phase; Probability; Process; Radiology Specialty; Reading; Reproducibility; Research; Scanning; Screening for cancer; Screening procedure; Second Opinions; Shapes; System; Techniques; Technology; Testing; Texture; Three-Dimensional Image; Time; Training; United States; United States National Institutes of Health; Universities; Update; Visual attention; Visualization; Woman; Work; X-Ray Computed Tomography; artificial intelligence algorithm; attenuation; calcification; career; clinical decision-making; clinical diagnostics; computer human interaction; cone-beam computed tomography; deep learning; deep learning algorithm; deep reinforcement learning; design; diagnostic accuracy; educational atmosphere; efficacy evaluation; efficacy validation; experience; experimental study; flexibility; gaze; improved; inattention; insight; learning algorithm; learning network; low dose computed tomography; lung cancer screening; men; mortality; novel; radiologist; sample fixation; satisfaction; screening; statistics; synergism; technological innovation; tool; tumor; virtual; visual search; visual tracking

PROJECT SUMMARY Lung cancer is the most common cause of cancer death in both men and women in the United States. Lung cancer screening with low-dose computed tomography (CT) has been shown to reduce lung cancer mortality. However, current radiology practice still suffers from (1) high rates of missed tumors and (2) imprecise lung nodule characterization (malignant vs. benign). Artificial intelligence (AI) based computer aided diagnosis (CAD) systems have helped radiologists to reduce the missed-tumor rates moderately, but have not been widely adopted for three key reasons: lack of efficiency, lack of real-time collaboration, and lack of interpretability. The overall goal of this proposal is to create radiologist-centered artificial intelligence algorithms that are both interpretable and collaborative and to demonstrate their improved efficacy via lung cancer screening experiments. The central hypothesis of this effort is that the creation of an AI based virtual cognitive assistant (VCA) will provide a better understanding of cognitive biases while offering interpretable feedback to radiologists for an improved screening experience with higher diagnostic accuracy, reproducibility, and efficiency. Specific aims of the proposal are three-fold. Aim 1: To develop an eye-tracking platform that offers a realistic radiology reading room experience while extracting gaze patterns from radiologists. This will facilitate addressing the problem of true collaboration between radiologists and CAD. Radiologists will perform their screening without any constraints (e.g., wearing glasses) while their gaze patterns and other human-computer interaction events are tracked, processed, and stored in real time. Aim 2: To develop an automated real-time collaborative system involving a developed VCA and the radiologist to synergistically improve detection and diagnostic performances. Using deep learning (DL) algorithms, the VCA will embody a powerful visual attention model to represent radiologists’ gaze, visual search, and fixation patterns, and will be composed of a detection component and a diagnostic component. A deep reinforcement learning algorithm will enable communication between the VCA and the radiologist. Lastly, a DL-based segmentation component will, on the fly, enable the VCA to derive and visualize quantitative measures (HU statistics, volume, long/short axes lengths, etc.) and overlay them along with the tumor classification label (benign/malignant) and its probability in real time. Aim 3: To evaluate the efficacy of the proposed VCA via lung cancer screening experiments involving six radiologists from two institutes (University of Pennsylvania and NIH) at different expertise levels. The proposed VCA is a first-of-a-kind-system to exploit the synergy between powerful DL technology and experts (humans) to attempt boost clinical diagnostic performance of radiologists, unlike passive DL techniques that learn from labeled data. The outcome of this research are expected to be transformative by providing deep insights for re-designing current CAD systems to truly collaborate with radiologists, instead of acting as second opinion tools for them or replacing them, and by ultimately further reducing lung cancer-related deaths.

项目摘要 肺癌是美国男性和女性癌症死亡的最常见原因。肺 用低剂量计算机断层扫描（CT）进行癌症筛查已显示出降低肺癌死亡率。 然而，目前的放射学实践仍然遭受（1）高比率的漏诊肿瘤和（2）不精确的肺 结节特征（恶性与良性）。基于人工智能的计算机辅助诊断（CAD） 系统已经帮助放射科医生适度地降低了漏诊率，但还没有广泛应用。 采用的主要原因有三个：缺乏效率、缺乏实时协作和缺乏可解释性。的 该提案的总体目标是创建以放射科医生为中心的人工智能算法， 并通过肺癌筛查证明其改善的疗效 实验这项工作的核心假设是，创建基于AI的虚拟认知助理， (VCA)将更好地理解认知偏差，同时为放射科医生提供可解释的反馈 以获得更高的诊断准确性、再现性和效率，从而改善筛查体验。 该提案的具体目标有三个方面。目标1：开发眼动追踪平台， 逼真的放射学阅读室体验，同时从放射科医师提取凝视模式。这将有利于 解决放射科医师和CAD之间真正协作的问题。放射科医生将执行他们的 没有任何约束的筛选（例如，戴眼镜），而他们的凝视模式和其他人机 交互事件被真实的跟踪、处理和存储。目标2：开发自动化实时 协作系统，涉及发达的VCA和放射科医生，以协同提高检测和 诊断性能。使用深度学习（DL）算法，VCA将体现强大的视觉注意力 模型来表示放射科医师的凝视、视觉搜索和固定模式，并且将由检测 组件和诊断组件。深度强化学习算法将实现沟通 和放射科医生之间的联系最后，基于DL的分段组件将动态地启用 VCA用于导出和可视化定量测量（HU统计、体积、长/短轴长度等）和 将它们沿着肿瘤分类标签（良性/恶性）及其概率真实的叠加。目标三： 通过6名放射科医生参与的肺癌筛查实验，评价拟议的VCA的有效性 来自两个不同专业水平的研究所（宾夕法尼亚大学和NIH）。 拟议中的VCA是一个首创的系统，利用强大的DL技术和 与被动DL技术不同， 从标记数据中学习。这项研究的成果预计将通过提供深入的 重新设计当前CAD系统的见解，真正与放射科医生合作，而不是充当第二个 为他们提供意见工具或取代他们，并最终进一步减少肺癌相关死亡。

项目成果

Machine learning-based prediction of MRI-induced power absorption in the tissue in patients with simplified deep brain stimulation lead models.

• DOI: 10.1109/temc.2021.3106872
• 发表时间: 2021-10
• 期刊: IEEE transactions on electromagnetic compatibility
• 影响因子: 2.1
• 作者: Vu J;Nguyen BT;Bhusal B;Baraboo J;Rosenow J;Bagci U;Bright MG;Golestanirad L
• 通讯作者: Golestanirad L

Adipose Tissue Segmentation in Unlabeled Abdomen MRI using Cross Modality Domain Adaptation.

使用交叉模态域的适应性适应未标记的腹部MRI中的脂肪组织分割。

• DOI: 10.1109/embc44109.2020.9176009
• 发表时间: 2020-07
• 期刊: Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
• 作者: Masoudi S;Anwar SM;Harmon SA;Choyke PL;Turkbey B;Bagci U
• 通讯作者: Bagci U

Multi-Contrast MRI Segmentation Trained on Synthetic Images.

• DOI: 10.1109/embc48229.2022.9871119
• 发表时间: 2022-07
• 期刊: Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference

Deep Learning Based Staging of Bone Lesions From Computed Tomography Scans.

基于深度学习的计算机断层扫描骨病变分期。

• DOI: 10.1109/access.2021.3074051
• 发表时间: 2021
• 期刊: IEEE access : practical innovations, open solutions
• 作者: Masoudi S;Mehralivand S;Harmon SA;Lay N;Lindenberg L;Mena E;Pinto PA;Citrin DE;Gulley JL;Wood BJ;Dahut WL;Madan RA;Bagci U;Choyke PL;Turkbey B
• 通讯作者: Turkbey B

A machine learning-based prediction of the micropapillary/solid growth pattern in invasive lung adenocarcinoma with radiomics.

• DOI: 10.21037/tlcr-21-44
• 发表时间: 2021-03
• 期刊: Translational lung cancer research
• 影响因子: 4
• 作者: He B;Song Y;Wang L;Wang T;She Y;Hou L;Zhang L;Wu C;Babu BA;Bagci U;Waseem T;Yang M;Xie D;Chen C
• 通讯作者: Chen C