An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis
An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis
复制标题
DOI：
10.1038/s41591-019-0539-7
复制
发表时间：
2019-09-01
期刊：
影响因子：
82.9
通讯作者：
Stumpe, Martin C.
中科院分区：
文献类型：
--
作者：
Chen, Po-Hsuan Cameron;Gadepalli, Krishna;Stumpe, Martin C.
组织样本的显微评估有助于癌症的诊断和分期，从而指导治疗。然而，这些评估显示出相当大的变异性，世界许多地区缺乏训练有素的病理学家。尽管人工智能(AI)承诺改善医疗保健的获取和质量，但病理图像数字化的成本和部署AI解决方案的困难仍然是现实世界使用的障碍。在这里，我们提出了一个经济高效的解决方案：增强现实显微镜(ARM)。ARM实时将基于人工智能的信息覆盖到样本的当前视图上，从而实现了人工智能与常规工作流程的无缝集成。我们展示了ARM在检测转移性乳腺癌和识别前列腺癌中的应用，其潜伏期与实时使用兼容。我们预计，ARM将消除使用人工智能的障碍，旨在提高癌症诊断的准确性和效率。
The microscopic assessment of tissue samples is instrumental for the diagnosis and staging of cancer, and thus guides therapy. However, these assessments demonstrate considerable variability and many regions of the world lack access to trained pathologists. Though artificial intelligence (AI) promises to improve the access and quality of healthcare, the costs of image digitization in pathology and difficulties in deploying AI solutions remain as barriers to real-world use. Here we propose a cost-effective solution: the augmented reality microscope (ARM). The ARM overlays AI-based information onto the current view of the sample in real time, enabling seamless integration of AI into routine workflows. We demonstrate the utility of ARM in the detection of metastatic breast cancer and the identification of prostate cancer, with latency compatible with real-time use. We anticipate that the ARM will remove barriers towards the use of AI designed to improve the accuracy and efficiency of cancer diagnosis.