AI platform for microscopy image restoration and virtual staining

用于显微图像恢复和虚拟染色的AI平台 项目总结： 荧光显微镜使生物医学科学中的许多重大发现成为可能。尽管 光学、激光、探测器、照相机和新技术的快速进步，空间等主要因素 时间分辨率、光曝光、信噪比、穿透深度和探测光谱仍在继续 以限制可能的实验类型。深度学习(DL)算法非常适合 基于图像的SNR/超分辨率恢复和虚拟染色等问题，具有很大的实用价值 使显微镜实验成为可能。以前不可能实现的实验可以这样实现 因为实现了高信噪比和/或时空分辨率，而没有光漂白/光毒性； 同时观察多个图像通道而不干扰本地进程等。这可能 为阐明生物学的基于显微镜的发现的量子飞跃铺平道路 研究疾病的功能和机制，并为人类疾病提供新的诊断和治疗方法。 然而，这些新方法还没有被广泛地转化为新的显微镜实验。这个 延迟是由于几个实际障碍和挑战，如所需的专业知识、计算和信任。在……里面 为了加速数字激光在显微镜领域的应用，需要为生物学家量身定做的新的人工智能平台 用于培训、应用和验证DL模型和输出。 本项目旨在开发一个用于显微图像恢复和虚拟的人工智能平台 染色称为人工智能修复和染色(AIRS)平台。与我们的合作者Hari Shroff博士 (国家生物医学成像和生物工程研究所)我们成功地为 各种成像条件下的SNR恢复、超分辨率恢复和虚拟染色 我们初步研究中的细胞器。AIRS平台的目的是(1)提供一套全面的 用于显微修复和包括SNR在内的虚拟染色应用的经验证的DL模型 复原、超分辨率复原、空间反卷积、光谱分解、3D预测 2D图像、细胞器虚拟染色和分析；(2)为普通显微镜提供即插即用 实验；(3)提供半自动更新培训，以定制DL模型以匹配高级 显微镜实验；(4)为新的DL模型创业培训提供用户友好的支持 显微镜实验；(5)通过DL模型提供置信度分数来评估输出结果，(6) 提供避免图像伪影(幻觉)并允许持续学习和进化的数字图书馆模型； (7)并能够访问所需的计算基础设施和数据库连接。

AI Platform for Microscopy Image Restoration and Virtual Staining Project Summary: Fluorescence microscopy has enabled many major discoveries in biomedical sciences. Despite the rapid advancements in optics, lasers, probes, cameras and novel techniques, major factors such as spatial and temporal resolution, light exposure, signal-to-noise, depth of penetration and probe spectra continue to limit the types of experiments that are possible. Deep learning (DL) algorithms are well suited for image-based problems like SNR/super-resolution restoration and virtual staining, which have great enabling potentials for microscopy experiments. Previously impossible experiments could be realized such as achieving high signal-to-noise and/or spatial-temporal resolution without photobleaching/phototoxicity; simultaneously observing many image channels without interfering with native processes, etc. This could pave the way for a quantum leap forward in microscopy-based discoveries that elucidate biological functions and the mechanisms of disorders, and enable new diagnostics and therapies for human diseases. However, these new methods have not been widely translated to new microscopy experiments. The delay is due to several practical hurdles and challenges such as required expertise, computing and trust. In order to accelerate the adoption of DL in microscopy, novel AI platform tailored for biologists are needed for training, applying and validating DL models and outputs. The present project aims to develop an AI platform for microscopy image restoration and virtual staining called AI for Restoring and Staining (AIRS) platform. With our collaborator, Dr. Hari Shroff (National Institute of Biomedical Imaging and Bioengineering) we have successfully created DL models for SNR restoration, super-resolution restoration and virtual staining for a variety of imaging conditions and organelles in our preliminary studies. The AIRS platform intends to (1)provide a comprehensive suite of validated DL models for microscopy restoration and virtual staining applications including SNR restoration, super-resolution restoration, spatial deconvolution, spectral unmixing, prediction of 3d from 2d images, organelle virtual staining and analysis; (2)provide plug and play for common microscopy experiments; (3)provide semi-automatic update training to tailor DL models to match advanced microscopy experiments; (4)provide user friendly support for new DL model training for pioneering microscopy experiments; (5)provide confidence scores to assess the output results by a DL model, (6) provide DL models that avoid image artifact (hallucination) and allow continuous learning and evolution; (7) and be able to access the required computing infrastructure and database connection.