AI platform for microscopy image restoration and virtual staining
AI platform for microscopy image restoration and virtual staining
批准号:
9909318
负责人:
Shih-Jong J Lee
金额:
$17.24万
依托单位国家:
美国
项目类别:
财政年份:
2020
资助国家:
美国
项目状态:
已结题
起止时间:
2020-04-01 至 2020-11-15
关键词:
3-DimensionalActive LearningAdoptionArtificial IntelligenceBiological ProcessDataDatabasesDiseaseEvaluationEvolutionFeedbackFluorescence MicroscopyGovernmentHallucinationsImageInfrastructureLasersLibrariesLightManualsMethodsMicroscopyModelingMorphologic artifactsNational Institute of Biomedical Imaging and BioengineeringNoiseOpticsOrganellesOutputPenetrationPerformancePersonsPhasePhotobleachingPhototoxicityPlayProcessResolutionScienceSignal TransductionStainsTechniquesTechnologyTestingThree-Dimensional ImageTrainingTranslatingTrustUpdateValidationbasecommercializationdeep learningdeep learning algorithmexperienceexperimental studyhuman diseaseimprovedinnovationlearning progressionmicroscopic imagingnovelnovel diagnosticsnovel therapeuticsprototypequantumrestorationtemporal measurementtoolusabilityuser-friendlyvirtual
中文摘要
用于显微图像恢复和虚拟染色的AI平台
项目总结:
荧光显微镜使生物医学科学中的许多重大发现成为可能。尽管
光学、激光、探测器、照相机和新技术的快速进步,空间等主要因素
时间分辨率、光曝光、信噪比、穿透深度和探测光谱仍在继续
以限制可能的实验类型。深度学习(DL)算法非常适合
基于图像的SNR/超分辨率恢复和虚拟染色等问题,具有很大的实用价值
使显微镜实验成为可能。以前不可能实现的实验可以这样实现
因为实现了高信噪比和/或时空分辨率,而没有光漂白/光毒性;
同时观察多个图像通道而不干扰本地进程等。这可能
为阐明生物学的基于显微镜的发现的量子飞跃铺平道路
研究疾病的功能和机制,并为人类疾病提供新的诊断和治疗方法。
然而,这些新方法还没有被广泛地转化为新的显微镜实验。这个
延迟是由于几个实际障碍和挑战,如所需的专业知识、计算和信任。在……里面
为了加速数字激光在显微镜领域的应用,需要为生物学家量身定做的新的人工智能平台
用于培训、应用和验证DL模型和输出。
本项目旨在开发一个用于显微图像恢复和虚拟的人工智能平台
染色称为人工智能修复和染色(AIRS)平台。与我们的合作者Hari Shroff博士
(国家生物医学成像和生物工程研究所)我们成功地为
各种成像条件下的SNR恢复、超分辨率恢复和虚拟染色
我们初步研究中的细胞器。AIRS平台的目的是(1)提供一套全面的
用于显微修复和包括SNR在内的虚拟染色应用的经验证的DL模型
复原、超分辨率复原、空间反卷积、光谱分解、3D预测
2D图像、细胞器虚拟染色和分析;(2)为普通显微镜提供即插即用
实验;(3)提供半自动更新培训,以定制DL模型以匹配高级
显微镜实验;(4)为新的DL模型创业培训提供用户友好的支持
显微镜实验;(5)通过DL模型提供置信度分数来评估输出结果,(6)
提供避免图像伪影(幻觉)并允许持续学习和进化的数字图书馆模型;
(7)并能够访问所需的计算基础设施和数据库连接。
英文摘要
AI Platform for Microscopy Image Restoration and Virtual Staining
Project Summary:
Fluorescence microscopy has enabled many major discoveries in biomedical sciences. Despite the
rapid advancements in optics, lasers, probes, cameras and novel techniques, major factors such as spatial
and temporal resolution, light exposure, signal-to-noise, depth of penetration and probe spectra continue
to limit the types of experiments that are possible. Deep learning (DL) algorithms are well suited for
image-based problems like SNR/super-resolution restoration and virtual staining, which have great
enabling potentials for microscopy experiments. Previously impossible experiments could be realized such
as achieving high signal-to-noise and/or spatial-temporal resolution without photobleaching/phototoxicity;
simultaneously observing many image channels without interfering with native processes, etc. This could
pave the way for a quantum leap forward in microscopy-based discoveries that elucidate biological
functions and the mechanisms of disorders, and enable new diagnostics and therapies for human diseases.
However, these new methods have not been widely translated to new microscopy experiments. The
delay is due to several practical hurdles and challenges such as required expertise, computing and trust. In
order to accelerate the adoption of DL in microscopy, novel AI platform tailored for biologists are needed
for training, applying and validating DL models and outputs.
The present project aims to develop an AI platform for microscopy image restoration and virtual
staining called AI for Restoring and Staining (AIRS) platform. With our collaborator, Dr. Hari Shroff
(National Institute of Biomedical Imaging and Bioengineering) we have successfully created DL models for
SNR restoration, super-resolution restoration and virtual staining for a variety of imaging conditions and
organelles in our preliminary studies. The AIRS platform intends to (1)provide a comprehensive suite of
validated DL models for microscopy restoration and virtual staining applications including SNR
restoration, super-resolution restoration, spatial deconvolution, spectral unmixing, prediction of 3d from
2d images, organelle virtual staining and analysis; (2)provide plug and play for common microscopy
experiments; (3)provide semi-automatic update training to tailor DL models to match advanced
microscopy experiments; (4)provide user friendly support for new DL model training for pioneering
microscopy experiments; (5)provide confidence scores to assess the output results by a DL model, (6)
provide DL models that avoid image artifact (hallucination) and allow continuous learning and evolution;
(7) and be able to access the required computing infrastructure and database connection.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Intelligent connectomic analysis tool for dense neuronal circuits
-
批准号:10019731
-
项目类别:
-
资助金额:$33.04万
-
财政年份:2020
-
负责人:Shih-Jong J Lee
-
依托单位:
Intelligent connectomic analysis tool for dense neuronal circuits
-
批准号:10311303
-
项目类别:
-
资助金额:$67.91万
-
财政年份:2020
-
负责人:Shih-Jong J Lee
-
依托单位:
AI platform for microscopy image restoration and virtual staining
-
批准号:10328064
-
项目类别:
-
资助金额:$11.42万
-
财政年份:2020
-
负责人:Shih-Jong J Lee
-
依托单位:
Kinetic Phenotype Discovery Informatics for Neurological Diseases
-
批准号:9769172
-
项目类别:
-
资助金额:$60.19万
-
财政年份:2016
-
负责人:Shih-Jong J Lee
-
依托单位:
Kinetic Phenotype Discovery Informatics for Neurological Diseases
-
批准号:10321425
-
项目类别:
-
资助金额:$35.81万
-
财政年份:2016
-
负责人:Shih-Jong J Lee
-
依托单位:
A 3D particle tracking tool for next generation neuroscience microscopy
-
批准号:8648198
-
项目类别:
-
资助金额:$29.65万
-
财政年份:2014
-
负责人:Shih-Jong J Lee
-
依托单位:
Efficient patient-specific cell generation by image-guidance
-
批准号:8697110
-
项目类别:
-
资助金额:$97.65万
-
财政年份:2011
-
负责人:Shih-Jong J Lee
-
依托单位:
Efficient patient-specific cell generation by image-guidance
-
批准号:8392472
-
项目类别:
-
资助金额:$98.77万
-
财政年份:2011
-
负责人:Shih-Jong J Lee
-
依托单位:
Efficient patient-specific cell generation by image-guidance
-
批准号:8058635
-
项目类别:
-
资助金额:$37.49万
-
财政年份:2011
-
负责人:Shih-Jong J Lee
-
依托单位:
Efficient patient-specific cell generation by image-guidance
-
批准号:8509778
-
项目类别:
-
资助金额:$98.35万
-
财政年份:2011
-
负责人:Shih-Jong J Lee
-
依托单位:
Analysis of tracking based phenotypes in CNS
-
批准号:8119649
-
项目类别:
-
资助金额:$45.68万
-
财政年份:2006
-
负责人:Shih-Jong J Lee
-
依托单位:
Robust Characterization of Moving Objects for Subcellular Time-lapse Assays
-
批准号:7108787
-
项目类别:
-
资助金额:$10.0万
-
财政年份:2006
-
负责人:Shih-Jong J Lee
-
依托单位:
Individual Cell Motility Image Informatics
-
批准号:7053106
-
项目类别:
-
资助金额:$10.0万
-
财政年份:2006
-
负责人:Shih-Jong J Lee
-
依托单位:
Analysis of tracking based phenotypes in CNS
-
批准号:7914170
-
项目类别:
-
资助金额:$49.1万
-
财政年份:2006
-
负责人:Shih-Jong J Lee
-
依托单位:
Phase II: Robust analysis of subcellular time-lapse assays
-
批准号:7477872
-
项目类别:
-
资助金额:$35.47万
-
财政年份:2005
-
负责人:Shih-Jong J Lee
-
依托单位:
Phase II: Robust analysis of subcellular time-lapse assays
-
批准号:7326926
-
项目类别:
-
资助金额:$39.52万
-
财政年份:2005
-
负责人:Shih-Jong J Lee
-
依托单位:
Robust Analysis of Subcellular Time-lapse Assays
-
批准号:6997585
-
项目类别:
-
资助金额:$10.0万
-
财政年份:2005
-
负责人:Shih-Jong J Lee
-
依托单位:
海外基金