IMAT-ITCR Collaboration: Develop deep learning-based methods to identify subtypes of circulating tumor cells from optical microscope images

IMAT-ITCR协作：开发基于深度学习的方法来识别循环肿瘤的亚型 细胞从光学显微镜图像 项目总结/摘要 母IMAT项目（R21 CA 240185）的目标是开发一个新的CTC分馏和分析平台 亚群，并阐明CTC的转移潜力。目前，这项工作需要研究人员记录数百个 在微芯片上捕获的细胞的单个显微镜图像，将所有图像与流动流体模拟相结合， 并分析了捕获细胞的三个特征（包括角位置、归一化速度和剪切力）进行识别 CTC亚型。这个过程非常劳动密集和耗时，因为大多数步骤依赖于手动操作。 ITCR项目（1U 01 CA 249245）的目标是开发一个信息学平台iSEE-Cell（基于图像的空间 pattern ExplorEr for Cells），其具有一套用于组织图像分析、可视化、探索 和单细胞水平的空间建模。这一拟议的行政补充申请，以支持 IMAT和ITCR资助的项目之间的合作旨在开发基于深度学习的方法来识别亚型 从光学显微镜图像中的CTC。这一提议的基本原理是，深度学习的发展 方法将提供在HU结构的微芯片上捕获的CTC的自动表征和分类。这 拟议的合作项目将利用这两个项目开发的技术，这将汇集和 增强互补技术平台和方法的能力，以推进癌症研究。创新 所提出的方法包括以下内容：1）使用CTC的位置来鉴定CTC的多个亚型 在没有破坏性免疫染色分析的情况下，HU微芯片上的信息; 2）改进的新型Restore-GAN模型 CTC捕获实验中获得的显微镜图像质量，并提高CTC亚型的预测准确性; 3） 拟议的信息学工具将提供计算机辅助的自动化工具，使反恐委员会的研究能够以人工方式进行。 智能具体目标包括：目标1：使用显微镜图像和分析/预测结果（来自IMAT 项目）作为数据输入以测试从肿瘤组织图像分类不同类型细胞的算法（iSEE-Cell， 目标2：应用新的计算方法（恢复- GAN，在卢旺达问题国际法庭项目中开发），以提高从IMAT项目获得的图像的图像质量，并测试 它们是否可以提高CTC亚型的预测准确性;目标3：开发一个用户友好的界面， iSEE-Cell平台用于远程分析光学/荧光显微镜图像。能够自动 从显微镜图像中捕获的细胞中提取/分析信息是迫切需要的， IMAT项目的产量和工作效率。

IMAT-ITCR Collaboration: Develop deep learning-based methods to identify subtypes of circulating tumor cells from optical microscope images Project Summary/Abstract The goal of the parent IMAT project (R21CA240185) is to develop a new platform for fractionation and profiling of CTC subpopulations and elucidate the metastatic potential of CTCs. Currently, this work requires researchers to record hundreds of individual microscope images of the cells captured on the microchip, integrate all images with flow fluid simulations, and analyze three features of the capture cells (including angular position, normalized velocity and shear) for identification of CTC subtypes. This process is very labor-intensive and time-consuming, as most of the steps rely on manual operations. The goal of the ITCR project (1U01CA249245) is to develop an informatics platform, iSEE-Cell (image-based Spatial pattern ExplorEr for Cells), which features a suite of informatics tools for tissue image analysis, visualization, exploration and spatial modeling at the single-cell level. This proposed Administrative Supplement application in support of collaboration between IMAT and ITCR-funded projects aims to develop deep learning-based methods to identify subtypes of CTCs from optical microscope images. The rationale underlying this proposal is that the development of deep learning methods will provide automatic characterization and classification of CTC captured on HU structured microchips. This proposed collaborative project will leverage the technologies developed by both projects, which will bring together and enhance the capabilities of complementary technology platforms and methodologies to advance cancer research. Innovation of the proposed methods include the following: 1) Identification of multiple subtypes of CTCs using their location information on an HU microchip without destructive immunostaining analysis; 2) Novel Restore-GAN model to improve quality of microscope image obtained in CTC capture experiments and enhance predication accuracy for CTC subtypes; 3) The proposed informatics tools will provide computer-assisted automated tools to empower CTC research with artificial intelligence. Specific aims include: Aim 1: Using the microscope images and analysis/prediction results (from the IMAT project) as data input to test whether algorithms to classify different types of cell from tumor tissue images (iSEE-Cell, developed in the ICTR project) can be applied for microscope images; Aim 2: Apply novel computational methods (Restore- GAN, developed in the ICTR project) to improve image quality of the images obtained from the IMAT project, and test whether they can improve prediction accuracy for CTC subtypes; Aim 3: Develop a user-friendly interface to incorporate the iSEE-Cell platform for analyzing optical/fluorescent microscope images remotely. The ability to automatically extract/analyze information from captured cells in the microscope images is urgently needed and will dramatically enhance the throughput and work efficiency of the IMAT project.