Prediction of Immunotherapy Response with Geometric Deep Learning in Medical Imaging

癌症患者的治疗选择有限。免疫治疗是一种很有前途的策略，利用免疫系统的主要功能来清除体内的癌细胞，显示出治疗癌症的长期好处。然而，临床医生仍然没有可靠的成像生物标志物，可以在治疗前可靠地识别患者对免疫治疗的反应。图像生物标记物可以作为一种非侵入性的替代方法来表征肿瘤的空间异质性，但缺乏预测治疗结果的统计框架。图形或流形上的深度学习，称为几何深度学习，最近引起了人们对医学成像问题的兴趣，特别是在肿瘤学和免疫治疗方面。他们展示了处理非欧几里德领域的潜力，同时解决了几个挑战，如有限和不平衡的数据集。 全球目标是基于几何深度学习中的新概念，开发用于免疫治疗反应的图像驱动预测工具。所提出的方法将综合复杂的和多模式的来源(CT图像和临床数据)，用区分图描述，从纵向患者数据集中捕捉潜在的趋势。它还将允许解释深层特征，以捕捉药物对结果的影响，以及恢复免疫表型特有的时空潜伏表现。 为了实现这一全球目标，主要目标是：(1)建立一个用流形正则深度神经网络训练的判别图结构，用于预测有反应的患者；(2)通过无监督的区域适应对潜在空间的拓扑进行参数化，以量化治疗效果；(3)利用黎曼几何和递归网络的概念，创建基于时空深层特征的治疗反应预测模型；(4)在癌症患者数据集上应用并验证所提出的方法，将预测结果与实际结果进行比较。基于我们最近在几何深度学习方面的工作，该提议的贡献在于一个预测性平台，生成具有代表性的知识，以发现免疫系统反应和肿瘤进化的预测性生物标记物，旨在诊断和治疗。 这项研究提案将对计算医学成像产生重大影响，因为几何深度学习框架将允许发现癌症表征的特定领域关系。它将合成纵向获得的大量不同种类的医学图像，并提供癌症肿瘤演变的全面肖像。最后，它将提出新的功能，将复杂结构分解为联合子集，以及适应通过深度学习获得的不同流形拓扑。从临床角度来看，这些发展将有助于癌症的早期检测和治疗结果的预测指标的洞察和指征，以及医学上可靠的预测工具。

Cancer patients have limited treatment options. Immunotherapy is a promising strategy using the primary function of the immune system to rid the body cancer cells, showing long-term benefits for curing cancer. However, clinicians still do not have a reliable imaging biomarker that can reliably identify patients responding to immunotherapy prior to treatment. Image biomarkers can serve as a non-invasive alternative to characterize the spatial heterogeneity of tumors, but lack the statistical framework to predict therapy outcomes. Deep learning on graphs or manifolds, denoted as geometric deep learning, has recently gained interest for medical imaging problems, specifically in oncology and immunotherapy. They demonstrated the potential to process non-Euclidean domains, while addressing several challenges such as limited and unbalanced datasets. The global objective is to develop image-driven predictive tools for immunotherapy response, based on novel concepts in geometric deep learning. The proposed methods will synthesize complex and multi-modal sources (CT images and clinical data) described with discriminative graphs, capturing underlying trends from longitudinal patient datasets. It will also allow the interpretation of deep features to capture drug effects on outcomes, as well recover spatiotemporal latent representations specific to immune phenotypes. To achieve this global objective, the main objectives are: (1) Develop a discriminative graph structure trained with a manifold-regularized deep neural network to predict responsive patients; (2) Parameterize the topology of the latent space with unsupervised domain adaptation to quantify therapeutic effects on outcomes; (3) Exploit concepts in Riemannian geometry and recurrent networks to create a prediction model for treatment response from spatiotemporal deep features; (4) Apply and validate the proposed methods on cancer patient datasets, comparing predicted results with actual outcomes. Based on our recent work on geometric deep learning, the proposal's contributions lie in a predictive platform generating representative knowledge to discover predictive biomarkers of the immune system response and tumor evolution, aimed for diagnosis and therapy. This research proposal will have a significant impact in computational medical imaging, as the geometric deep learning framework will allow to uncover domain specific relationships for cancer characterization. It will synthesize large heterogeneous sets of medical images acquired longitudinally and provide a comprehensive portrait of cancerous tumor evolution. Finally, it will propose new functionalities to disentangle complex structures into joint subsets, as well as adapting to different manifold topologies obtained with deep learning. From a clinical perspective, these developments will contribute insights and indications for early detection of cancer and predictors of therapy outcomes, as well as reliable forecasting tools in medicine.