Learning an Optimized Variational Network for Medical Image Reconstruction

学习用于医学图像重建的优化变分网络

• 批准号: 10231217
• 负责人: Patricia Margaret Johnson
• 金额: $ 43.67万
• 依托单位: NEW YORK UNIVERSITY SCHOOL OF MEDICINE
• 依托单位国家: 美国
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-30 至 2023-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10231217
• 关键词: Acceleration; Affect; Algorithms; Anatomy; Appearance; Area; Blinded; Characteristics; Clinical; Clinical Protocols; Communities; Computer Vision Systems; Consumption; Data; Data Set; Databases; Development; Diagnostic; Disease; Environment; Evaluation Studies; Goals; Health Care Costs; Human; Image; Individual; Interruption; Joints; Knee; Learning; Light; Machine Learning; Magnetic Resonance Imaging; Manuals; Medical Imaging; Methods; Modeling; Morphologic artifacts; Motion; Motivation; Musculoskeletal; Neurologic; Noise; Outcome; Pathologic; Pathology; Patients; Pattern; Plant Roots; Procedures; Process; Protocols documentation; Public Health; Reader; Reading; Research; Sampling; Scanning; Signal Transduction; Step training; Structure; Testing; Time; Touch sensation; Training; Validation; Variant; base; clinical Diagnosis; clinical imaging; clinical translation; conditioning; cost; data acquisition; data repository; data space; deep learning; experience; image reconstruction; imaging modality; improved; indexing; insight; learning strategy; novel; pathology imaging; patient population; performance tests; prospective; radiologist; reconstruction; research clinical testing

Project Summary We propose a novel way of reconstructing medical images rooted in deep learning and computer vision that models the process how human radiologists are using years of experience from reading thousands of cases to recognize anatomical structures, pathologies and image artifacts. Our approach is based on the novel idea of a variational network, which embeds a generalized compressed sensing concept within a deep learning framework. We propose to learn a complete reconstruction procedure, including filter kernels and penalty functions to separate between true image content and artifacts, all parameters that normally have to be tuned manually as well as the associated numerical algorithm described by this variational network. The training step is decoupled from the time critical image reconstruction step, which can then be performed in near-real-time without interruption of clinical workflow. Our preliminary patient data from accelerated magnetic resonance imaging (MRI) acquisitions suggest that our learning approach outperforms the state-of-the-art of currently existing image reconstruction methods and is robust with respect to the variations that arise in a daily clinical imaging situation. In our first aim, we will test the hypothesis that learning can be performed such that it is robust against changes in data acquisition. In the second aim, we will answer the question if it is possible to learn a single reconstruction procedure for multiple MR imaging applications. Finally, we will perform a clinical reader study for 300 patients undergoing imaging for internal derangement of the knee. We will compare our proposed approach to a clinical standard reconstruction. Our hypothesis is that our approach will lead to the same clinical diagnosis and patient management decisions when using a 5min exam. The immediate benefit of the project is to bring accelerated imaging to an application with wide public-health impact, thereby improving clinical outcomes and reducing health-care costs. Additionally, the insights gained from the developments in this project will answer the currently most important open questions in the emerging field of machine learning for medical image reconstruction. Finally, given the recent increase of activities in this field, there is a significant demand for a publicly available data repository for raw k-space data that can be used for training and validation. Since all data that will be acquired in this project will be made available to the research community, this project will be a first step to meet this demand.

项目摘要 我们提出了一种基于深度学习和计算机视觉的重建医学图像的新方法 模拟了人类放射科医生如何利用多年的经验从阅读数千个病例到 识别解剖结构、病理和图像伪影。我们的方法是基于一种新的想法 变分网络，它在深度学习中嵌入了广义压缩感知概念 框架。我们建议学习一个完整的重建过程，包括滤波核和惩罚 用于区分真实图像内容和伪像的函数，通常需要调整所有参数 以及由该变分网络描述的相关联的数值算法。培训步骤 与时间关键的图像重建步骤分离，然后可以近乎实时地执行 而不会中断临床工作流程。我们从加速磁共振获得的初步患者数据 成像(MRI)的获取表明，我们的学习方法优于目前最先进的 现有的图像重建方法，并且对于日常临床中出现的变化是健壮的 成像情况。在我们的第一个目标中，我们将测试学习可以被执行的假设 对数据采集的变化具有很强的抵抗力。在第二个目标中，如果有可能的话，我们将回答这个问题 学习适用于多个磁共振成像应用的单一重建程序。最后，我们将进行一次临床 300名接受膝关节内错位影像检查的患者的阅读研究。我们将比较我们的 提出了临床标准重建的方法。我们的假设是，我们的方法将导致 使用5分钟检查时，相同的临床诊断和患者管理决策。带来的直接好处是 该项目旨在将加速成像应用于对公共健康具有广泛影响的应用程序，从而改善 临床结果和降低医疗保健成本。此外，从发展中获得的洞察力 该项目将回答当前机器学习新兴领域中最重要的开放问题 用于医学图像重建。最后，鉴于最近这一领域的活动有所增加，有一个 对可用于培训的原始k空间数据的公共可用数据储存库的巨大需求 和验证。因为在这个项目中将获得的所有数据都将提供给研究人员 社区，这个项目将是满足这一需求的第一步。

项目成果

FastMRI Prostate: A Publicly Available, Biparametric MRI Dataset to Advance Machine Learning for Prostate Cancer Imaging

• DOI: 10.48550/arxiv.2304.09254
• 发表时间: 2023-04
• 期刊: ArXiv
• 作者: R. Tibrewala;T. Dutt;A. Tong;L. Ginocchio;M. Keerthivasan;S. Baete;S. Chopra;Y. Lui;D. Sodickson;H. Chandarana;Patricia M. Johnson