Optimization- and learning-based algorithms for medical image computing

基于优化和学习的医学图像计算算法

• 批准号: RGPIN-2014-05076
• 负责人: BenAyed, Ismail
• 金额: $ 2.54万
• 依托单位: École de technologie supérieure
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=645102
• 关键词: Optimization; learning; based; algorithms; medical

1) Problems, difficulties and prior art: **Finding automatically and efficiently meaningful regions in a numerical image, for instance an organ in a 3D medical scan or a person in a photograph, is a research problem of paramount importance within the computer vision and medical imaging communities for its theoretical and methodological challenges, and numerous useful applications.*Current major application areas include medical image analysis, robotics, human-computer interaction, image retrieval and editing, security and surveillance, navigation, manufacturing, remote sensing and many others. For instance, in medical imaging, automatic detection and visualization of the 3D surfaces of anatomic structures is essential to efficient disease diagnosis/treatment/follow-up, surgery planning, radiologic reporting and health care practices at large. From a technical point of view, such detection problems are difficult and often application-dependent because of the various and complex appearances of medical scans. Mostly based on classical compute-vision techniques, the methods in the literature can handle only a small fraction of real-world problems because of the following reasons: (i) they do not take full advantage of the available prior knowledge, i.e., the contextual information that a machine can learn from a set of training structures/surfaces produced by a human expert. The mathematical descriptions used so far to model such knowledge are not complex enough to reflect human understanding of medical scans; and (ii) they may be very slow in many real-world scenarios.**2) Objectives: **The overall objective of this research program is to develop fully trained, efficient (real-time) and theoretically sound algorithms for the automatic detection and visualization of the 3D surfaces of various organs from medical scans. Specific objectives include:**(i) Theoretical objectives: We intend to define novel energy functionals based on information-theoretic measures and recent advances in machine learning. We further intend to design original and efficient optimization techniques for such functionals. The overall purpose is to determine solutions which embody important prior knowledge that has been either omitted or oversimplified in current algorithms; and**(ii) Practical objectives: In practice, we plan to devise our technical investigations to solving various challenging and important problems, e.g., finding the 3D structures of the aorta, spine, heart, liver, prostate, brain tumors, as well as multiple abdominal organs, just to name a few examples.**3) Scientific approach:**(i) Methodology: Our methodology is based on the following main steps: (a) building sophisticated functionals that describe contextual knowledge about the structures of interest (e.g., shape, geometric relations between several organs and high-level medical knowledge) using training data built by human experts; (b) investigating mathematically and solving numerically the minimization of the new functionals; and (d) evaluating experimentally the algorithms by comparisons to ground-truth data built by human experts.**(ii) Technical and theoretical novelty/significance: We anticipate that our formulations lead to challenging optimization problems, which cannot be solved directly with standard techniques. We intend to derive original approximations or bounds, thereby designing novel and efficient optimization techniques that are still not in use in computer vision and medical imaging. We intend to focus on optimization-transfer and convex relaxation approaches. We anticipate the solutions we intend to develop will (a) be applicable to a breadth of problems; and (ii) yield state-of-the-art performances in regard to accuracy and speed.

1)问题、困难和现有技术：** 在数字图像中自动有效地找到有意义的区域，例如3D医学扫描中的器官或照片中的人，是计算机视觉和医学成像领域中最重要的研究问题，因为它的理论和方法挑战以及许多有用的应用。目前的主要应用领域包括医学图像分析、机器人技术、人机交互、图像检索和编辑、安全和监控、导航、制造、遥感等。例如，在医学成像中，解剖结构的3D表面的自动检测和可视化对于有效的疾病诊断/治疗/随访、手术规划、放射学报告和整个医疗保健实践至关重要。从技术的角度来看，这样的检测问题是困难的，并且通常依赖于应用，因为医学扫描的各种和复杂的外观。大多数基于经典的计算机视觉技术，文献中的方法只能处理一小部分现实世界的问题，原因如下：（i）它们没有充分利用可用的先验知识，即，机器可以从由人类专家产生的一组训练结构/表面学习的上下文信息。到目前为止，用于对这些知识进行建模的数学描述还不够复杂，无法反映人类对医学扫描的理解;（ii）在许多现实世界的场景中，它们可能非常缓慢。2)目的：** 该研究计划的总体目标是开发经过充分训练的，有效的（实时）和理论上合理的算法，用于自动检测和可视化医学扫描中各种器官的3D表面。具体目标包括：**（i）理论目标：我们打算基于信息理论测量和机器学习的最新进展定义新的能量泛函。我们还打算设计原始的和有效的优化技术，这样的泛函。总体目的是确定体现在当前算法中被省略或过度简化的重要先验知识的解决方案;以及 **（ii）实际目标：在实践中，我们计划设计我们的技术调查来解决各种具有挑战性和重要的问题，例如，查找主动脉、脊柱、心脏、肝脏、前列腺、脑肿瘤以及多个腹部器官的3D结构，仅举几例。** 3)科学方法：**（i）方法：我们的方法基于以下主要步骤：（a）构建描述有关感兴趣结构的背景知识的复杂泛函（例如，形状，几个器官之间的几何关系和高级医学知识）使用人类专家建立的训练数据;（B）数学研究和数值求解新泛函的最小化;以及（d）通过与人类专家建立的地面实况数据进行比较，对算法进行实验评估。(ii)技术和理论新奇/重要性：我们预计我们的配方会导致具有挑战性的优化问题，这些问题无法直接用标准技术解决。我们打算推导出原始的近似值或边界，从而设计出在计算机视觉和医学成像中尚未使用的新颖而有效的优化技术。我们打算专注于优化转移和凸松弛方法。我们预计我们打算开发的解决方案将（a）适用于广泛的问题;（ii）在准确性和速度方面产生最先进的性能。