Weak supervision with imperfect annotations for medical image computing

医学图像计算的弱监督和不完善的注释

• 批准号: RGPIN-2021-02914
• 负责人: Li, Xingyu
• 金额: $ 1.75万
• 依托单位: University of Alberta
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=752171
• 关键词: Weak; supervision; imperfect; annotations; medical

Medical image computing (MIC) aims to develop computational methods for solving problems pertinent to medical image interpretation and understanding. Recent advances in machine learning have made a big leap in MIC and we have started to witness their influence on our daily lives, ranging from 3D human embryo/organ visualization to intelligent examination of lung scans for COVID-19 checkup. Moreover, the healthcare industry is increasingly embracing the cloud services powered by machine learning techniques, such as Google Cloud healthcare and IBM Watson Health. In the future, the envisioned MIC solutions are expected to free clinicians from tedious daily operations on easy cases, to provide physicians a second opinion, and to facilitate biomedical researchers for numerical biomarker discovery. Meanwhile, there are still many hurdles to overcome. In most real-world MIC tasks, it is extremely difficult to attain high quality datasets that can be used in strong supervision methods due to the high cost of medical data labeling; in contrast, weak annotation, or imperfect annotation, is much easier to access. The imperfect annotation in various MIC tasks makes machine learning techniques working with weak supervision to be highly desired. With my long-term goal to leverage machine learning techniques and computer vision algorithms to improve medical imaging relevant healthcare, this research proposal aims to innovate different weak supervision algorithms to extract medical information that is not explicitly available in imperfect annotations. Three different topics will be the major directions in this proposal, including: (1) learning anomaly from sparse, extremely unbalanced annotated medical images, through innovating representation learning methods that fuse batch contrastive learning and generative learning; (2) learning from noisy labeled medical images, by incorporating Bayesian inference into deep learning towards a unified framework; (3) inference from imprecision annotated medical images, by developing a unified weak-supervision region-of-interest segmentation pipeline that combines class activation map methods and multiple instance learning. Potential impact of this proposal includes (1) inventing solutions for medical image computing with imperfect annotation, which will open a door for the massive existing medical images to become directly usable in MIC research and (2) proposing representation learning methods that will be helpful to discover numerical biomarkers of abnormal, rare cases. Though our target application domain is medical image computing, the solutions proposed in this research are also transferable to many image analysis and computer vision tasks. Besides, the HQP trained through this research program will get training on both scientific theories and application-oriented developments, that would be valuable in their future medical imaging and machine learning careers.

医学图像计算（MIC）旨在开发解决与医学图像解释和理解相关问题的计算方法。机器学习的最新进展使 MIC 取得了巨大飞跃，我们已经开始见证它们对我们日常生活的影响，从 3D 人类胚胎/器官可视化到用于 COVID-19 检查的肺部扫描智能检查。此外，医疗保健行业越来越多地采用由机器学习技术支持的云服务，例如 Google Cloud 医疗保健和 IBM Watson Health。未来，设想的 MIC 解决方案有望将临床医生从简单病例的繁琐日常操作中解放出来，为医生提供第二意见，并促进生物医学研究人员发现数字生物标志物。与此同时，仍有许多障碍需要克服。在大多数现实世界的 MIC 任务中，由于医疗数据标记的成本高昂，获得可用于强监督方法的高质量数据集是极其困难的；相反，弱注释或不完善的注释更容易访问。各种 MIC 任务中的不完善注释使得弱监督下的机器学习技术非常受欢迎。我的长期目标是利用机器学习技术和计算机视觉算法来改善医学成像相关的医疗保健，本研究提案旨在创新不同的弱监督算法，以提取在不完善的注释中未明确提供的医学信息。三个不同的主题将是该提案的主要方向，包括：（1）通过融合批量对比学习和生成学习的创新表示学习方法，从稀疏、极度不平衡的注释医学图像中学习异常； （2）通过将贝叶斯推理纳入深度学习以形成统一的框架，从噪声标记的医学图像中进行学习； （3）通过开发结合类激活图方法和多实例学习的统一弱监督感兴趣区域分割管道，从不精确注释的医学图像中进行推理。 该提案的潜在影响包括（1）发明不完善注释的医学图像计算解决方案，这将为大量现有医学图像直接用于 MIC 研究打开大门；（2）提出表示学习方法，这将有助于发现异常、罕见病例的数字生物标志物。虽然我们的目标应用领域是医学图像计算，但本研究中提出的解决方案也可应用于许多图像分析和计算机视觉任务。此外，通过该研究项目培训的总部人员将获得科学理论和面向应用的开发方面的培训，这对他们未来的医学成像和机器学习职业生涯非常有价值。