Differentiable Programming for Computer Vision and Medical Image Analysis

计算机视觉和医学图像分析的可微分编程

• 批准号: RGPIN-2020-04139
• 负责人: Ray, Nilanjan
• 金额: $ 2.11万
• 依托单位: University of Alberta
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=716137
• 关键词: Differentiable; Programming; Computer; Vision; Medical

Deep learning has emerged as a strong method with empirical evidence to deliver accurate learning models for various computer vision applications. The success behind deep learning seems to be supervised learning that requires lots and lots of tagged image and video data. The requirement to have lots of training data with expert-created labels or tags pose a particularly challenging situation for medical image analysis applications, where scarcity of training data is common. Over the years, some methods, such as transfer learning have emerged to mitigate this issue. However, none of these techniques can adequately address lack of training data. The proposed research program will explore an alternative to the exiting techniques and will make use of prior and domain knowledge along with the power of deep learning to address the scarcity of labeled training data. As a technical solution, the program will rely on differentiable programming to mix traditional computer vision algorithms with deep learning methods, where the prior knowledge can be included in the traditional methods. Differentiable programming refers to gradient descent based optimization that relies on the differentiability of all the functions used in a data processing pipeline. However, most traditional computer vision methods include functions or processes that are not differentiable. Thus, the research further proposes to overcome this difficulty by using bypass neural networks to approximate non-differentiable functional modules. Using several use cases, the proposed research also demonstrates that the scope extends further beyond the lack of training data. For example, an end-to-end detection-tracking system for multi-object tracking can be cast into the proposed optimization framework. The research program will have ample opportunity to provide broad training to students in computer vision, medical image analysis, theoretical and statistical analysis of learning algorithms that fit well into Canada's commitment to artificial intelligence research. The proposed research can create a new and significant family of learning algorithms in computer vision and image analysis research.

深度学习已经成为一种强大的方法，具有经验证据，可以为各种计算机视觉应用提供准确的学习模型。深度学习背后的成功似乎是监督学习，它需要大量的标记图像和视频数据。对于医学图像分析应用来说，需要大量带有专家创建的标签或标记的训练数据是一个特别具有挑战性的情况，因为训练数据的稀缺是常见的。多年来，一些方法，如迁移学习已经出现，以减轻这个问题。然而，这些技术都不能充分解决缺乏训练数据的问题。拟议的研究计划将探索现有技术的替代方案，并将利用先验知识和领域知识沿着深度学习的力量来解决标记训练数据的稀缺性。作为一种技术解决方案，该计划将依靠可微编程将传统的计算机视觉算法与深度学习方法相结合，其中先验知识可以包含在传统方法中。可微编程是指基于梯度下降的优化，其依赖于数据处理流水线中使用的所有函数的可微性。然而，大多数传统的计算机视觉方法包括不可微分的功能或过程。因此，本研究进一步提出使用旁路神经网络来近似不可微的功能模块，以克服这个困难。使用几个用例，拟议的研究还表明，范围进一步扩展到缺乏训练数据。例如，用于多目标跟踪的端到端检测跟踪系统可以被投射到所提出的优化框架中。该研究计划将有充分的机会为学生提供计算机视觉，医学图像分析，学习算法的理论和统计分析方面的广泛培训，这些都非常适合加拿大对人工智能研究的承诺。所提出的研究可以在计算机视觉和图像分析研究中创建一个新的和重要的学习算法家族。