Bayesian Meta-Learning for Earth Observation: Better Models with Less Data

用于地球观测的贝叶斯元学习：用更少的数据建立更好的模型

• 批准号: 2890092
• 金额: --
• 依托单位: University of Edinburgh
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2023
• 资助国家: 英国
• 起止时间: 2023 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2890092
• 关键词: Bayesian; Meta; Learning; Earth; Observation

Machine learning has brought significant improvements to pattern recognition systems in the past decade [5]. The three main factors that this success is attributed to are the use of deep neural networks, very large annotated training datasets, and abundant computing resources. However, for many earth observations problems only small training datasets are available. One promising family of machine learning techniques for dealing with limited training data is meta-learning-also known as learning to learn [4]. Given several pattern recognition problems from the same application domain (e.g., object detection in satellite images) these approaches are able to automatically construct new machine learning algorithms that are specialised for the application domain of interest. When deployed on novel tasks from the same domain, these meta-learned algorithms require less data and computing resources in order to train an effective model compared to conventional machine learning approaches.Meta-learning methods are most commonly applied to datasets containing images of people or everyday objects, with the goal of creating learning algorithms that are able to quickly train models on images that contain novel object categories. Such methods are unsuitable for the earth observation problem setting, because of the additional structure in earth observation data compared to conventional everyday photo collections. In addition, in many situations satellites will acquire multiple images of the same region, and there will be considerable overlap in content between these images. This overlapping content violates standard independence assumptions made by machine learning methods. Naively ignoring this structure will yield machine learning models with suboptimal performance, but bespoke meta-learning approaches that instead explicitly take advantage of these temporal and spatial structures in the data have the potential to provide even more powerful models.The objective of this project is to develop a meta-learning framework that is suitable for use with remote sensing applications, thus enabling scientists working with earth observation data to rapidly train accurate models without costly data annotation processes or machine learning expertise. The meta-learning approaches will take advantage of the multiple image modalities commonly captured by satellite imaging systems (e.g., RGB, infrared, multispectral/hyperspectral, range/LiDAR, etc), and leverage additional contextual information of the geographic areas in which datasets are gathered (e.g., latitude and longitude, historical weather patterns, population density, etc) and the relative position of different regions of interest within the same dataset. By combining deep learning with novel Bayesian prediction heads, the framework will be able to take advantage of all the benefits provided by well[1]calibrated uncertainty estimates. Examples of such benefits include easily detecting anomalies [2], being able to fuse information from other sources with the information extracted from satellite images, and active learning [1] to further make the most effective use of limited label annotation resources.

在过去十年中，机器学习为模式识别系统带来了重大改进。这一成功的三个主要因素是深度神经网络的使用，非常大的带注释的训练数据集和丰富的计算资源。然而，对于许多地球观测问题，只有小的训练数据集可用。处理有限训练数据的一个很有前途的机器学习技术家族是元学习——也被称为学习[4]。给定来自同一应用领域的几个模式识别问题（例如，卫星图像中的目标检测），这些方法能够自动构建专门针对感兴趣的应用领域的新机器学习算法。当部署在同一领域的新任务上时，与传统的机器学习方法相比，这些元学习算法需要更少的数据和计算资源来训练有效的模型。元学习方法最常应用于包含人物或日常物品图像的数据集，其目标是创建能够在包含新对象类别的图像上快速训练模型的学习算法。这种方法不适合地球观测问题的设置，因为与传统的日常照片集相比，地球观测数据中有额外的结构。此外，在许多情况下，卫星将获得同一区域的多幅图像，这些图像之间的内容将有相当大的重叠。这种重叠的内容违反了机器学习方法所做的标准独立性假设。天真地忽略这种结构会产生性能欠佳的机器学习模型，但定制的元学习方法可以明确地利用数据中的这些时间和空间结构，从而有可能提供更强大的模型。该项目的目标是开发一种适用于遥感应用的元学习框架，从而使使用地球观测数据的科学家能够快速训练准确的模型，而无需昂贵的数据注释过程或机器学习专业知识。元学习方法将利用卫星成像系统通常捕获的多种图像模式（例如，RGB，红外，多光谱/高光谱，距离/激光雷达等），并利用收集数据集的地理区域的额外上下文信息（例如，纬度和经度，历史天气模式，人口密度等）以及同一数据集中不同感兴趣区域的相对位置。通过将深度学习与新颖的贝叶斯预测头相结合，该框架将能够利用[1]井校准不确定性估计提供的所有优势。这些好处的例子包括轻松检测异常[2]，能够将来自其他来源的信息与从卫星图像中提取的信息融合在一起[1]，以及主动学习[1]，以进一步最有效地利用有限的标签标注资源。