权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Collaborative Research: Computational Harmonic Analysis Approach to Active Learning

协作研究：主动学习的计算调和分析方法

基本信息

批准号：
2012355
负责人：
Hrushikesh Mhaskar
金额：
$ 27.04万
依托单位：
Claremont Graduate University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2020
资助国家：
美国
起止时间：
2020-07-01 至 2024-06-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2012355&HistoricalAwards=false
关键词：
Collaborative Research Computational Harmonic Analysis

项目摘要

Research in supervised learning is concerned with uncovering relationships between training data and some function or label that is attached to each datum, with the goal of generalizing to new samples. Modern machine learning tools, such as deep networks, typically require a huge set of training data in order to classify the rest of the data with sufficient confidence. Obviously, assigning an accurate label to a datum can be an expensive task, involving a great deal of human effort. This project seeks to develop methods to classify large amounts of data with a theoretically minimal number of training labels. The key to classifying with a small number of labels comes with the ability to choose at which data points a label will be queried. This collaborative research project will study these methods, known as active machine learning, from a geometric and harmonic analysis perspective, focusing on both algorithmic insights and theoretical guarantees. The ability to perform classification with a small number of labeled points has important implications in a variety of applications, including remote sensing classification, medical data analysis, and general applications where it is expensive to collect labels.This project applies knowledge in computational harmonic analysis, function approximation, and machine learning to the study of active learning models, focusing on algorithmic insights, efficient implementations, and performance guarantees for both novel algorithms and currently existing machine learning algorithms. Mathematical tools, including localized kernel construction, approximation analysis in terms of intrinsic dimensionality, and harmonic analysis of eigenfunctions of operators on graphs and manifolds, have natural applications in the study of these areas. Specifically, the project addresses four fundamental questions that arise in the field: (1) How do you conservatively propagate the sampled labels to new points when the labels form a hierarchical clustering with possibly zero minimal separation between clusters? (2) Does the mechanism of kernel active learning generalize to graphs, where naive choice of points to sample becomes a combinatorial optimization problem? (3) Can we incorporate the structure of a neural network (or general parametric) classifier into the choice of labels queried and provably bound the generalization error for predictions on the rest of the data? (4) How can we tailor our framework to transfer learning and high-dimensional imaging?This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

监督学习的研究关注的是发现训练数据和附加到每个数据上的一些函数或标签之间的关系，目标是推广到新的样本。现代机器学习工具，如深度网络，通常需要大量的训练数据集，以便以足够的置信度对其余数据进行分类。显然，为数据分配准确的标签可能是一项昂贵的任务，涉及大量的人力。该项目旨在开发一种方法，用理论上最少数量的训练标签对大量数据进行分类。使用少量标签进行分类的关键在于能够选择在哪个数据点查询标签。该合作研究项目将从几何和谐波分析的角度研究这些被称为主动机器学习的方法，重点关注算法见解和理论保证。使用少量标记点执行分类的能力在各种应用程序中具有重要意义，包括遥感分类、医疗数据分析和收集标签成本较高的一般应用程序。本项目将计算谐波分析、函数近似和机器学习方面的知识应用于主动学习模型的研究，重点关注新算法和现有机器学习算法的算法见解、有效实现和性能保证。数学工具，包括局域核构造、内在维数的近似分析、图和流形上算子的特征函数的调和分析，在这些领域的研究中有自然的应用。具体来说，该项目解决了该领域出现的四个基本问题：(1)当标签形成一个可能为零最小分离的分层聚类时，如何将采样标签保守地传播到新的点？(2)核主动学习的机制是否可以推广到图中，在图中简单地选择点到样本成为一个组合优化问题？(3)我们能否将神经网络（或一般参数）分类器的结构纳入查询标签的选择中，并可证明地约束对其余数据的预测的泛化误差？(4)如何调整我们的框架以适应迁移学习和高维成像？该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。