BIGDATA: F: Compositional Learning, Maps and Transfer: Statistical and Machine Learning on Collections of Data Sets

人类智能的里程碑之一是，不仅有能力找到解决难题的办法，而且有能力从过去的经验中学习，积累可能(部分)转移的知识，以快速解决新问题。这个项目将开发新的基础技术，用于从数据集和机器学习问题中学习组成规则。研究人员将开发的构建块能够跨多个数据集和模式共享学习。第一个构建块将使机器学习算法能够存储过去问题的解决方案，并使用映射和抽象将知识转移到新问题。这就需要有效的技术来学习地图，学习如何合成地图以实现知识转移，所有这些都要与问题及其解决方案的表示方式相兼容，而这些问题及其解决方案也需要自动学习。这些想法将在一系列问题上进行测试，从图像的对象和模式识别到交互代理系统的行为，从融合不同传感器获取的数据集到控制虚拟和真实代理。这个项目将在机器学习方面提供一般性的、基础性的结果，这些结果可以应用于几乎任何人类努力领域的应用。调查员将开发侧重于表征和迁移学习的新技术，特别是：(1)成分学习：通过数据集之间的合成映射以及数据集上的函数(用于分类和回归任务)进行学习和分解的能力(例如，任务f可以通过使用映射h到已经发生学习的一个数据集和该数据上已经学习的函数g来学习)，以便提高学习率、跨数据集和数据类型的知识提取和传递；(2)地图学习：有效地学习、表示、存储、回忆和应用复杂数据集之间的地图的能力，可能具有不同的形态；但也学习将一项任务转化为另一项任务，并将知识从一项任务转移到另一项任务的地图；(3)表示学习：学习如何有效地表示、存储和检索复杂数据集的能力，跨越多个传感器模式和不同抽象水平--例如，学习来自多种类型传感器的数据的有效表示、分类器和回归函数的学习、或学习基于代理的系统中的交互核心，以及跨传感器模式、数据集、动态系统传递这些功能。在推进这些学习能力的当前最新技术的同时，这项研究将解决在图像中学习不变性和执行对象识别任务、检测图像中的对象是新的还是已知的对象、通过观察交互代理系统的轨迹来学习交互规则、在虚拟学习系统(例如使用OpenAI挑战)和真实学习系统(例如使用机器人)的环境中实施组合学习的思想。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

One of the landmarks of human intelligence is the ability to not only find solutions to hard problems, but to learn from past experiences and accumulate knowledge that may be (partially) transferred for quickly solving new problems. This project will develop novel foundational techniques for learning compositional rules, from collections of data sets and machine learning problems. The building blocks that the investigator will develop enable sharing of learning across multiple data sets and modalities. A first building block will enable machine learning algorithms to store solutions to past problems and use maps and abstractions to transfer knowledge to new problems. This requires efficient techniques for learning maps, how to compose them to enable knowledge transfer, all in a way that is compatible with the representation of the problems and their solutions, which also need to be automatically learned. These ideas will be tested on problems ranging from object and pattern recognition of images to behavior of interacting agent systems, from fusing data sets acquired with different sensors to controlling virtual and real agents. This project will provide general, foundational results in machine learning, which can be applied to applications in virtually any domain of human endeavor. The investigator will develop new techniques focused on representation and transfer learning, in particular: (i) Compositional Learning: the ability to learn and factorize through composition maps between data sets, and of functions (for classification and regression tasks) on data sets (e.g. the task f may be learned by using the map h to one data set on which learning already occurred and the already-learned function g on that data), in order to enhance both learning rates, knowledge extraction and transfer across data sets and data types; (ii) Map Learning: the ability to efficiently learn, represent, store, recall and apply maps between complex data sets, possibly of different modalities; but also learn maps that transform, at least approximately, one task into another, and transfer knowledge from one task to another; (iii) Representation Learning: the ability to learn how to efficiently represent, store and recall complex data sets, across multiple sensor modalities, and across different levels of abstractions -- for example, learning efficient representations of data from multiple types of sensors, learning of classifiers and regression functions, or learning interaction kernels in agent-based systems, as well as transfer those functions across sensor modalities, data sets, dynamical systems. While advancing current state of art techniques in each of these learning abilities, the research will tackle applications in learning invariances and performing object recognition tasks in images, detecting whether objects in an image are new or known, learn interaction rules from observing trajectories of interacting agent systems, and implement the ideas of compositional learning in the context of learning systems both virtual (for examples, using the OpenAI challenges) and real (for example, using robots), on sequences of tasks of increasing difficulty.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.