Multitask learning
Multitask learning
复制标题
DOI：
10.1023/a:1007379606734
复制
发表时间：
1997-07-01
期刊：
影响因子：
7.5
通讯作者：
Caruana, R
中科院分区：
文献类型：
--
作者：
Caruana, R
多任务学习是一种归纳迁移方法，它通过使用相关任务训练信号中包含的领域信息作为归纳偏差来提高泛化能力。它通过在使用共享表示法的同时并行学习任务来做到这一点；为每个任务学习的内容可以帮助更好地学习其他任务。本文回顾了以往关于MTL的工作，提出了新的证据，证明了Backprop网中的MTL在不需要监督信号的情况下发现了任务的相关性，并给出了具有k近邻和核回归的MTL的新结果。在本文中，我们从三个方面论证了多任务学习。我们解释了多任务学习是如何工作的，并表明在真实领域中存在许多多任务学习的机会。提出了一种基于案例的k近邻和核回归等多任务学习算法和结果，并给出了决策树中多任务学习的算法框图。由于多任务学习是有效的，可以应用于许多不同的领域，并且可以与不同的学习算法一起使用，我们推测它在现实世界的问题上将有很多机会使用。
Multitask Learning is an approach to inductive transfer that improves generalization by using the domain information contained in the training signals of related tasks as an inductive bias. It does this by learning tasks in parallel while using a shared representation; what is learned For each task can help other tasks be learned better. This paper reviews prior work on MTL, presents new evidence that MTL in backprop nets discovers task relatedness without the need of supervisory signals, and presents new results for MTL with k-nearest neighbor and kernel regression. In this paper we demonstrate multitask learning in three domains. We explain how multitask learning works, and show that there are many opportunities for multitask learning in real domains. We present an algorithm and results for multitask learning with case-based methods like k-nearest neighbor and kernel regression, and sketch an algorithm for multitask learning in decision trees. Because multitask learning works, can be applied to many different kinds of domains, and can be used with different learning algorithms, we conjecture there will be many opportunities for its use on real-world problems.