Reminder of the First Paper on Transfer Learning in Neural Networks, 1976
Reminder of the First Paper on Transfer Learning in Neural Networks, 1976
复制标题
DOI：
10.31449/inf.v44i3.2828
复制
发表时间：
2020-09-01
期刊：
影响因子：
--
通讯作者：
Bozinovski, Stevo
中科院分区：
文献类型：
--
作者：
Bozinovski, Stevo
本文描述了20世纪70年代和80年代初开展的神经网络迁移学习工作，该工作于1976年首次发表。在当代迁移学习的研究中，有一种观点认为迁移学习的开创性工作发生在20世纪90年代初，本文更新了这一认识，指出迁移学习的研究早在10多年前就开始了。本文回顾了20世纪70年代的前沿研究，并讨论了与当前迁移学习研究相关的重要问题。它给出了迁移学习的数学模型和几何解释，以及迁移学习的衡量标准，表明积极，消极和无迁移学习。它提出了上述类型的迁移学习的实验研究。并给出了迁移学习在图像模式识别中的应用。
This paper describes a work on transfer learning in neural networks carried out in 1970s and early 1980s, which produced its first publication in 1976. In the contemporary research on transfer learning there is a belief that pioneering work on transfer learning took place in early 1990s, and this paper updates that knowledge, pointing out that the transfer learning research started more than a decade earlier. This paper reviews the pioneering 1970s research, and addresses important issues relevant for the current transfer learning research. It gives a mathematical model and geometric interpretation of transfer learning, and a measure of transfer learning indicating positive, negative, and no transfer learning. It presents experimental investigation in the mentioned types of transfer learning. And it gives an application of transfer learning in pattern recognition using datasets of images.