Human Activity Recognition-Oriented Incremental Learning with Knowledge Distillation
Human Activity Recognition-Oriented Incremental Learning with Knowledge Distillation
复制标题
DOI：
10.1142/s0218126621500961
复制
发表时间：
2020-10
期刊：
影响因子：
--
通讯作者：
Caijuan Chen;K. Ota;M. Dong;Chen Yu;Hai Jin
中科院分区：
文献类型：
--
作者：
Caijuan Chen;K. Ota;M. Dong;Chen Yu;Hai Jin
最近，各种不同的机器学习方法提高了活动识别系统在不同场景中的适用性。对于许多当前的活动识别模型，假设所有数据都提前准备好，并且设备没有存储空间限制。然而，传感器数据收集的过程随时间动态变化，活动类别可能不断增加，并且设备具有有限的存储空间。因此，在这项研究中，我们提出了一种新的类增量学习的综合解决方案，对活动识别与知识蒸馏。此外，我们发展了代表性样本选择方法，选择和更新特定数量的保存旧样本。当新的活动类样本到达时，我们只需要新类样本和代表性的旧样本，以在识别新类的同时保留旧类的网络性能。最后，我们使用两个不同的公共数据集进行了实验，它们对新旧类别都表现出了良好的准确性。此外，该方法可以显着减少存储旧类样本所需的空间。
Recently, a variety of different machine learning methods improve the applicability of activity recognition systems in different scenarios. For many current activity recognition models, it is assumed that all data are prepared well in advance and the device has no storage space limitation. However, the process of the sensor data collection is dynamically changing over time, the activity category may be continuously increasing, and the device has limited storage space. Therefore, in this study, we propose a novel class incremental learning comprehensive solution towards activity recognition with knowledge distillation. Besides, we develop the representative sample selection method to select and update a specific number of preserved old samples. When new activity classes samples arrive, we only need the new classes samples and the representative old samples to preserve the network’s performance for old classes while identifying the new classes. Finally, we carry out experiments using two different public datasets, and they show good accuracy for old and new categories. Besides, the method can significantly reduce the space required to store old classes samples.