Parameter-Free Loss for Class-Imbalanced Deep Learning in Image Classification
Parameter-Free Loss for Class-Imbalanced Deep Learning in Image Classification
复制标题
图像分类中类不平衡深度学习的无参数损失
DOI：
10.1109/tnnls.2021.3110885
复制
发表时间：
2021
影响因子：
10.4
通讯作者：
Wang Tianfu
中科院分区：
文献类型：
--
作者：
Du Jie;Zhou Yanhong;Liu Peng;Vong Chi-Man;Wang Tianfu
Current state-of-the-art class-imbalanced loss functions for deep models require exhaustive tuning on hyperparameters for high model performance, resulting in low training efficiency and impracticality for nonexpert users. To tackle this issue, a parameter-free loss (PF-loss) function is proposed, which works for both binary and multiclass-imbalanced deep learning for image classification tasks. PF-loss provides three advantages: 1) training time is significantly reduced due to NO tuning on hyperparameter(s); 2) it dynamically pays more attention on minority classes (rather than outliers compared to the existing loss functions) with NO hyperparameters in the loss function; and 3) higher accuracy can be achieved since it adapts to the changes of data distribution in each mini-batch instead of the fixed hyperparameters in the existing methods during training, especially when the data are highly skewed. Experimental results on some classical image datasets with different imbalance ratios (IR, up to 200) show that PF-loss reduces the training time down to 1/148 of that spent by compared state-of-the-art losses and simultaneously achieves comparable or even higher accuracy in terms of both G-mean and area under receiver operating characteristic (ROC) curve (AUC) metrics, especially when the data are highly skewed.
