.png){kind=icon}
返回
Parameter-Free Loss for Class-Imbalanced Deep Learning in Image Classification
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2021.3110885.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Current state-of-the-art class-imbalanced loss functions for deep models require exhaustive tuning on hyperparameters for high model performance, resulting in low training efficiency and impracticality for nonexpert users. To tackle this issue, a parameter-free loss (PF-loss) function is proposed, which works for both binary and multiclass-imbalanced deep learning for image classification tasks. PF-loss provides three advantages: 1) training time is significantly reduced due to NO tuning on hyperparameter(s); 2) it dynamically pays more attention on minority classes (rather than outliers compared to the existing loss functions) with NO hyperparameters in the loss function; and 3) higher accuracy can be achieved since it adapts to the changes of data distribution in each mini-batch instead of the fixed hyperparameters in the existing methods during training, especially when the data are highly skewed. Experimental results on some classical image datasets with different imbalance ratios (IR, up to 200) show that PF-loss reduces the training time down to 1/148 of that spent by compared state-of-the-art losses and simultaneously achieves comparable or even higher accuracy in terms of both G-mean and area under receiver operating characteristic (ROC) curve (AUC) metrics, especially when the data are highly skewed.
Keyword:
Training
Tuning
Deep learning
Data models
Task analysis
Learning systems
Focusing
Class-imbalanced deep learning
dynamic changes
hyperparameters tuning
loss function
parameter-free
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
.png){kind=icon}
Generation of hydroxyl radicals by urban suspended particulate air matter. The role of iron ions城市悬浮颗粒物产生羟基自由基。铁离子的作用:
PREAI
分享收藏Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification用于不平衡数据分类的双球支持向量机最大间隔
PREAI
分享收藏分享收藏
查看更多内容