.png){kind=icon}
返回
.png){kind=icon}
.png){kind=icon}
摘要
En 中文
Dynamic sample weighting is an effective approach for improving the inference accuracy and efficiency of different classifiers in multi-exit networks. By bringing the early-exit behavior from testing to training, such a method allows input samples to contribute differently at each sub-network, reducing the gap between training and inference. Recent methods mainly rely on learning a weighting mechanism through reinforcement learning and meta-learning based frameworks jointly with the multi-exit models. However, additional data are usually needed and essential for these approaches, which results in more computation consumption and limits their general applicability. To address these two problems, we propose a Self-supervised Efficient Sample Weighting (SESW) method to predict weights for input samples based on their losses at each exit. We pose the problem as a self-supervised multi-class classification problem. The SESW module is trained to predict if the log-likelihood for the loss of each sample in the current training stage belongs to the most confident classifier. The results of our experiments demonstrate that the proposed method performs comparably to state-of-the-art methods in terms of prediction accuracy and dynamic inference efficiency while achieving a significant improvement in training time.(c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Sample weighting
Early-exit networks
Self-supervised
Efficient training
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
Dynamically Weighted Balanced Loss: Class Imbalanced Learning and Confidence Calibration of Deep Neural Networks动态加权平衡损失: 深度神经网络的类不平衡学习和置信度校准.png)
PREAI
.png){kind=icon}
分享.png){kind=icon}
收藏Investigation of Ti mesh-supported anodes for direct borohydride fuel cells直接硼氢化物燃料电池用钛网支撑阳极的研究
PREAI
分享收藏Structural study of lanthanides(III) in aqueous nitrate and chloride solutions by EXAFS通过EXAFS对硝酸盐和氯化物水溶液中镧系元素 (III) 的结构研究
PREAI
分享收藏
查看更多内容