.png){kind=icon}
返回
Model adaptive parameter fine-tuning Based on contribution measure for image classification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2025.129634.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Fine-tuning is an important transfer learning technique that has achieved significant success in various image classification tasks lacking training data and requires only a small number of training epochs to achieve satisfactory results. However, with the increasing complexity of the model scale and structure, designing appropriate fine-tuning schemes for specific target tasks becomes increasingly difficult. In this paper, a contribution measure criterion is used to quantify the importance of the pre-trained model parameters to the target task, providing a basis for selecting fine-tuning parameters. In addition, we find that the fine-tuning ratio vary depends on the specific target task. Therefore, we propose an adaptive fine-tuning ratio search strategy to search the appropriate fine-tuning ratio for the given target task. Based on the above strategy, we propose an adaptive fine-tuning algorithm based on parameter contribution to customize the fine-tuning scheme for the target task. The experimental results show that the proposed algorithm can effectively quantify the contribution of model parameters, and our algorithm can adaptively adjust the fine-tuning ratio for the target task. Furthermore, our algorithm achieves state-of-the-art performance on seven publicly available image classification datasets widely used in transfer learning.
Keyword:
Parameter fine-tuning
Transfer learning
Image classification
Contribution measure
Fine-tuning ratio
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Improved proprioceptive function by application of subsensory electrical noise: Effects of aging and task-demand.png)
Neuroscience
OAAI
NeuroscienceIF0
OAAI分享收藏Patch dynamics ofGlaucopsyche lygdamus (Lycaenidae): correlations between butterfly density and host species diversityOecologia
OecologiaIF0
PREAI
分享收藏Neuro or Symbolic? Fine-Tuned Transformer With Unsupervised LDA Topic Clustering for Text Sentiment Analysis神经还是象征性的？用于文本情感分析的具有无监督LDA主题聚类的微调转换器
PREAI
分享收藏Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?用于医学图像分析的卷积神经网络: 完全训练还是微调？OAAI
OAAI分享收藏Attention-based aspect sentiment classification using enhanced learning through CNN-BiLSTM networks
PREAI
分享收藏分享收藏
查看更多内容