.png){kind=icon}
返回
Adaptive multi-source domain collaborative fine-tuning for transfer learning
.png){kind=icon}
OA
AI
DOI：10.7717/peerj-cs.2107.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Fine-tuning is an important technique in transfer learning that has achieved significant success in tasks that lack training data. However, as it is difficult to extract effective features for single -source domain fine-tuning when the data distribution difference between the source and the target domain is large, we propose a transfer learning framework based on multi -source domain called adaptive multi -source domain collaborative fine-tuning (AMCF) to address this issue. AMCF utilizes multiple source domain models for collaborative fine-tuning, thereby improving the feature extraction capability of model in the target task. Specifically, AMCF employs an adaptive multisource domain layer selection strategy to customize appropriate layer fine-tuning schemes for the target task among multiple source domain models, aiming to extract more efficient features. Furthermore, a novel multi -source domain collaborative loss function is designed to facilitate the precise extraction of target data features by each source domain model. Simultaneously, it works towards minimizing the output difference among various source domain models, thereby enhancing the adaptability of the source domain model to the target data. In order to validate the effectiveness of AMCF, it is applied to seven public visual classification datasets commonly used in transfer learning, and compared with the most widely used single -source domain fine-tuning methods. Experimental results demonstrate that, in comparison with the existing fine-tuning methods, our method not only enhances the accuracy of feature extraction in the model but also provides precise layer fine-tuning schemes for the target task, thereby significantly improving the fine-tuning performance.
Keyword:
Transfer learning
Fine-tuning
Multi-source domain collaborative fine-tuning
Fine-tuning layer selection
Feature extraction
Target task
Source domain models
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
2.5
论文数:
3.4K
被引数:
6.9K
机构
引用论文
分享收藏Transferring CNN With Adaptive Learning for Remote Sensing Scene Classification基于自适应学习的CNN在遥感场景分类中的应用
PREAI
分享收藏AutoTune: Automatically Tuning Convolutional Neural Networks for Improved Transfer Learning.png)
NEURAL NETWORKSOAAI
NEURAL NETWORKSIF6.3
OAAI分享收藏分享收藏
查看更多内容