arrow
Return

Progressive Transfer Learning

delete2022-01-01
delete11
delete
OA
AI
Z
Zhengxu Yu
D
Dong Shen
Z
Zhongming Jin
J
Jianqiang Huang
D
Deng Cai *
X
Xian‐Sheng Hua
DOI:10.1109/TIP.2022.3141258delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Model fine-tuning is a widely used transfer learning approach in person Re-identification (ReID) applications, which fine-tuning a pre-trained feature extraction model into the target scenario instead of training a model from scratch. It is challenging due to the significant variations inside the target scenario, e.g., different camera viewpoint, illumination changes, and occlusion. These variations result in a gap between each mini-batch's distribution and the whole dataset's distribution when using mini-batch training. In this paper, we study model fine-tuning from the perspective of the aggregation and utilization of the dataset's global information when using mini-batch training. Specifically, we introduce a novel network structure called Batch-related Convolutional Cell (BConv-Cell), which progressively collects the dataset's global information into a latent state and uses it to rectify the extracted feature. Based on BConv-Cells, we further proposed the Progressive Transfer Learning (PTL) method to facilitate the model fine-tuning process by jointly optimizing BConv-Cells and the pre-trained ReID model. Empirical experiments show that our proposal can greatly improve the ReID model's performance on MSMT17, Market-1501, CUHK03, and DukeMTMC-reID datasets. Moreover, we extend our proposal to the general image classification task. The experiments in several image classification benchmark datasets demonstrate that our proposal can significantly improve baseline models' performance. The code has been released at https://github.com/ZJULearning/PTL
Keywords:
Task analysis
Transfer learning
Feature extraction
Computer architecture
Training
Proposals
Data models
Person re-identification
transfer learning
image classification

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

A
alibaba group
Scholars:
1.1K
Papers: 789
Citations: 0
Z
zhejiang university
Scholars:
17.4W
Papers: 12.0W
Citations: 152