arrow
Return

Multi-proxy feature learning for robust fine-grained visual recognition

delete2023-11-01
delete2
PRE
AI
S
Shunan Mao
王
王耀威 (Yaowei Wang)
王
王晓玉 (Xiaoyu Wang)
张史梁 cover
张史梁 (Shiliang Zhang) *
DOI:10.1016/j.patcog.2023.109779delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Visual representation for fine-grained visual recognition can be learned by mandatorily enforcing all samples of the same category into a uniform representation. This strict training objective performs well under closed-set setting but is not applicable to data in the wild containing noisy annotations and long-tailed distributions, e. g., it may lead to a feature space biased to head categories. This paper tackles this challenge by pursuing a more balanced and discriminative feature space by first retaining intra-class variances to isolate noises, then eliminating intra-class variances to improve the visual recognition performance. We propose the Compact Memory Updater to maintain a memory bank, which memorizes proxy features to represent multiple typical appearances of each category in the training set. The Proxy-based Feature Enhancement hence leverages proxy features to ensure samples of the same category have similar features. Iteratively running those two modules boosts the robustness and discriminative power of the learnt representation, hence facilitates various fine-grained visual recognition tasks including person re-identification (re-id), image classification and retrieval. Extensive experiments on noisy and long-tailed training sets show this Multi-Proxy Feature Learning (MPFL) framework achieves promising performance. For instance on a training set with 90% one-shot categories, MPFL outperforms the recent long-tailed person re-id method LEAP-AF by 16.9% in rank-1 accuracy.
Keywords:
Fine-grained visual recognition
Noisy label
Long tail
Proxy learning

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

P
Peng Cheng Laboratory
Scholars:
1.7K
Papers: 1.8K
Citations: 2.0K
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
Collaborative Refining for Person Re-Identification With Label Noise
err2022-01-01
err67
PREAI
errYe, Mang; Li, He; Du, Bo; Shen, Jianbing; Shao, Ling; Hoi, Steven C. H.
errShare
errSave
CamStyle: A Novel Data Augmentation Method for Person Re-Identification
err2019-03-01
err260
PREAI
errZhong, Zhun; Zheng, Liang; Zheng, Zhedong; Li, Shaozi; Yang, Yi
errShare
errSave
From Individual to Whole: Reducing Intra-class Variance by Feature Aggregation
err2022-02-02
err10
PREAI
errZhang, Zhaoxiang; Luo, Chuanchen; Wu, Haiping; Chen, Yuntao; Wang, Naiyan; Song, Chunfeng
errShare
errSave
Learnable dynamic margin in deep metric learning
err2022-12-01
err8
PREAI
errWang, Yifan; Liu, Pingping; Lang, Yijun; Shan, Xue; Zhou, Qiuzhan
errShare
errSave
Noise-robust oversampling for imbalanced data classification
err2023-01-01
err41
PREAI
errLiu, Yongxu; Liu, Yan; Yu, Bruce X. B.; Zhong, Shenghua; Hu, Zhejing
errShare
errSave
Robust learning from noisy web data for fine-Grained recognition
err2023-02-01
err9
PREAI
errCai, Zhenhuang; Xie, Guo-Sen; Huang, Xingguo; Huang, Dan; Yao, Yazhou; Tang, Zhenmin
errShare
errSave
Learning to rectify for robust learning with noisy labels
err2022-04-01
err27
errOAAI
errSun, Haoliang; Guo, Chenhui; Wei, Qi; Han, Zhongyi; Yin, Yilong
errShare
errSave
Margin-aware rectified augmentation for long-tailed recognition
err2023-09-01
err8
PREAI
errXiang, Liuyu; Han, Jungong; Ding, Guiguang
errShare
errSave
researcher View more