arrow
Return

Graph Representation and Prototype Learning for webly supervised

delete2024-07-01
delete0
PRE
AI
J
Jiantao Lin
陈添水 cover
陈添水 (Tianshui Chen) *
Y
Ying-Cong Chen
杨志景 cover
杨志景 (Zhijing Yang)
Y
Yuefang Gao
DOI:10.1016/j.patrec.2024.05.002delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Webly supervised fine-grained image recognition (FGIR) learns to distinguish sub-ordinate categories based on webly-retrieved data, which can dramatically alleviate the dependency on manually annotated labels. This is quite a challenging task due to the heavy noise labels and the inherent dilemma of small inter-class variance and large intra-class variance. Current webly supervised algorithms learn holistic category prototypes to help correct noisy labels but ignore local features that can distinguish different sub-ordinate categories. In this work, we propose a Graph Representation and Prototype Learning (GRPL) framework to automatically mine discriminative local regions and their interactions with holistic image to learn instance graph representation both category graph prototype to help correct noisy labels and retrieve out-of-distribution (OOD) samples. Specifically, an attention-focused module is designed to extract the discriminative regions and then build a structured graph to correlate them with the holistic image for each instance and an identical graph to model holistic-local correlations for each category. Next, we apply two stacked graph convolution networks to explore holistic-local interaction within each graph and across two graphs to learn graph representation for each instance and graph prototype for each category. Finally, the similarities between the instancelevel and prototype-level graph representation are learned to help correct noisy labels and exclude OOD samples. Extensive experiments conducted on several datasets show the proposed approach achieves superior performance compared with current leading algorithms.
Keywords:
Webly supervised learning
Fine-grained image recognition
Graph representation learning

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.8K
Citations:
1.6W

Organization

S
South China Agricultural University
Scholars:
3.0W
Papers: 1.5W
Citations: 2.6W
G
guangdong university of technology
Scholars:
2.9W
Papers: 2.0W
Citations: 36