arrow
返回

Multi-Label Continual Learning Using Augmented Graph Convolutional Network

delete2024-01-01
delete2
delete
OA
AI
K
Kaile Du
F
Fan Lyu
L
Linyan Li
胡
胡伏原 (Fuyuan Hu) *
W
Wei Feng
F
Fenglei Xu
X
Xuefeng Xi
H
Hanjing Cheng
DOI:10.1109/TMM.2023.3305871delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-Label Continual Learning (MLCL) is a framework designed for class-incremental multi-label image recognition. However, MLCL faces two critical challenges: the construction of label relationships on past-missing and future-missing partial labels of training data, and the problem of catastrophic forgetting, which leads to poor generalization. To address these challenges, this study proposes an enhanced version of the Augmented Graph Convolutional Network (AGCN++), capable of constructing cross-task label relationships and mitigating catastrophic forgetting. First, an Augmented Correlation Matrix (ACM) is constructed across all observed classes, incorporating intra-task relationships derived from hard label statistics. Additionally, inter-task relationships are established by leveraging both hard and soft labels obtained from the data, as well as a constructed expert network. Next, a novel partial label encoder (PLE) is introduced for MLCL, enabling the extraction of dynamic class representations for each partial label image as graph nodes. This PLE also facilitates the generation of soft labels, which contribute to the creation of a more persuasive ACM and effectively mitigate forgetting. Lastly, a relationship-preserving constrainter is proposed to address the issue of forgetting label dependencies across old tasks. In the AGCN++, the label relationships topology can be augmented automatically, thereby generating efficient class representations. The effectiveness of the proposed method is evaluated using two multi-label image benchmarks. The experimental results demonstrate that the proposed approach is highly effective in the context of MLCL image recognition. It can establish compelling correlations across tasks, even in scenarios where the old task labels are missing.
Keyword:
Task analysis
Correlation
Training
Image recognition
Convolutional neural networks
Dogs
Recurrent neural networks
Continual learning
multi-label recognition
partial label encoder
augmented correlation matrix

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
S
suzhou university of science & technology
学者数:
5.0K
论文数: 4.8K
被引数: 4
引用论文

引用论文

err分享
err收藏
Clinicopathologic profile of 470 giant cell tumors of bone from a cancer hospital in western India
err2008-08-01
err0
PREAI
errR. Gupta; V. Seethalakshmi; N.A. Jambhekar; S. Prabhudesai; N. Merchant; A. Puri; M. Agarwal
err分享
err收藏
err分享
err收藏
S1-Leitlinie Post-COVID/Long-COVIDS1-Leitlinie后COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
err分享
err收藏
Recommendation system for automatic design of magazine covers
err2013-03-19
err0
PREAI
errAli Jahanian; Jerry Liu; Qian Lin; Daniel Tretter; Eamonn O'Brien-Strain; Seungyon Claire Lee; Nic Lyons; Jan Allebach
err分享
err收藏
err分享
err收藏
Usage of Green Concrete Technology in Civil Engineering
err2015-01-01
err0
errOAAI
errTomasz Błaszczyński; Maciej Król
err分享
err收藏
学者 查看更多内容