.png){kind=icon}
Return
Cross-Modal Alternating Learning With Task-Aware Representations for Continual Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2023.3340551.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Continual learning is a research field of artificial neural networks to simulate human lifelong learning ability. Although a surge of investigations has achieved considerable performance, most rely only on image modality for incremental image recognition tasks. In this article, we propose a novel yet effective framework coined cross-modal Alternating Learning with Task-Aware representations (ALTA) to make good use of visual and linguistic modal information and achieve more effective continual learning. To do so, ALTA presents a cross-modal joint learning mechanism that leverages simultaneous learning of image and text representations to provide more effective supervision. And it mitigates forgetting by endowing task-aware representations with continual learning capability. Concurrently, considering the dilemma of stability and plasticity, ALTA proposes a cross-modal alternating learning strategy that alternately learns the task-aware cross-modal representations to match the image-text pairs between tasks better, further enhancing the ability of continual learning. We conduct extensive experiments under various popular image classification benchmarks to demonstrate that our approach achieves state-of-the-art performance. At the same time, systematic ablation studies and visualization analyses validate the effectiveness and rationality of our method.
Keywords:
Continual learning
cross-modal
task-aware representation
joint learning
and alternating learning
Continual learning
cross-modal
task-aware representation
joint learning
and alternating learning
Journal
IF:
9.7
Papers:
4.6K
Citations:
2.4W
Organization
Cited Papers
ShareSaveShareSavePrecipitation Versus Partitioning Kinetics during the Quenching of Low-Carbon Martensitic Steels.png)
Metals
OAAI
MetalsIF0
OAAIShareSaveShareSaveShareSaveShareSaveShareSave
View more