.png){kind=icon}
返回
Cross-Modal Alternating Learning With Task-Aware Representations for Continual Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2023.3340551.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Continual learning is a research field of artificial neural networks to simulate human lifelong learning ability. Although a surge of investigations has achieved considerable performance, most rely only on image modality for incremental image recognition tasks. In this article, we propose a novel yet effective framework coined cross-modal Alternating Learning with Task-Aware representations (ALTA) to make good use of visual and linguistic modal information and achieve more effective continual learning. To do so, ALTA presents a cross-modal joint learning mechanism that leverages simultaneous learning of image and text representations to provide more effective supervision. And it mitigates forgetting by endowing task-aware representations with continual learning capability. Concurrently, considering the dilemma of stability and plasticity, ALTA proposes a cross-modal alternating learning strategy that alternately learns the task-aware cross-modal representations to match the image-text pairs between tasks better, further enhancing the ability of continual learning. We conduct extensive experiments under various popular image classification benchmarks to demonstrate that our approach achieves state-of-the-art performance. At the same time, systematic ablation studies and visualization analyses validate the effectiveness and rationality of our method.
Keyword:
Continual learning
cross-modal
task-aware representation
joint learning
and alternating learning
Continual learning
cross-modal
task-aware representation
joint learning
and alternating learning
期刊
IF:
9.7
论文数:
4.6K
被引数:
2.4W
机构
引用论文
Precipitation Versus Partitioning Kinetics during the Quenching of Low-Carbon Martensitic Steels.png)
Metals
OAAI
MetalsIF0
OAAI分享收藏分享收藏
查看更多内容