arrow
Return

Multimodal Continual Learning Using Online Dictionary Updating

delete2021-03-01
delete2
PRE
AI
F
Fuchun Sun
刘华坪 cover
刘华坪 (Huaping Liu) *
杨超 cover
杨超 (Chao Yang)
B
Bin Fang
DOI:10.1109/TCDS.2020.2973280delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article studies the continual learning task from the perspective of multimodal fusion. In the multimodal fusion problem, the unified representations of heterogeneous modalities are continuously updated, while the classifier is also constantly refreshed for each multimodal learning task. To tackle this point, we establish a continual learning framework for multimodal learning and design an effective online dictionary updating method. Finally, we experimentally verify a complex material identification task and obtain promising results.
Keywords:
Task analysis
Dictionaries
Robots
Machine learning
Encoding
Learning systems
Knowledge based systems
Continual learning
dictionary updating
multimodal fusion
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cognitive and Developmental Systems cover
IEEE Transactions on Cognitive and Developmental Systems
IF:
4.9
Papers:
1.0K
Citations:
3.5K

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137