.png){kind=icon}
Return
A text guided multi-task learning network for multimodal sentiment analysis
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.126836.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multimodal Sentiment Analysis (MSA) is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. Existing research tends to develop sophisticated fusion techniques to fuse unimodal representations into multimodal representation and treat MSA as a single prediction task. However, we find that the text modality with the pre-trained model (BERT) learn more semantic information and dominates the training in multimodal models, inhibiting the learning of other modalities. Besides, the classification ability of each modality is also suppressed by single-task learning. In this paper, We propose a text guided multi-task learning network to enhance the semantic information of non-text modalities and improve the learning ability of unimodal networks. We conducted experiments on multimodal sentiment analysis datasets, CMU-MOSI, CMU-MOSEI, and CH-SIMS. The results show that our method outperforms the current SOTA method.
Keywords:
Multimodal sentiment analysis
Representation learning
Multi-task learning
Journal
IF:
6.5
Papers:
2.5W
Citations:
6.5W
Organization
Cited Papers
ShareSaveAspect-based sentiment analysis with component focusing multi-head co-attention networks.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
ShareSave
ShareSave
ShareSaveShareSaveShareSaveYield and Quality of Soymilk and Tofu Made from Soybean Genotypes Grown at Four LocationsCrop Science
Crop ScienceIF0
PREAI
ShareSaveShareSave
View more