.png){kind=icon}
返回
A text guided multi-task learning network for multimodal sentiment analysis
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2023.126836.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multimodal Sentiment Analysis (MSA) is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. Existing research tends to develop sophisticated fusion techniques to fuse unimodal representations into multimodal representation and treat MSA as a single prediction task. However, we find that the text modality with the pre-trained model (BERT) learn more semantic information and dominates the training in multimodal models, inhibiting the learning of other modalities. Besides, the classification ability of each modality is also suppressed by single-task learning. In this paper, We propose a text guided multi-task learning network to enhance the semantic information of non-text modalities and improve the learning ability of unimodal networks. We conducted experiments on multimodal sentiment analysis datasets, CMU-MOSI, CMU-MOSEI, and CH-SIMS. The results show that our method outperforms the current SOTA method.
Keyword:
Multimodal sentiment analysis
Representation learning
Multi-task learning
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages视频中的多模态情感强度分析: 面部手势和言语信息
PREAI
分享收藏Aspect-based sentiment analysis with component focusing multi-head co-attention networks基于Aspect的组件聚焦多头协同关注网络情感分析.png)
NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏
Multimodal sentiment analysis with unidirectional modality translation基于单向模态翻译的多模态情感分析NEUROCOMPUTING
NEUROCOMPUTINGIF6.5
PREAI
分享收藏分享收藏Yield and Quality of Soymilk and Tofu Made from Soybean Genotypes Grown at Four LocationsCrop Science
Crop ScienceIF0
PREAI
分享收藏
查看更多内容