.png){kind=icon}
返回
Multi-Level Attention Map Network for Multimodal Sentiment Analysis
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2022.3155290.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multimodal sentiment analysis (MSA) is a very challenging task due to its complex and complementary interactions between multiple modalities, which can be widely applied into areas of product marketing, public opinion monitoring, and so on. However, previous works directly utilized the features extracted from multimodal data, in which the noise reduction within and among multiple modalities has been largely ignored before multimodal fusion. This paper proposes a multi-level attention map network (MAMN) to filter noise before multimodal fusion and capture the consistent and heterogeneous correlations among multi-granularity features for multimodal sentiment analysis. Architecturally, MAMN is comprised of three modules: multi-granularity feature extraction module, multi-level attention map generation module, and attention map fusion module. The first module is designed to sufficiently extract multi-granularity features from multimodal data. The second module is constructed to filter noise and enhance the representation ability for multi-granularity features before multimodal fusion. And the third module is built to extensibly mine the interactions among multi-level attention maps by the proposed extensible co-attention fusion method. Extensive experimental results on three public datasets show the proposed model is significantly superior to the state-of-the-art methods, and demonstrate its effectiveness on two tasks of document-based and aspect-based MSA tasks.
Keyword:
Feature extraction
Task analysis
Sentiment analysis
Fuses
Visualization
User-generated content
Data mining
Multimodal sentiment analysis
opinion mining
social analysis
multimodal fusion
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
4-Phenylbutyrate Attenuates the ER Stress Response and Cyclic AMP Accumulation in DYT1 Dystonia Cell Models.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏分享收藏
查看更多内容