.png){kind=icon}
返回
Shared-Private Memory Networks For Multimodal Sentiment Analysis
.png){kind=icon}
PRE
AI
DOI：10.1109/TAFFC.2022.3222023.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Text, visual, and acoustic are usually complementary in the Multimodal Sentiment Analysis (MSA) task. However, current methods primarily concern shared representations while neglecting the critical private aspects of data within individual modalities. In this work, we propose shared-private memory networks based on the recent advances in the attention mechanism, called SPMN, to decouple multimodal representation from shared and private perspectives. It contains three components: a) a shared memory to learn the shared representations of multimodal data; b) three private memories to learn the private representations of individual modalities, respectively; c) and adaptive fusion gates to fuse multimodal private and shared representations. To evaluate the effectiveness of SPMN, we integrate it into different pre-trained language representation models, such as BERT and XLNET, and conduct experiments on two public datasets, CMU-MOSI and CMU-MOSEI. Experimental results indicate that the performances of pre-trained language representation models are significantly improved because of SPMN and demonstrate the superiority of our model compared to the state-of-the-art methods. SPMN's source code is publicly available at: https://github.com/xiaobaicaihhh/SPMN.
Keyword:
Multimodal sentiment analysis
shared-private memory netwoks
adaptive fusion gate
BERT
期刊
IF:
9.8
论文数:
1.4K
被引数:
9.1K
机构
引用论文
Information needs and delivery channels: Experimental evidence from Cambodian smallholders.png)
IFLA Journal
OAAI
IFLA JournalIF0
OAAI分享收藏
查看更多内容