.png){kind=icon}
.png){kind=icon}
Return
Multi-View Interactive Representations for Multimodal Sentiment Analysis
.png){kind=icon}
PRE
AI
DOI：10.1109/TCE.2024.3357480.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multimodal Sentiment Analysis (MSA) technology, prevalent in consumer applications and mobile edge computing (MEC), enables sentiment examination through user data collected by smart devices. Despite the focus on representation learning in MSA, current methods often prioritize recognition performance through modality interaction and fusion. However, they struggle to capture multi-view sentiment cues across different interaction states, limiting multimodal sentiment representations' expressiveness. This paper develops an innovative MSA framework, MVIR, learning multi-view interactive representations in diverse interaction states. Multiple meticulously designed sentiment tasks and an introduced self-supervised label generation algorithm (SSLGM) enable a comprehensive understanding of multi-view sentiment tendencies. The dual-view attention weighted fusion (DVAWF) module is designed to facilitate inter-modality information exchange in different interaction states. Extensive experiments on three MSA datasets affirm the efficacy and superiority of MVIR, showcasing its ability to capture sentiment information from multimodal data across various interaction states.
Keywords:
Task analysis
Sentiment analysis
Visualization
Multitasking
Information exchange
Image color analysis
Videos
Representation learning
dual-view attention weighted fusion
multi-task learning
multimodal sentiment analysis
Journal
IF:
10.9
Papers:
5.1K
Citations:
6.8K