.png){kind=icon}
Return
Multimodal Sentiment Recognition With Multi-Task Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TETCI.2022.3224929.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Sentiment recognition in social network aims at recognizing the underlying affective states of user-generated content. The research center of sentiment recognition is moving from pure texts to multimodal contents, with the explosive growth of social platforms. Different from the image-text contents on blog and review platforms, multimodal sequences play a dominant role in streaming media, e.g. YouTube and TikTok. Sentiment recognition for multimodal sequences needs to extract the common and specific information of modalities. But current studies only focus on learning the cross-modal fusion representation to explore the inter-modal interaction, while neglecting the interactions and characteristics within each modality. We propose a novel cascade and specific scoring model, which aims at learning better cross-modal and unimodal representations to capture both the inter- and intra-modal interactions for sentiment recognition. Qualitative and quantitative experiments on two benchmarks have demonstrated the competitive performances of the proposed methods.
Keywords:
Task analysis
Visualization
Multitasking
Feature extraction
Data mining
Time series analysis
Kernel
Multimodal
multi-task learning
representation fusion
sentiment recognition
Journal
I
IF:
6.5
Papers:
1.4K
Citations:
4.5K
Organization
Cited Papers
ShareSaveBeneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
OAAI
OAAIShareSave4-Phenylbutyrate Attenuates the ER Stress Response and Cyclic AMP Accumulation in DYT1 Dystonia Cell Models.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAIShareSaveShareSaveShareSaveShareSave
View more