1
Return

Multi-level global and local fusion for multimodal sentiment analysis

delete2026-07-13
delete0
delete
OA
AI
B
Bing Zhang
J
Junteng Wang
B
Bin Sun
N
Ning Ma *
DOI:10.1007/s12293-026-00520-7delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
With the rise of social media, multimodal sentiment analysis has gained increasing attention due to the rich and diverse ways users express emotions through text and images. However, existing methods often ignore fine-grained sentiment cues and semantic misalignment across modalities, limiting this task effectiveness. To address these challenges, we propose DualScope, a novel model that combines a global-local fusion strategy with bidirectional image-text generation for semantically consistent data augmentation. Furthermore, we introduce both label contrastive learning and data contrastive learning to align heterogeneous modalities and enhance model robustness. The fusion module integrates global and local features in a progressive manner under global semantic guidance. Extensive experiments on two widely used datasets, MVSA-Single and MVSA-Multiple, demonstrate that the proposed method achieves superior performance, confirming its effectiveness in handling fine-grained semantics and cross-modal inconsistency.
Keywords:
Multimodal Sentiment Analysis
Global-Local Fusion
Contrastive Learning
Data Augmentation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Memetic Computing cover
Memetic Computing
IF:
2.3
Papers:
447
Citations:
718

Organization

Cited Papers

Cited Papers

Citing Papers

Citing Papers