arrow
Return

SPACE: Self-Supervised Dual Preference Enhancing Network for Multimodal Recommendation

delete2024-01-01
delete2
PRE
AI
J
Jie Guo
L
Longyu Wen
Y
Yan Zhou
B
Bin Song
Y
Yuhao Chi *
F
F. Richard Yu
DOI:10.1109/TMM.2024.3382889delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multimodalrecommendation is an emerging task with the goal of improving the effectiveness of the recommendation system by utilizing multimodal data (images, texts, etc.). Most previous methods have struggled with the ability to mine item semantic relationships while guaranteeing accurate modeling of user modality preferences, resulting in low recommendation accuracy. To address this issue, this paper proposes a novel and effective Self-suPervised duAl preference enhanCing nEtwork for multimodal recommendation, named SPACE, which further mines user preferences towards historical interactions and multimodal features of items to obtain more precise user and item representation. Specifically, we design an interaction preference enhancing module to learn both interactive and latent semantic relationships between users and items. Then, a modality preference enhancing module is established by introducing self-supervised learning (SSL), which aims to strengthen the role of dominant modality-specific representation of items. Finally, the enhanced interaction and modality representations are fused, and the recommendation performance is largely improved by utilizing dual joint prediction. Extensive experiments are conducted on three real-world datasets, and the simulation results demonstrate that the proposed SPACE model outperforms the state-of-the-art multimodal recommendation methods.
Keywords:
Semantics
Self-supervised learning
Visualization
Convolution
Task analysis
Recommender systems
Noise measurement
Multimodal recommendation
self-supervised learning
preference enhancing
dual joint prediction

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

C
carleton university
Scholars:
7.5K
Papers: 8.3K
Citations: 5
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K