.png){kind=icon}
Return
Self-Supervised Learning for Multimedia Recommendation
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2022.3187556.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Learning representations for multimedia content is critical for multimedia recommendation. Current representation learning methods roughly fall into two groups: (1) using the historical interactions to create ID embeddings of users and items, and (2) treating multi-modal data as the side information of items to enrich their ID embeddings. Each user-item interaction offers the supervisory signal to optimize the representation learning by the traditional supervised learning paradigm. Due to the overlook of the multi-modal patterns ($e.g.$, co-occurrence of visual, acoustic, textual features in micro-videos a user saw before, and her behavioral features) hidden in the data, these methods are insufficient to create powerful representations and obtain satisfactory recommendation accuracy. To capture multi-modal patterns in the data itself, we go beyond the supervised learning paradigm, and incorporate the idea of self-supervised learning (SSL) into multimedia recommendation. Specifically, SSL consists of two components: (1) data augmentation upon multi-modal contents, where we design three operators - feature dropout (FD), feature masking (FM), feature fine and coarse spaces (FAC) - to generate multiple views of individual items; and (2) contrastive learning, which differentiates the views of an item from the others' to distill additional supervisory signals. Clearly, SSL enables us to explore and exhibit the underlying relations among modalities, thereby resulting in powerful representations. We denote the generic framework by Self-supervised Learning-guided Multimedia Recommendation (SLMRec). Extensive experiments are performed on three real-world datasets, showing that SLMRec achieves significant improvements over several state-of-the-art baselines like LightGCN [1], MMGCN [2]. Further analysis shows how SSL affects recommendation performance.
Keywords:
Multimedia recommendation
self-supervised learning
graph neural network
micro-videos
Journal
IF:
9.7
Papers:
4.5K
Citations:
2.4W
Organization
View more organizations
Cited Papers
ShareSaveShareSaveIndividual and combining effects of anti-RANKL monoclonal antibody and teriparatide in ovariectomized mice.png)
Bone Reports
OAAI
Bone ReportsIF0
OAAIShareSave View more