arrow
Return

DRARec: diffusion-based representation augmentation for multimodal recommendation

delete2026-09-06
delete0
PRE
AI
L
Lingfeng Liu
L
Lin Cheng *
X
Xiaojia Wu
S
Shanshan Xu
DOI:10.1007/s00530-026-02622-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multimodal recommendation systems integrate multimodal information into user and item feature representations, and leverage multimodal information to alleviate the data sparsity issue. However, existing research faces two key challenges. First, most methods based on graph convolutional network (GCN) directly utilize multimodal features, which may introduce noisy information unrelated to user preferences. Second, existing diffusion-based methods primarily focus on interaction modeling or graph structure augmentation, which inevitably adds new noisy edges (e.g., introducing false user–item interactions). Although these methods have achieved remarkable success, the aforementioned noise can be amplified in the message propagation of GCN, affecting the final multimodal representation. To address these challenges, we propose a novel Diffusion-based Representation Augmentation for Multimodal Recommendation (DRARec) method. Specifically, to mitigate the negative impact of noisy information across different modalities, we introduce a behavior-aware injection mechanism. It first injects behavior modality information into all content modality embeddings, aligning them to a preference-related semantic space, and then employs an attention module to enhance feature discriminability. Additionally, to avoid the negative impact of noisy edges, we propose a diffusion-based modality representation augmentation strategy. It directly refines the semantic features of each modality to enhance the robustness of features. Extensive experiments on three public datasets demonstrate the superiority and effectiveness of DRARec.
Keywords:
Multimodal recommendation systems
Representation augmentation
Diffusion models

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.8K
Citations:
2.7K

Organization

No organization information available
Cited Papers

Cited Papers

Diffusion Augmentation for Sequential Recommendation
err2023-10-21
err0
errOAAI
errQidong Liu; Fan Yan; Xiangyu Zhao; Zhaocheng Du; Huifeng Guo; Ruiming Tang; Feng Tian
errShare
errSave
High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
Knowledge-Aware Diffusion-Enhanced Multimedia Recommendation
err2025-01-01
err0
PREAI
errMo,Xian; Liu,Fei; Tang,Rui; Gao,Jintao; Liu,Hao
errShare
errSave
Bootstrap Latent Representations for Multi-modal Recommendation
err2023-04-30
err0
errOAAI
errXin Zhou; Hongyu Zhou; Yong Liu; Zhiwei Zeng; Chunyan Miao; Pengwei Wang; Yuan You; Feijun Jiang
errShare
errSave
Mining Latent Structures for Multimedia Recommendation
err2021-10-17
err0
errOAAI
errJinghao Zhang; Yanqiao Zhu; Qiang Liu; Shu Wu; Shuhui Wang; Liang Wang
errShare
errSave
LightGCN
err2020-07-25
err0
PREAI
errXiangnan He; Kuan Deng; Xiang Wang; Yan Li; YongDong Zhang; Meng Wang
errShare
errSave
researcher View more