arrow
Return

Exploiting diffusion-based structured learning for item interactions representations in multimodal recommender systems

delete2025-05-01
delete0
PRE
AI
K
Khan, Nikhat *
S
Sisodia, Dilip Singh
DOI:10.1016/j.ipm.2025.104075delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multimodal Recommender Systems (MRS) enhance the performance of recommendations by utilizing different item information, such as text, images, and audio. Existing non-graph-based MRS techniques combine embeddings (i.e., id and multimodal embedding) but ignore indirect and higher-order interactions. Graph-based MRS approaches use graph sparsification (GS) to construct item graphs and graph convolutional networks (GCNs) for higher-order interactions. However, GS reduces the item graph size, while GCNs ignore specific information due to their predefined weights. Hence, to mitigate the mentioned issues, this study proposes a Diffusionbased Structured Learning technique for Multimodal Recommender Systems (DSL-MRS) that improves the latent item graph information flow while maintaining its structure. Additionally, we used a graph attention neural network (GANN) to represent complex higher-order item-item interactions and implemented an attention mechanism to prioritize relevant nodes by assigning weights to neighbour. Also, for optimization, a Weighted Approximate-Rank pairwise (WARP) loss function has been used to prioritize predictions for observed items over those for unspecified items. To demonstrate the advantage of DSL-MRS, we conducted extensive experiments on three publicly available categories of Amazon datasets. The experimental findings showed that the proposed approach led to an average improvement of 5.8 % in R@20, 8.7 % in precision@20,7.8 % in NDCG@20 and 8.8 % in F-score@20 compared to the baseline model. Ablation studies demonstrate the value and efficacy of DSL-MRS, as its components degrade performance when removed.
Keywords:
Multimodal recommender system
Attention mechanism
Graph structure learning
Graph diffusion
Interaction graph

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

N
natl inst technol raipur
Scholars:
52
Papers: 31
Citations: 18
Cited Papers

Cited Papers

Data Augmentation for Deep Graph Learning
err2022-12-08
err0
PREAI
errKaize Ding; Zhe Xu; Hanghang Tong; Huan Liu
errShare
errSave
Market2Dish: Health-aware Food Recommendation
err2021-04-16
err41
errOAAI
errWang, Wenjie; Duan, Ling-Yu; Jiang, Hao; Jing, Peiguang; Song, Xuemeng; Nie, Liqiang
errShare
errSave
Large scale image annotation: learning to rank with joint word-image embeddings
err2010-07-27
err250
errOAAI
errWeston, Jason; Bengio, Samy; Usunier, Nicolas
errShare
errSave
Simple hierarchical PageRank graph neural networks
err2023-09-29
err0
PREAI
errFei Yang; Huyin Zhang; Shiming Tao; Xiying Fan
errShare
errSave
A survey on personalized itinerary recommendation: From optimisation to deep learning
err2024-02-01
err3
errOAAI
errHalder, Sajal; Lim, Kwan Hui; Chan, Jeffrey; Zhang, Xiuzhen
errShare
errSave
Towards a social and context-aware mobile recommendation system for tourism
err2017-07-01
err72
errOAAI
errColomo-Palacios, Ricardo; Jose Garcia-Penalvo, Francisco; Stantchev, Vladimir; Misra, Sanjay
errShare
errSave
Preference-corrected multimodal graph convolutional recommendation network
err2022-06-04
err1
PREAI
errJia, Xiangen; Dong, Yihong; Zhu, Feng; Xin, Yu; Qian, Jiangbo
errShare
errSave
researcher View more