.png){kind=icon}
返回
Structurally Refined Graph Transformer for Multimodal Recommendation
.png){kind=icon}
PRE
AI
DOI：10.1109/tmm.2026.3673527.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multimodal recommendation systems utilize various types of information, including images and text, to enhance the effectiveness of recommendations. The key challenge is predicting user purchasing behavior from the available data. Current recommendation models prioritize extracting multimodal information neglecting the distinction between redundant and valuable data. They also rely heavily on a single semantic framework (e.g., local or global semantics), resulting in an incomplete or biased representation of user preferences, particularly those less expressed in prior interactions. Furthermore, these approaches fail to capture the complex interactions between users and items limiting the model's ability to meet diverse users. To address these challenges, we present SRGFormer, a structurally optimized multimodal recommendation model. By modifying the transformer for better integration into our model, we capture the overall behavior patterns of users. Then, we enhance structural information by embedding multimodal information into a hypergraph structure to aid in learning the local structures between users and items. Meanwhile, applying self-supervised tasks to user-item collaborative signals enhances the integration of multimodal information, thereby revealing the representational features inherent to the data's modality. Extensive experiments on three public datasets reveal that SRGFormer surpasses previous benchmark models, achieving an average performance improvement of 4.47% on the Sports dataset.
Keyword:
Predictive models
Collaboration
Attention mechanisms
Accuracy
Recommender systems
Transformers
Feature extraction
Data mining
Semantics
Robustness
Recommendation system
multimodal recommendation
attention mechanism
self-supervise learning
期刊
IF:
9.7
论文数:
4.6K
被引数:
2.4W
机构
引用论文
暂无论文信息