arrow
Return

Hierarchy-Aware Multimodal Distillation for Recommendation

delete2026-01-12
delete0
PRE
AI
J
Jian Meng
T
T. Y. Wang
M
Meijuan Yang
毋立芳 cover
毋立芳 (Lifang Wu)
DOI:10.1109/TMM.2026.3651049delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Beyond behavioral interaction records, multimedia recommendation scenarios possess abundant semantic signals, which provide excellent data support for user interest mining. Recently, the multimodal enhanced interaction graph has been actively explored and has achieved great progress. However, these methods overlook the capability disparity of various modalities in learning users' interests and lack the ability to explore the hierarchical relationships of interests in modality, resulting in suboptimal recommendation performance. Therefore, this work investigates intra-modality hierarchical learning and inter-modality guidance, proposing a hyperbolic self-distillation (HSD) model for multimedia recommendation. In each modality space, HSD introduces a hyperbolic propagation to filter users' hierarchical interests from the interaction graph effectively. Inter-modality interests are aligned further by a two-level self-distillation strategy to designate multimodal interactions to teach single-modal learning, aiming at teaching and learning to promote each other. Extensive experiments on four public datasets demonstrate that the proposed HSD outperforms leading baselines for multimedia recommendation, verifying the effectiveness of hierarchical propagation and two-level self-distillation in mining users' hierarchical interests.
Keywords:
Embedding learning
hyperbolic space
knowledge distillation
multimedia recommendation
user interest

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

N
northwestern polytechnical university
Scholars:
1.2W
Papers: 4.3K
Citations: 0
B
beijing university of technology
Scholars:
5.3K
Papers: 1.8K
Citations: 0