arrow
返回

Beyond Co-Occurrence: Multi-Modal Session-Based Recommendation

delete2024-04-01
delete6
delete
OA
AI
X
Xiaokun Zhang
X
Xu, Bo
F
Fenglong Ma
李晨亮 封面图
李晨亮 (Chenliang Li)
L
Liang Yang
H
Hongfei Lin *
DOI:10.1109/TKDE.2023.3309995delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Session-based recommendation is devoted to characterizing preferences of anonymous users based on short sessions. Existing methods mostly focus on mining limited item co-occurrence patterns exposed by item ID within sessions, while ignoring what attracts users to engage with certain items is rich multi-modal information displayed on pages. Generally, the multi-modal information can be classified into two categories: descriptive information (e.g., item images and description text) and numerical information (e.g., price). In this paper, we aim to improve session-based recommendation by modeling the above multi-modal information holistically. There are mainly three issues to reveal user intent from multi-modal information: (1) How to extract relevant semantics from heterogeneous descriptive information with different noise? (2) How to fuse these heterogeneous descriptive information to comprehensively infer user interests? (3) How to handle probabilistic influence of numerical information on user behaviors? To solve above issues, we propose a novel multi-modal session-based recommendation (MMSBR) that models both descriptive and numerical information under a unified framework. Specifically, a pseudo-modality contrastive learning is devised to enhance the representation learning of descriptive information. Afterwards, a hierarchical pivot transformer is presented to fuse heterogeneous descriptive information. Moreover, we represent numerical information with Gaussian distribution and design a Wasserstein self-attention to handle the probabilistic influence mode. Extensive experiments on three real-world datasets demonstrate the effectiveness of the proposed MMSBR. Further analysis also proves that our MMSBR can alleviate the cold-start problem in SBR effectively.
Keyword:
Probabilistic logic
Behavioral sciences
Numerical models
Transformers
Semantics
Graph neural networks
Fuses
Hierarchical pivot transformer
multi-modal learning
probabilistic modeling
pseudo-modality contrastive learning
session-based recommendation

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

P
Pennsylvania State University
学者数:
3.0W
论文数: 2.6W
被引数: 7.2W
P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Failure analysis of idler roller bearings in belt conveyors
err2020-11-01
err0
PREAI
errMilan Vasić; Blaža Stojanović; Mirko Blagojević
err分享
err收藏
err分享
err收藏
err分享
err收藏
Lithium Dendrites: Inside or Outside: Origin of Lithium Dendrite Formation of All Solid‐State Electrolytes (Adv. Energy Mater. 40/2019)
err2019-10-24
err0
errOAAI
errFangjie Mo; Jiafeng Ruan; Shuxian Sun; Zixuan Lian; Sangpu Yang; Xinyang Yue; Yun Song; Yong‐Ning Zhou; Fang Fang; Guangai Sun; Shuming Peng; Dalin Sun
err分享
err收藏
Lockdown impact on COVID-19 epidemics in regions across metropolitan France
err2020-10-01
err0
errOAAI
errSimon Cauchemez; Cécile Tran Kiem; Juliette Paireau; Patrick Rolland; Arnaud Fontanet
err分享
err收藏
学者 查看更多内容