.png){kind=icon}
Return
Knowledge-Enhanced Causal Reinforcement Learning Model for Interactive Recommendation
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2023.3276505.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Owing to its inherently dynamic nature and economical training cost, offline reinforcement learning (RL) is typically employed to implement an interactive recommender system (IRS). A crucial challenge in offline RL-based IRSs is the data sparsity issue, i.e., it is hard to mine user preferences well from the limited number of user-item interactions. In this article, we propose a knowledge-enhanced causal reinforcement learning model (KCRL) to mitigate data sparsity in IRSs. We make technical extensions to the offline RL framework in terms of the reward function and state representation. Specifically, we first propose a group preference-injected causal user model (GCUM) to learn user satisfaction (i.e., reward) estimation. We introduce beneficial group preference information, namely, the group effect, via causal inference to compensate for incomplete user interests extracted from sparse data. Then, we learn the RL recommendation policy with the reward given by the GCUM. We propose a knowledge-enhanced state encoder (KSE) to generate knowledge-enriched user state representations at each time step, which is assisted by a self-constructed user-item knowledge graph. Extensive experimental results on real-world datasets demonstrate that our model significantly outperforms the baselines.
Keywords:
Data models
Recommender systems
Training
Reinforcement learning
Estimation
Correlation
Computational modeling
Causal inference
data sparsity
group performance
interactive recommender system
knowledge graph
offline reinforcement learning
Journal
IF:
9.7
Papers:
4.6K
Citations:
2.4W
Organization
View more organizations
Cited Papers
.png){kind=icon}
ShareSaveOperational entanglement-based quantum key distribution over 50 km of field-deployed optical fibers
PREAI
ShareSaveShareSaveShareSaveInSight coordinates determination from direct-to-Earth radio-tracking and Mars topography model
PREAI
ShareSaveShareSaveShareSave View more