arrow
Return

Efficient Deep Reinforcement Learning-Enabled Recommendation

delete2023-03-01
delete8
PRE
AI
G
Guangyao Pang
X
Xiaoming Wang *
王亮 cover
王亮 (Liang Wang)
F
Fei Hao
Y
Yaguang Lin
P
Pengfei Wan
G
Geyong Min
DOI:10.1109/TNSE.2022.3224028delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing recommendations based on machine learning are mainly based on supervised learning. However, these methods affected by historical behavior often bring great difficulties on mining high-quality long-tail items, achieving cold-start recommendations, and causing response inability to real-time environment changes. To this end, this paper proposes a Deep Reinforcement Learning-enabled Recommendation based on Hierarchical attention and Sample-enhanced priority experience replay (HEDRL-Rec). First, we propose a hierarchical attention mechanism to extract more hidden information, including different contributions from single feature and overall feature (comprising combined feature), for enhancing features extraction ability of Actor-Critic architecture. Then, by considering the reusability of historical experiences and differences their contributions, we then propose a sample-enhanced priority experience replay mechanism to alleviate the problems of sample imbalance, sparse data, and excessive action space, where, thereby realizing personalized recommendations in real-time changing environments. Finally, we develop a deep reinforcement learning-enabled recommendation algorithm to solve the problems of non-convergence in the Critic. Extensive experiments demonstrate that, in particular, the recommended Click-Through Rate (CTR) of the HEDRL-Rec is 10.55% higher than the state-of-the-art LIst-wise Recommendation framework based on the Deep Reinforcement learning (ILRD) scheme, while the HEDRL-Rec has better stability and usability in the recommendation scenario, effectively alleviating the cold-start problem of systems lacking manual annotation data.
Keywords:
Feature extraction
Neural networks
Data models
Data mining
Training
Supervised learning
Recommender systems
Recommendation
Deep reinforcement learning
Attention mechanism
Experience replay mechanism
Unsupervised learning

Journal

I
IEEE Transactions on Network Science and Engineering
IF:
7.9
Papers:
2.5K
Citations:
10.0K

Organization

S
Shaanxi Normal University
Scholars:
1.6W
Papers: 1.1W
Citations: 1.7W
U
University of Exeter
Scholars:
2.0W
Papers: 2.1W
Citations: 3.6W