arrow
返回

Large-Scale Interactive Recommendation With Tree-Structured Reinforcement Learning

delete2023-04-01
delete3
PRE
AI
H
Haokun Chen
C
Chenxu Zhu
R
Ruiming Tang
W
Weinan Zhang *
X
Xiuqiang He
Y
Yong Yu
DOI:10.1109/TKDE.2021.3137310delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Although reinforcement learning (RL) techniques are regarded as promising solutions for interactive recommender systems (IRS), such solutions still face three main challenges, namely, i) time inefficiency when handling large discrete action space in IRS, ii) inability to deal with the cold-start scenarios in IRS, iii) data inefficiency during training the RL-based methods. To tackle these challenges, we propose a generic tree-structured RL framework taking both policy-based and value-based approaches into consideration. We propose to construct a balanced tree over representations of the items, such that picking an item is formulated as seeking a suitable path from the root to a leaf node in the balanced tree, which dramatically reduces the time complexity of item recommendation. Further, for cold-start scenarios where prior information of the items is unavailable, we initialize a random balanced tree as the starting point and then refine the tree structure based on the learned item representations. Besides, we also incorporate a user modeling component to explicitly model the environment, which can be utilized in the training phase to improve data efficiency. Extensive experiments on two real-world datasets are conducted and demonstrate that our framework can achieve superior recommendation performance and provide time and data efficiency improvement over state-of-the-art methods in both warm-start and cold-start IRS scenarios.
Keyword:
Reinforcement learning
Predictive models
interactive recommender system
large-scale recommendation
cold-start

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

H
huawei technologies
学者数:
3.3K
论文数: 2.9K
被引数: 1
S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

Operational entanglement-based quantum key distribution over 50 km of field-deployed optical fibers
err2023-10-03
err0
PREAI
errYoann Pelet; Grégory Sauder; Mathis Cohen; Laurent Labonté; Olivier Alibart; Anthony Martin; Sébastien Tanzilli
err分享
err收藏
A comparative analysis of binding in ultralong-range Rydberg molecules
err2015-05-07
err0
errOAAI
errC Fey; M Kurz; P Schmelcher; S T Rittenhouse; H R Sadeghpour
err分享
err收藏
err分享
err收藏
err分享
err收藏
Atomistic basis of opening and conduction in mammalian inward rectifier potassium (Kir2.2) channels哺乳动物内向整流钾 (Kir2.2) 通道开放和传导的原子基础
err
IF0
err2019-05-18
err0
errOAAI
errEva-Maria Zangerl-Plessl; Sun-Joo Lee; Grigory Maksaev; Harald Bernsteiner; Feifei Ren; Peng Yuan; Anna Stary-Weinzinger; Colin G. Nichols
err分享
err收藏
Cosmetics and its Health Risks
err2018-06-02
err0
errOAAI
errJonathas Xavier Pereira; Thais Canuto Pereira
err分享
err收藏
学者 查看更多内容