arrow
Return

Reinforcement Learning-Based Data Weight Optimization for Sequential Recommendation

delete2026-01-19
delete0
PRE
AI
王石泉 cover
王石泉 (Shiquan Wang)
Y
Yicheng Di
J
Jiayu Bao
Z
Zhuolong Jiang
H
Hongjian Shi
马
马汝辉 (Ruhui Ma)
X
Xin Gao
Z
Zhiwei Song
袁
袁宏 (Yuan Hong)
Y
Yuan Liu
H
Haibing Guan
DOI:10.1109/TCE.2026.3655431delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advances in recommendation systems have highlighted the critical importance of data quality in model performance. In this paper, we propose a reinforcement learning based data weight optimization framework, termed RLWORec, to enhance data quality for both small recommendation models and large language model (LLM) fine-tuning scenarios. By dynamically assigning continuous importance weights to training samples via a policy gradient method under the Proximal Policy Optimization (PPO) framework, our approach effectively identifies and filters noisy data while preserving informative samples. Unlike traditional data selection methods that rely on static scoring mechanisms, RLWORec adaptively learns sample importance through iterative optimization with global performance feedback. Extensive experiments on three real-world datasets demonstrate that RLWORec consistently outperforms state-of-the-art data selection baselines, achieving superior recommendation performance with significantly reduced training data. Our method enables small models to exceed full-dataset performance using only carefully selected subsets, while allowing large models to achieve comparable results with merely 2% of the original training data.
Keywords:
Recommendation systems
reinforcement learning
data selection
large language models

Journal

IEEE Transactions on Consumer Electronics cover
IEEE Transactions on Consumer Electronics
IF:
10.9
Papers:
5.3K
Citations:
6.8K

Organization

B
bombardier nug signalling solutions company ltd
Scholars:
1
Papers: 1
Citations: 0
U
UGO-AI Intelligent Technology Company Ltd.
Scholars:
1
Papers: 1
Citations: 0
S
shanghai jiao tong university
Scholars:
15.7W
Papers: 11.7W
Citations: 159
S
singpilot pte. ltd.
Scholars:
1
Papers: 1
Citations: 0
J
jiangnan university
Scholars:
8.8K
Papers: 2.4K
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Personalized Consumer Federated Recommender System Using Fine-grained Transformation and Hybrid Information Sharing
err2025-01-01
err0
PREAI
errYicheng Di; Xiaoming Wang; Hongjian Shi; Chongsheng Fan; Rong Zhou; Ruhui Ma; Yuan Liu
errShare
errSave
FGC: GCN-Based Federated Learning Approach for Trust Industrial Service Recommendation
err2023-03-01
err21
PREAI
errYin, Yuyu; Li, Youhuizi; Gao, Honghao; Liang, Tingting; Pan, Qianqian
errShare
errSave
errShare
errSave
Dynamical Resource Allocation in Edge for Trustable Internet-of-Things Systems: A Reinforcement Learning Method
err2020-09-01
err122
PREAI
errDeng, Shuiguang; Xiang, Zhengzhe; Zhao, Peng; Taheri, Javid; Gao, Honghao; Yin, Jianwei; Zomaya, Albert Y.
errShare
errSave
Leveraging ChatGPT to Empower Training-free Dataset Condensation for Content-based Recommendation
err2025-05-08
err0
PREAI
errWu,Jiahao; Liu,Qijiong; Hu,Hengchang; Fan,Wenqi; Liu,Shengcai; Li,Qing; Wu,Xiao-Ming; Tang,Ke
errShare
errSave
Recommender Systems with Generative Retrieval
err2023-01-01
err0
PREAI
errChi,Ed; Heldt,Lukasz; Hong,Lichan; Hulikal Keshavan,Raghunandan; Kula,Maciej; Mehta,Nikhil; Rajput,Shashank; Samost,Jonah; Sathiamoorthy,Maheswaran; Singh,Anima; Tay,Yi; Tran,Vinh; Vu,Trung
errShare
errSave
researcher View more