.png){kind=icon}
Return
Regularized Q-Learning With Linear Function Approximation
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2025.3592801.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We consider a single-loop algorithm for regularized Q-learning with linear function approximation. The proposed algorithm is motivated by a bilevel optimization formulation of regularized Q-learning wherein the lower level optimization problem aims to identify a value function approximation that satisfies Bellman’s recursive optimality condition, and the upper level aims to find the projection onto the span of basis vectors. We show that under certain assumptions, the proposed algorithm converges to a stationary point in the presence of Markovian noise. In addition, we provide a performance guarantee for the policies derived from the proposed algorithm.
Keywords:
Linear function approximation
Q-learning
reinforcement learning
Journal
IF:
7
Papers:
1.3W
Citations:
6.7W
Organization
Cited Papers
.png){kind=icon}
ShareSaveFast gradient-descent methods for temporal-difference learning with linear function approximation
PREAI
ShareSaveShareSaveShareSave
View more