arrow
返回

Online attentive kernel-based temporal difference learning

delete2023-10-01
delete2
delete
OA
AI
X
Xingguo Chen *
Guang Yang 封面图
Guang Yang (Guang Yang)
S
Shangdong Yang
H
Huihui Wang
S
Shaokang Dong
高扬 封面图
高扬 (Yang Gao)
DOI:10.1016/j.knosys.2023.110902delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Kernel-based reinforcement learning has received increasing attention because it requires less prior knowledge linear approximation and neural networks. Online kernel-based updating, however, is hindered by the challenge of catastrophic forgetting or interference. Sparse representation is a key method to address this issue, but existing methods fail to satisfy four criteria: learnability, nonprior, nontruncation, and explicitness. In this paper, we present an attentive kernel-based value function approximation as a learnable, nonprior, nontruncated, and explicit sparse representation. We propose the online attentive kernel-based temporal difference (OAKTD) algorithm, which employs twotimescale optimization, and provide a convergence analysis for our proposed algorithm. Experimental results show that OAKTD outperforms online kernel-based TD learning algorithms, and the TD learning algorithm with Tile Coding on classical tasks, i.e., Mountain Car, Acrobot, CartPole and Puddle World. (c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Online kernel-based reinforcement learning
Catastrophic forgetting or interference
Sparse representation
Attentive function
Two-timescale optimization
Stability analysis
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

err分享
err收藏
Evidence for a Ubiquitous Seismic Discontinuity at the Base of the Mantle
err1999-11-12
err0
PREAI
errIgor Sidorin; Michael Gurnis; Don V. Helmberger
err分享
err收藏
err分享
err收藏
Current status of materials development of nuclear fuel cladding tubes for light water reactors
err2017-05-01
err0
PREAI
errZhengang Duan; Huilong Yang; Yuhki Satoh; Kenta Murakami; Sho Kano; Zishou Zhao; Jingjie Shen; Hiroaki Abe
err分享
err收藏
学者 查看更多内容