.png){kind=icon}
返回
A kernel-based approximate dynamic programming approach: Theory and application
.png){kind=icon}
PRE
AI
DOI：10.1016/j.automatica.2024.111517.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article proposes a novel kernel -based Dynamic Programming (DP) approximation method to tackle the typical curse of dimensionality of stochastic DP problems over the finite time horizon. Such a method utilizes kernel functions in combination with Support Vector Machine (SVM) regression to determine an approximate cost function for the entire state space of the underlying Markov Decision Process (MDP), by leveraging cost function computed for selected representative states. Kernel functions are used to define the so-called kernel matrix, while the parameter vector of the given kernel -based cost function approximation is computed by moving backwards in time from the terminal condition and by applying SVM regression. This way, the difficulty of selecting a proper set of features is also tackled. The proposed method is then extended to the infinite time horizon case. To show the effectiveness of the proposed approach, the resulting Recursive Residual Approximate Dynamic Programming (RR -ADP) algorithm is applied to the sensor scheduling design in multi -process remote state estimation problems. (c) 2024 Elsevier Ltd. All rights reserved.
Keyword:
Dynamic Programming
Markov Decision Process
Approximate Dynamic Programming
Kernel function
Support Vector Machine
Sensor scheduling
期刊
IF:
5.9
论文数:
1.2W
被引数:
6.0W
机构
引用论文
On the Development and Applications of Cellulosic Nanofibrillar and Nanocrystalline Materials纤维素纳米原纤和纳米晶材料的发展与应用
PREAI
分享收藏分享收藏Feature-Based Aggregation and Deep Reinforcement Learning: A Survey and Some New Implementations
OAAI
OAAI分享收藏Transmission scheduling for multi-process multi-sensor remote estimation via approximate dynamic programming.png)
AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏分享收藏
查看更多内容