返回
Evolution-guided value iteration for optimal tracking control
DOI:10.1016/j.neucom.2024.127835.png)
摘要
En 中文
In this article, an evolution-guided value iteration (EGVI) algorithm is established to address optimal tracking problems for nonlinear nonaffine systems. Conventional adaptive dynamic programming algorithms rely on gradient information to improve the policy, which adheres to the first order necessity condition. Nonetheless, these methods encounter limitations when gradient information is intricate or system dynamics lack differentiability. In response to this challenge, evolutionary computation is leveraged by EGVI to search for the optimal policy without requiring an action network. The competition within the policy population serves as the driving force for policy improvement. Therefore, EGVI can effectively handle complex and non-differentiable systems. Additionally, this innovative method has the potential to enhance exploration efficiency and bolster the robustness of algorithms due to its population-based characteristics. Furthermore, the convergence of the algorithm and the stability of the policy are investigated based on the EGVI framework. Finally, the effectiveness of the established method is comprehensively demonstrated through two simulation experiments.
Keyword:
Adaptive critic designs
Adaptive dynamic programming
Evolutionary computation
Intelligent control
Optimal tracking
Reinforcement learning
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Advanced value iteration for discrete-time intelligent critic control: A survey离散时间智能评论家控制的高级值迭代: 一项调查
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
Discrete-Time Stable Generalized Self-Learning Optimal Control With Approximation Errors具有逼近误差的离散稳定广义自学习最优控制
System Stability of Learning-Based Linear Optimal Control With General Discounted Value Iteration具有一般折现值迭代的基于学习的线性最优控制的系统稳定性
Adaptive dynamic programming and optimal control of nonlinear nonaffine systems自适应动态规划与非线性非仿射系统的最优控制
AUTOMATICA
IF5.9

