arrow
Return

Evolution-guided value iteration for optimal tracking control

delete2024-08-01
delete0
PRE
AI
H
Haiming Huang
王
王丁 (Ding Wang) *
M
Mingming Zhao
Q
Qinna Hu
DOI:10.1016/j.neucom.2024.127835delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, an evolution-guided value iteration (EGVI) algorithm is established to address optimal tracking problems for nonlinear nonaffine systems. Conventional adaptive dynamic programming algorithms rely on gradient information to improve the policy, which adheres to the first order necessity condition. Nonetheless, these methods encounter limitations when gradient information is intricate or system dynamics lack differentiability. In response to this challenge, evolutionary computation is leveraged by EGVI to search for the optimal policy without requiring an action network. The competition within the policy population serves as the driving force for policy improvement. Therefore, EGVI can effectively handle complex and non-differentiable systems. Additionally, this innovative method has the potential to enhance exploration efficiency and bolster the robustness of algorithms due to its population-based characteristics. Furthermore, the convergence of the algorithm and the stability of the policy are investigated based on the EGVI framework. Finally, the effectiveness of the established method is comprehensively demonstrated through two simulation experiments.
Keywords:
Adaptive critic designs
Adaptive dynamic programming
Evolutionary computation
Intelligent control
Optimal tracking
Reinforcement learning

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W
Cited Papers

Cited Papers

Advanced value iteration for discrete-time intelligent critic control: A survey
err2023-05-21
err35
PREAI
errZhao, Mingming; Wang, Ding; Qiao, Junfei; Ha, Mingming; Ren, Jin
errShare
errSave
Adaptive dynamic programming and optimal control of nonlinear nonaffine systems
err2014-10-01
err188
PREAI
errBian, Tao; Jiang, Yu; Jiang, Zhong-Ping
errShare
errSave
errShare
errSave
researcher View more