返回
Online adaptive optimal control algorithm based on synchronous integral reinforcement learning with explorations
DOI:10.1016/j.neucom.2022.11.055.png)
摘要
En 中文
In this study, we present a novel algorithm, based on synchronous policy iteration, to solve the continuous-time infinite-horizon optimal control problem of input affine system dynamics. The integral reinforcement is measured as an excitation signal to estimate the solution to the Hamilton-Jacobi-Bell man equation. In addition, the proposed method is completely model-free, that is, no a priori knowledge of the system is required. Using the adaptive tuning law, the actor and critic neural networks can simultaneously approximate the optimal value function and policy. The persistence of excitation condition is required to guarantee the convergence of the two networks. Unlike in traditional policy iteration algorithms, the restriction of the initial admissible policy was eliminated using this method. The effectiveness of the proposed algorithm is verified through numerical simulations. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Reinforcement learning
Neural networks
Adaptive control
Actor -critic
Explorations
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Adaptive optimal control for continuous-time linear systems based on policy iteration基于策略迭代的连续时间线性系统自适应最优控制
AUTOMATICA
IF5.9
Reinforcement Learning and Adaptive Optimal Control for Continuous-Time Nonlinear Systems: A Value Iteration Approach连续时间非线性系统的强化学习和自适应最优控制: 一种值迭代方法
A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems一种用于不确定非线性系统的近似最优控制的新型参与者-批评者-标识符体系结构
AUTOMATICA
IF5.9
Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach使用神经网络HJB方法对具有饱和执行器的非线性系统进行近乎最优的控制律
AUTOMATICA
IF5.9

