返回
Model-based reinforcement learning for approximate optimal regulation
DOI:10.1016/j.automatica.2015.10.039.png)
摘要
En 中文
Reinforcement learning (RL)-based online approximate optimal control methods applied to deterministic systems typically require a restrictive persistence of excitation (PE) condition for convergence. This paper develops a concurrent learning (CL)-based implementation of model-based RL to solve approximate optimal regulation problems online under a PE-like rank condition. The development is based on the observation that, given a model of the system, RL can be implemented by evaluating the Bellman error at any number of desired points in the state space. In this result, a parametric system model is considered, and a CL-based parameter identifier is developed to compensate for uncertainty in the parameters. Uniformly ultimately bounded regulation of the system states to a neighborhood of the origin, and convergence of the developed policy to a neighborhood of the optimal policy are established using a Lyapunov-based analysis, and simulation results are presented to demonstrate the performance of the developed controller. (C) 2015 Elsevier Ltd. All rights reserved.
Keyword:
Model-based reinforcement learning
Concurrent learning
Simulated experience
Data-based control
Adaptive control
System identification
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.9
论文数:
1.2W
被引数:
5.2W
机构
引用论文
Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems
AUTOMATICA
IF5.9
Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks基于策略迭代和神经网络的未知约束输入系统的自适应最优控制
A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems一种用于不确定非线性系统的近似最优控制的新型参与者-批评者-标识符体系结构
AUTOMATICA
IF5.9
Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton-Jacobi equations多人非零和游戏: 耦合hamilton-jacobi方程的在线自适应学习解决方案
AUTOMATICA
IF5.9
Min-max vs. max-min flow control algorithms for optimal computer network capacity assignment优化计算机网络容量分配的最小-最大vs.最大-最小流量控制算法


