.png){kind=icon}
返回
Adaptive Observation-Based Efficient Reinforcement Learning for Uncertain Systems
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2021.3070852.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article develops an adaptive observation-based efficient reinforcement learning (RL) approach for systems with uncertain drift dynamics. A novel concurrent learning adaptive extended observer (CL-AEO) is first designed to jointly estimate the system state and parameter. This observer has a two-time-scale structure and does not require any additional numerical techniques to calculate the state derivative information. The idea of concurrent learning (CL) is leveraged to use the recorded data, which leads to a relaxed verifiable excitation condition for the convergence of parameter estimation. Based on the estimated state and parameter provided by the CL-AEO, a simulation of experience-based RL scheme is developed to online approximate the optimal control policy. Rigorous theoretical analysis is given to show that the practical convergence of the system state to the origin and the developed policy to the ideal optimal policy can be achieved without the persistence of excitation (PE) condition. Finally, the effectiveness and superiority of the developed methodology are demonstrated via comparative simulations.
Keyword:
Optimal control
Observers
Adaptive systems
Adaptation models
Uncertain systems
Estimation
Data models
Adaptive observer
concurrent learning (CL)
optimal control
reinforcement learning (RL)
uncertain systems
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Data-based reinforcement learning approximate optimal control for an uncertain nonlinear system with control effectiveness faults.png)
AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design数据驱动的自适应最优控制设计的值迭代和自适应动态规划AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏Model-based reinforcement learning for approximate optimal regulation基于模型的强化学习的近似最优调节AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏Adaptive observer design for a class of nonlinear systems. Application to speed sensorless induction motorAUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏Adaptive dynamic programming and optimal control of nonlinear nonaffine systems自适应动态规划与非线性非仿射系统的最优控制AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏Adaptive optimal control for continuous-time linear systems based on policy iteration基于策略迭代的连续时间线性系统自适应最优控制AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏
查看更多内容