arrow
返回

Model-based reinforcement learning for approximate optimal regulation

delete2016-02-01
delete156
delete
OA
AI
R
Rushikesh Kamalapurkar
P
Patrick Walters
W
Warren E. Dixon *
DOI:10.1016/j.automatica.2015.10.039delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Reinforcement learning (RL)-based online approximate optimal control methods applied to deterministic systems typically require a restrictive persistence of excitation (PE) condition for convergence. This paper develops a concurrent learning (CL)-based implementation of model-based RL to solve approximate optimal regulation problems online under a PE-like rank condition. The development is based on the observation that, given a model of the system, RL can be implemented by evaluating the Bellman error at any number of desired points in the state space. In this result, a parametric system model is considered, and a CL-based parameter identifier is developed to compensate for uncertainty in the parameters. Uniformly ultimately bounded regulation of the system states to a neighborhood of the origin, and convergence of the developed policy to a neighborhood of the optimal policy are established using a Lyapunov-based analysis, and simulation results are presented to demonstrate the performance of the developed controller. (C) 2015 Elsevier Ltd. All rights reserved.
Keyword:
Model-based reinforcement learning
Concurrent learning
Simulated experience
Data-based control
Adaptive control
System identification
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.8W
论文数: 10.9W
被引数: 130
引用论文

引用论文

err分享
err收藏
Robust Identification-Based State Derivative Estimation for Nonlinear Systems
err2013-01-01
err35
PREAI
errBhasin, Shubhendu; Kamalapurkar, Rushikesh; Dinh, Huyen T.; Dixon, Warren E.
err分享
err收藏
学者 查看更多内容