arrow
返回

Off-Policy Reinforcement Learning for H∞ Control Design

delete2015-01-01
delete305
PRE
AI
B
Biao Luo *
H
Huai‐Ning Wu
T
Tingwen Huang
DOI:10.1109/TCYB.2014.2319577delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The H-infinity control design problem is considered for nonlinear systems with unknown internal system model. It is known that the nonlinear H-infinity control problem can be transformed into solving the so-called Hamilton-Jacobi-Isaacs (HJI) equation, which is a nonlinear partial differential equation that is generally impossible to be solved analytically. Even worse, model-based approaches cannot be used for approximately solving HJI equation, when the accurate system model is unavailable or costly to obtain in practice. To overcome these difficulties, an off-policy reinforcement leaning (RL) method is introduced to learn the solution of HJI equation from real system data instead of mathematical system model, and its convergence is proved. In the off-policy RL method, the system data can be generated with arbitrary policies rather than the evaluating policy, which is extremely important and promising for practical systems. For implementation purpose, a neural network (NN)-based actor-critic structure is employed and a least-square NN weight update algorithm is derived based on the method of weighted residuals. Finally, the developed NN-based off-policy RL method is tested on a linear F16 aircraft plant, and further applied to a rotational/translational actuator system.
Keyword:
H-infinity control design
Hamilton-Jacobi-Isaacs equation
neural network
off-policy learning
reinforcement learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
引用论文

引用论文

Surface modification processes on European Union bronze reference materials for analytical studies of cultural artefacts
err2002-10-25
err0
errOAAI
errT. Beldjoudi; F. Bardet; N. Lacoudre; S. Andrieu; A. Adriaens; I. Constantinides; P. Brunella
err分享
err收藏
The Effect of Haptic Support Systems on Driver Performance: A Literature Survey
err2015-10-01
err0
errOAAI
errSebastiaan M. Petermeijer; David A. Abbink; Mark Mulder; Joost C. F. de Winter
err分享
err收藏
学者 查看更多内容