arrow
返回

Performance Evaluation of Direct Heuristic Dynamic Programming using Control-Theoretic Measures

delete2009-01-15
delete13
PRE
AI
杨
杨磊 (Lei Yang) *
J
Jennie Si
K
Konstantinos Tsakalis
A
Armando A. Rodriguez
DOI:10.1007/s10846-008-9307-5delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Approximate dynamic programming (ADP) has been widely studied from several important perspectives: algorithm development, learning efficiency measured by success or failure statistics, convergence rate, and learning error bounds. Given that many learning benchmarks used in ADP or reinforcement learning studies are control problems, it is important and necessary to examine the learning controllers from a control-theoretic perspective. This paper makes use of direct heuristic dynamic programming (direct HDP) and three typical benchmark examples to introduce a unique analytical framework that can be applied to other learning control paradigms and other complex control problems. The sensitivity analysis and the linear quadratic regulator (LQR) design are used in the paper for two purposes: to quantify direct HDP performances and to provide guidance toward designing better learning controllers. The use of LQR however does not limit the direct HDP to be a learning controller that addresses nonlinear dynamic system control issues. Toward this end, applications of the direct HDP for nonlinear control problems beyond sensitivity analysis and the confines of LQR have been developed and compared whenever appropriate to an LQR design.
Keyword:
Approximate dynamic programming (ADP)
Direc t heuristic dynamic programming (direct HDP)
Linear quadratic regulator (LQR)
On-line learning control
Sensitivity and complementary sensitivity
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

J
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS
IF:
2.8
论文数:
3.9K
被引数:
6.9K

机构

A
Arizona State University
学者数:
2.7W
论文数: 2.5W
被引数: 4.2W
引用论文

引用论文

Complexity of D″ in the presence of slab‐debris and phase changes
err2006-03-04
err0
errOAAI
errDaoyuan Sun; Teh‐Ru Alex Song; Don Helmberger
err分享
err收藏
Formation of Multi-Branched Graft Copolymer by Coupling Reaction
err1975-03-01
err0
errOAAI
errKoji Ishizu; Takashi Fukutomi; Toshio Kakurai
err分享
err收藏
err分享
err收藏
A Long Term Clinical, I mmu no logical, and Histological Follow-Up Study of Patients with Goitrous Chronic Lymphocytic Thyroiditis
err1985-12-01
err0
PREAI
errYOSHIO HAYASHI; HAJIME TAMAI; SYUJI FUKATA; YOSHIHIKO HIROTA; SHOICHI KATAYAMA; KANJI KUMA; LINDY F. KUMAGAI; NAGATAKI SHIGENOBU
err分享
err收藏
没有更多内容