arrow
返回

Model-Free Dual Heuristic Dynamic Programming

delete2015-08-01
delete80
PRE
AI
Z
Zhen Ni *
H
Haibo He
X
X. Zhong
D
Danil Prokhorov
DOI:10.1109/TNNLS.2015.2424971delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Model-based dual heuristic dynamic programming (MB-DHP) is a popular approach in approximating optimal solutions in control problems. Yet, it usually requires offline training for the model network, and thus resulting in extra computational cost. In this brief, we propose a model-free DHP (MF-DHP) design based on finite-difference technique. In particular, we adopt multilayer perceptron with one hidden layer for both the action and the critic networks design, and use delayed objective functions to train both the action and the critic networks online over time. We test both the MF-DHP and MB-DHP approaches with a discrete time example and a continuous time example under the same parameter settings. Our simulation results demonstrate that the MF-DHP approach can obtain a control performance competitive with that of the traditional MB-DHP approach while requiring less computational resources.
Keyword:
Action-dependent dual heuristic dynamic programming (DHP)
adaptive critic designs (ACDs)
adaptive dynamic programming (ADP)
online learning
reinforcement learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
toyota motor corporation
学者数:
1.3K
论文数: 1.3K
被引数: 2
U
University of Rhode Island
学者数:
5.0K
论文数: 4.5K
被引数: 6.3K
引用论文

引用论文

err分享
err收藏
Reactive power control of grid-connected wind farm based on adaptive dynamic programming
err2014-02-01
err82
PREAI
errTang, Yufei; He, Haibo; Ni, Zhen; Wen, Jinyu; Sui, Xianchao
err分享
err收藏
学者 查看更多内容