arrow
Return

GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming

delete2015-03-01
delete82
PRE
AI
Z
Zhen Ni *
H
Haibo He
D
Dongbin Zhao
徐鑫 cover
徐鑫 (Xin Xu)
D
Danil Prokhorov
DOI:10.1109/TNNLS.2014.2329942delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A general utility function representation is proposed to provide the required derivable and adjustable utility function for the dual heuristic dynamic programming (DHP) design. Goal representation DHP (GrDHP) is presented with a goal network being on top of the traditional DHP design. This goal network provides a general mapping between the system states and the derivatives of the utility function. With this proposed architecture, we can obtain the required derivatives of the utility function directly from the goal network. In addition, instead of a fixed predefined utility function in literature, we conduct an online learning process for the goal network so that the derivatives of the utility function can be adaptively tuned over time. We provide the control performance of both the proposed GrDHP and the traditional DHP approaches under the same environment and parameter settings. The statistical simulation results and the snapshot of the system variables are presented to demonstrate the improved learning and controlling performance. We also apply both approaches to a power system example to further demonstrate the control capabilities of the GrDHP approach.
Keywords:
Adaptive control
adaptive dynamic programming (ADP)
dual heuristic dynamic programming (DHP)
general utility function
goal representation
reinforcement learning (RL)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

I
institute of automation, cas
Scholars:
2.2K
Papers: 2.1K
Citations: 2
U
University of Rhode Island
Scholars:
5.0K
Papers: 4.5K
Citations: 6.3K
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
C
chinese academy of sciences
Scholars:
56.0W
Papers: 44.8W
Citations: 704
researcher View more organizations