arrow
Return

Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design

delete2016-09-01
delete202
delete
OA
AI
T
Tao Bian *
Z
Zhong‐Ping Jiang
DOI:10.1016/j.automatica.2016.05.003delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper presents a novel non-model-based, data-driven adaptive optimal controller design for linear continuous-time systems with completely unknown dynamics. Inspired by the stochastic approximation theory, a continuous-time version of the traditional value iteration (VI) algorithm is presented with rigorous convergence analysis. This VI method is crucial for developing new adaptive dynamic programming methods to solve the adaptive optimal control problem and the stochastic robust optimal control problem for linear continuous-time systems. Fundamentally different from existing results, the a priori knowledge of an initial admissible control policy is no longer required. The efficacy of the proposed methodology is illustrated by two examples and a brief comparative study between VI and earlier policy iteration methods. (C) 2016 Elsevier Ltd. All rights reserved.
Keywords:
Value iteration
Adaptive dynamic programming
Optimal control
Adaptive control
Stochastic approximation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Automatica cover
Automatica
IF:
5.9
Papers:
1.2W
Citations:
5.2W

Organization

N
New York University
Scholars:
4.4W
Papers: 3.9W
Citations: 5.8W
Cited Papers

Cited Papers

Interaction between Benzene and N-Monosubstituted Amides
err1959-11-01
err0
PREAI
errI. Suzuki; M. Tsuboi; T. Shimanouchi; S. Mizushima
errShare
errSave
Use of Amazonian Forest Fragments by Understory Insectivorous Birds
err1995-12-01
err0
PREAI
errPhilip C. Stouffer; Richard O. Bierregaard
errShare
errSave
Adaptive dynamic programming and optimal control of nonlinear nonaffine systems
err2014-10-01
err188
PREAI
errBian, Tao; Jiang, Yu; Jiang, Zhong-Ping
errShare
errSave
Adaptive optimal control for continuous-time linear systems based on policy iteration
err2009-02-01
err671
PREAI
errVrabie, D.; Pastravanu, O.; Abu-Khalaf, M.; Lewis, F. L.
errShare
errSave
Principles of sensorimotor learning
err2011-10-27
err987
errOAAI
errWolpert, Daniel M.; Diedrichsen, Joern; Flanagan, J. Randall
errShare
errSave
Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
err2012-08-01
err350
PREAI
errWang, Ding; Liu, Derong; Wei, Qinglai; Zhao, Dongbin; Jin, Ning
errShare
errSave
researcher View more