arrow
返回

Solving optimal predictor-feedback control using approximate dynamic programming

delete2024-12-01
delete0
PRE
AI
H
Hongxia Wang
F
Fuyu Zhao
Z
Zhaorong Zhang *
J
Juanjuan Xu
X
Xun Li
DOI:10.1016/j.automatica.2024.111848delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper is concerned with approximately solving the optimal predictor-feedback control problem of multiplicative-noise systems with input delay in infinite horizon. The optimal predictor-feedback control, provided by the analytical method, is determined by Riccati-ZXL equations and is hard to obtain in the case of unknown system dynamics. We aim to propose a policy iteration (PI) algorithm for solving the optimal solution by approximate dynamic programming. For convergence analysis of the algorithm, we first develop a necessary and sufficient stabilizing condition, in the form of several new Lyapunov-type equations, which parameterizes all predictor-feedback controllers and can be seen as an important addition to Lyapunov stability theory. We then propose an iterative scheme for the Riccati-ZXL equations computations, along with convergence analysis, based on the condition. Inspired by this scheme, a data-driven online PI algorithm, convergence implied in that of the iterative scheme, is proposed for the optimal predictor-feedback control problem without full system dynamics. Finally, a numerical example is used to evaluate the proposed PI algorithm. (c) 2024 Published by Elsevier Ltd.
Keyword:
Stochastic system
Optimal control
Input delay
Approximate dynamic programming

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
引用论文

引用论文

S1-Leitlinie Post-COVID/Long-COVIDS1-Leitlinie后COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
err分享
err收藏
Recent Advancements in Deep Learning Frameworks for Precision Fish Farming Opportunities, Challenges, and Applications
err2023-02-07
err0
errOAAI
errGaganpreet Kaur; Nirmal Adhikari; Singamaneni Krishnapriya; Surindar Gopalrao Wawale; R. Q. Malik; Abu Sarwar Zamani; Julian Perez-Falcon; Jonathan Osei-Owusu
err分享
err收藏
err分享
err收藏
Risk assessment of potentially toxic elements in intermittent rivers, “fiumara”, flowing in the Gulf of Milazzo (Sicily, Italy)
err2024-05-10
err0
PREAI
errGiuseppa Di Bella; Abdelbaset S. El-Sorogy; Salvatore Giacobbe; Vincenzo Nava; Khaled Al-Kahtany; Hamdy E. Nour
err分享
err收藏
340,000-Year Centennial-Scale Marine Record of Southern Hemisphere Climatic Oscillation
err2003-08-15
err0
PREAI
errKatharina Pahnke; Rainer Zahn; Henry Elderfield; Michael Schulz
err分享
err收藏
学者 查看更多内容