arrow
返回

Performance Guarantees for Model-Based Approximate Dynamic Programming in Continuous Spaces

delete2020-01-01
delete12
delete
OA
AI
P
Paul N. Beuchat *
A
Angelos Georghiou
J
John Lygeros
DOI:10.1109/TAC.2019.2906423delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We study both the value function and Q-function formulation of the linear programming approach to approximate dynamic programming. The approach is model based and optimizes over a restricted function space to approximate the value function or Q-function. Working in the discrete time, continuous space setting, we provide guarantees for the fitting error and online performance of the policy. In particular, the online performance guarantee is obtained by analyzing an iterated version of the greedy policy, and the fitting error guarantee by analyzing an iterated version of the Bellman inequality. These guarantees complement the existing bounds that appear in the literature. The Q-function formulation offers benefits, for example, in the decentralized controller design, however, it can lead to computationally demanding optimization problems. To alleviate this drawback, we provide a condition that simplifies the formulation, resulting in improved computational times.
Keyword:
Aerospace electronics
Dynamic programming
Optimal control
Numerical models
Linear programming
Stochastic processes
Mathematical model
Discrete-time systems
dynamic programming
infinite horizon optimal control
stochastic systems
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

E
ETH Zurich
学者数:
3.0W
论文数: 2.4W
被引数: 8.4W
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
引用论文

引用论文

Opening Platforms: How, When and Why?
err2008-01-01
err0
PREAI
errThomas R. Eisenmann; Geoffrey Parker; Marshall W. Van Alstyne
err分享
err收藏
Introduction
err2005-06-01
err0
PREAI
errD. F. Barbe
err分享
err收藏
err分享
err收藏
err分享
err收藏
Similarity Measures and Dimensionality Reduction Techniques for Time Series Data Mining
err2012-09-12
err0
errOAAI
errCarmelo Cassisi; Placido Montalto; Marco Aliotta; Andrea Cannata; Alfredo Pulvirenti
err分享
err收藏
学者 查看更多内容