arrow
返回

Compactly Restrictable Metric Policy Optimization Problems

delete2023-05-01
delete1
delete
OA
AI
V
Victor D. Dorobantu *
K
Kamyar Azizzadenesheli
Y
Yisong Yue
DOI:10.1109/TAC.2022.3217269delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
We study policy optimization problems for deterministic Markov decision processes (MDPs) with metric state and action spaces, which we refer to as metric policy optimization problems (MPOPs). Our goal is to establish theoretical results on the well-posedness of MPOPs that can characterize practically relevant continuous control systems. To do so, we define a special class of MPOPs called compactly restrictable MPOPs (CR-MPOPs), which are flexible enough to capture the complex behavior of robotic systems but specific enough to admit solutions using dynamic programming methods such as value iteration. We show how to arrive at CR-MPOPs using forward-invariance. We further show that our theoretical results on CR-MPOPs can be used to characterize feedback linearizable control affine systems.
Keyword:
Optimization
Aerospace electronics
Extraterrestrial measurements
Control systems
Robots
Reinforcement learning
Markov processes
Continuous Markov decision processes (MDPs)
optimal control
physical systems
reinforcement learning
sampled-data
selection theorems
value iteration

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

C
California Institute of Technology
学者数:
2.9W
论文数: 2.5W
被引数: 4.9W
P
Purdue University
学者数:
2.7W
论文数: 2.1W
被引数: 147
引用论文

引用论文

Preparations, solution conformations and molecular structures of N,N′‐ethylene‐bridged dipeptides and their derivatives
err2009-01-12
err0
PREAI
errYOSHITANE KOJIMA; YOUKO IKEDA; ETSUKO KUMATA; JOJI MARUO; AKIHIRO OKAMOTO; KEN HIROTSU; KOZO SHIBATA; AKIO OHSUKA
err分享
err收藏
Gaseous bromine and particulate lead, vanadium, and bromine in a polluted atmosphere
err2002-05-01
err0
PREAI
errJarvis L. Moyers; William H. Zoller; Robert A. Duce; Gerald L. Hoffman
err分享
err收藏
Crystallization and preliminary X-ray analysis of rat SHPS-1
err2006-02-10
err0
errOAAI
errAki Nagata; Hiroshi Ohnishi; Masato Yoshimura; Akira Ogawa; Sayuri Ujita; Hiroaki Adachi; Masato Okada; Takashi Matozaki; Atsushi Nakagawa
err分享
err收藏
Synthesis of new tetrazolyldienylphenothiazines as potential multidrug resistance inhibitory compounds
err2004-04-05
err0
errOAAI
errIldikó Nagy; Zsuzsanna Riedl; György Hajós; András Messmer; József Molnár
err分享
err收藏
学者 查看更多内容