.png){kind=icon}
返回
Learning Constrained Parametric Differentiable Predictive Control Policies With Guarantees
.png){kind=icon}
OA
AI
DOI：10.1109/TSMC.2024.3368026.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We present differentiable predictive control (DPC), a method for offline learning of constrained neural control policies for nonlinear dynamical systems with performance guarantees. We show that the sensitivities of the parametric optimal control problem can be used to obtain direct policy gradients. Specifically, we employ automatic differentiation (AD) to efficiently compute the sensitivities of the model predictive control (MPC) objective function and constraints penalties. To guarantee safety upon deployment, we derive probabilistic guarantees on closed-loop stability and constraint satisfaction based on indicator functions and Hoeffding's inequality. We empirically demonstrate that the proposed method can learn neural control policies for various parametric optimal control tasks. In particular, we show that the proposed DPC method can stabilize systems with unstable dynamics, track time-varying references, and satisfy nonlinear state and input constraints. Our DPC method has practical time savings compared to alternative approaches for fast and memory-efficient controller design. Specifically, DPC does not depend on a supervisory controller as opposed to approximate MPC based on imitation learning. We demonstrate that, without losing performance, DPC is scalable with greatly reduced demands on memory and computation compared to implicit and explicit MPC while being more sample efficient than model-free reinforcement learning (RL) algorithms.
Keyword:
Predictive control
Optimization
Computational modeling
Programming
Sensitivity
Optimal control
Closed loop systems
Differentiable programming
learning for control
parametric optimal control
policy optimization (PO)
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
.png){kind=icon}
分享收藏Types of Parent Verbal Responsiveness That Predict Language in Young Children With Autism Spectrum Disorder预测自闭症谱系障碍幼儿语言的父母言语反应类型
OAAI
OAAI分享收藏Offline and Online Adaptive Critic Control Designs With Stability Guarantee Through Value Iteration
PREAI
分享收藏Efficient Representation and Approximation of Model Predictive Control Laws via Deep Learning基于深度学习的模型预测控制律的有效表示和逼近OAAI
OAAI分享收藏CasADi: a software framework for nonlinear optimization and optimal controlCasADi: 非线性优化和最优控制的软件框架
PREAI
分享收藏
查看更多内容