Approximate constrained stochastic optimal control via parameterized input inference

Shahbaz P Qadri Syed

doi:10.1016/j.automatica.2024.111978

2025-01-01

PRE

Shahbaz P Qadri Syed

何

何柏 (He Bai) *

DOI：10.1016/j.automatica.2024.111978

原文链接

摘要

En 中文

Approximate methods to solve stochastic optimal control (SOC) problems have received significant interest from researchers in the past decade. Probabilistic inference approaches to SOC have been developed to solve nonlinear quadratic Gaussian problems. In this work, we propose an Expectation- Maximization (EM) based inference procedure to generate state-feedback controls for constrained SOC problems. We consider the inequality constraints for the state and controls and also the structural constraints for the controls. We employ barrier functions to address state and control constraints. We show that the expectation step leads to smoothing of the state-control pair while the maximization step on the non-zero subsets of the control parameters allows inference of structured stochastic optimal controllers. We demonstrate the effectiveness of the algorithm on unicycle obstacle avoidance and four-unicycle formation control examples. In these examples, we perform an empirical study on the parametric effect of barrier functions on the state constraint satisfaction. We also present a comparative study of smoothing algorithms on the performance of the proposed approach. (c) 2024 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.

Keyword:

Inference-based control

Structured control

Parametric optimization

Multi-agent systems

Stochastic control