Relaxing dynamic programming

B. Lincoln

doi:10.1109/TAC.2006.878720

Return

Relaxing dynamic programming

2006-08-01

260

PRE

B. Lincoln *

Anders Rantzer

DOI：10.1109/TAC.2006.878720

Original

Original request for help

Save

Abstract

En 中文

The idea of dynamic programming is general and very simple, but the curse of dimensionality is often prohibitive and restricts the fields of application. This paper introduces a method to reduce the complexity by relaxing the demand for optimality. The distance from optimality is kept within prespecified bounds and the size of the bounds determines the computational complexity. Several computational examples are considered. The first is optimal switching between linear systems, with application to design of a dc/dc voltage converter. The second is optimal control of a linear system with piecewise linear cost with application to stock order control. Finally, the method is applied to a partially observable Markov decision problem (POMDP).

Keywords:

dynamic programming

nonlinear synthesis

optimal control

switching systems

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.