.png){kind=icon}
Return
Online estimation of objective function for continuous-time deterministic systems
.png){kind=icon}
OA
AI
DOI：10.1016/j.neunet.2024.106116.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
We developed two online data -driven methods for estimating an objective function in continuous -time linear and nonlinear deterministic systems. The primary focus addressed the challenge posed by unknown input dynamics (control mapping function) in the expert system, a critical element for an online solution of the problem. Our methods leverage both the learner's and expert's data for effective problem -solving. The first approach, which is model -free, estimates the expert's policy and integrates it into the learner agent to approximate the objective function associated with the optimal policy. The second approach estimates the input dynamics from the learner's data and combines it with the expert's input -state observations to tackle the objective function estimation problem. Compared to other methods for deterministic systems that rely on both the learner's and expert's data, our approaches offer reduced complexity by eliminating the need to estimate an optimal policy after each objective function update. We conduct a convergence analysis of the estimation techniques using Lyapunov-based methods. Numerical experiments validate the effectiveness of our developed methods.
Keywords:
Objective function estimation
Deterministic systems
Data-driven solution
Continuous-time systems
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6.3
Papers:
8.2K
Citations:
3.0W
Organization
No organization information available
Cited Papers
ShareSaveShareSaveA novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems.png)
AUTOMATICA
AUTOMATICAIF5.9
PREAI
ShareSaveShareSaveEfficient model-based reinforcement learning for approximate online optimal controlAUTOMATICAOAAI
AUTOMATICAIF5.9
OAAIShareSave
View more