arrow
Return

Hybrid optimal impulse control

delete2022-06-01
delete4
PRE
AI
S
Siyu Lv *
J
Jie Xiong
DOI:10.1016/j.automatica.2022.110233delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper is concerned with an optimal impulse control problem under a hybrid diffusion (or, regime switching) model, where the state of the system consists of a number of diffusions coupled by a continuous-time finite-state Markov chain. The objective is to minimize the expected discounted cost from exerting the impulse control in the infinite horizon. Based on the dynamic programming principle (DPP), the value function of the hybrid optimal impulse control problem is shown to be the unique viscosity solution to the associated Hamilton-Jacobi-Bellman (HJB) equation, which is in the form of a coupled system of variational inequalities. Moreover, a verification theorem as the sufficient condition for optimality of a solution is also established. The optimal impulse control, indicates when and how it is optimal to intervene, is described by the obstacle part of the HJB equation. Finally, the general theoretical results are applied to an optimal cash management problem. The value function in closed-form and an explicit optimal policy are obtained, which exhibit clearly the effect of regime switching on the agent's decision.(C) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Optimal impulse control
Markov chain
HJB equation
Viscosity solution
Verification theorem

Journal

Automatica cover
Automatica
IF:
5.9
Papers:
1.2W
Citations:
5.2W

Organization

S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57