arrow
Return

On Distributed Implementation of Switch-Based Adaptive Dynamic Programming

delete2022-07-01
delete19
delete
OA
AI
柳笛 (Di Liu)
S
Simone Baldi
W
Wenwu Yu *
陈光荣 (Guanrong Chen)
DOI:10.1109/TCYB.2020.3029825delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Switch-based adaptive dynamic programming (ADP) is an optimal control problem in which a cost must be minimized by switching among a family of dynamical modes. When the system dimension increases, the solution to switch-based ADP is made prohibitive by the exponentially increasing structure of the value function approximator and by the exponentially increasing modes. This technical correspondence proposes a distributed computational method for solving switch-based ADP. The method relies on partitioning the system into agents, each one dealing with a lower dimensional state and a few local modes. Each agent aims to minimize a local version of the global cost while avoiding that its local switching strategy has conflicts with the switching strategies of the neighboring agents. A heuristic algorithm based on the consensus dynamics and Nash equilibrium is proposed to avoid such conflicts. The effectiveness of the proposed method is verified via traffic and building test cases.
Keywords:
Switches
Neural networks
Games
Dynamic programming
Switched systems
Cybernetics
Consensus
distributed adaptive dynamic programming (ADP)
heuristic dynamic programming
optimal switching
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57
Cited Papers

Cited Papers

Neutron Optical Beam Splitter from Holographically Structured Nanoparticle-Polymer Composites
err2010-09-17
err0
errOAAI
errM. Fally; J. Klepp; Y. Tomita; T. Nakamura; C. Pruner; M. A. Ellabban; R. A. Rupp; M. Bichler; I. Drevenšek Olenik; J. Kohlbrecher; H. Eckerlebe; H. Lemmel; H. Rauch
errShare
errSave
Towards a wireless and fully-implantable ECoG system
err2013-06-01
err0
PREAI
errE. Tolstosheeva; J. Hoeffmann; J. Pistor; D. Rotermund; T. Schellenberg; D. Boll; T. Hertzberg; V. Gordillo-Gonzalez; S. Mandon; D. Peters-Drolshagen; M. Schneider; K. Pawelzik; A. Kreiter; S. Paul; W. Lang
errShare
errSave
Automating occupant-building interaction via smart zoning of thermostatic loads: A switched self-tuning approach
err2018-12-01
err88
errOAAI
errBaldi, Simone; Korkas, Christos D.; Lv, Maolong; Kosmatopoulos, Elias B.
errShare
errSave
Hierarchical Deep Reinforcement Learning for Continuous Action Control
err2018-11-01
err127
errOAAI
errYang, Zhaoyang; Merrick, Kathryn; Jin, Lianwen; Abbass, Hussein A.
errShare
errSave
researcher View more