arrow
Return

TD3 Algorithm Based Reinforcement Learning Control for Multiple-Input Multiple-Output DC-DC Converters

delete2024-10-01
delete0
PRE
AI
J
Jian Ye *
H
Huanyu Guo
D
Di Zhao
B
Benfei Wang
X
Xinan Zhang
DOI:10.1109/TPEL.2024.3416911delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article presents a reinforcement learning (RL) controller based on the twin delayed deep deterministic (TD3) policy gradient algorithm for single-inductor multiple-input multiple-output (SI-MIMO) dc-dc converters. The controller aims to address the power allocation challenges arising from parallel input sources and mitigate cross-regulation among multiple output channels. The objective is to enable the converter to exhibit outstanding performance in both steady-state and dynamic regulation during operation. The proposed RL controller is trained using the TD3 algorithm. It directly generates duty cycle control signals based on the observed states from the controlled converter. After applying input-side power allocation modulation and output-side time-multiplexing modulation, the controller generates the switching signals for each switch, completing the closed-loop control of the SI-MIMO converter. To validate the effectiveness of the proposed controller, stability analysis of the RL controller is conducted, and an experimental platform is established. Experimental results demonstrate that the proposed controller exhibits superior control performance. It effectively addresses the challenges associated with input-side power allocation and output voltage cross-regulation in SI-MIMO dc-dc converters.
Keywords:
Modulation
Switches
Resource management
Multiplexing
DC-DC power converters
Steady-state
Vectors
Cross-regulation
multiport dc-dc converters
reinforcement learning (RL)

Journal

IEEE Transactions on Power Electronics cover
IEEE Transactions on Power Electronics
IF:
6.5
Papers:
1.7W
Citations:
8.3W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
U
University of Western Australia
Scholars:
2.9W
Papers: 3.0W
Citations: 46
S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
researcher View more organizations
Cited Papers

Cited Papers

The mechanism of propylene disproportionation
err1969-12-01
err0
PREAI
errAlfred Clark; Courtney Cook
errShare
errSave
A Novel Intelligent Nonlinear Controller for Dual Active Bridge Converter With Constant Power Loads
err2023-03-01
err24
PREAI
errMeng, Xiangqi; Jia, Yanbing; Xu, Qianwen; Ren, Chunguang; Han, Xiaoqing; Wang, Peng
errShare
errSave
Learning-Based Neural Dynamic Surface Predictive Control for MMC
err2023-01-01
err14
PREAI
errLiu, Xing; Qiu, Lin; Rodriguez, Jose; Wang, Kui; Li, Yongdong; Fang, Youtong
errShare
errSave
errShare
errSave
Practical Multi-Mesh Registration for Few-View Poly-Chromatic X-Ray Inspection
err2024-05-11
err0
errOAAI
errDomenico Iuso; Pavel Paramonov; Jan De Beenhouwer; Jan Sijbers
errShare
errSave
Killing, Letting Die, and the Trolley Problem
err1976-01-01
err0
PREAI
errJudith Jarvis Thomson
errShare
errSave
A Digital Method of Power-Sharing and Cross-Regulation Suppression for Single-Inductor Multiple-Input Multiple-Output DC-DC Converter
err2017-04-01
err78
PREAI
errWang, Benfei; Xian, Liang; Kanamarlapudi, Venkata Ravi Kishore; Tseng, King Jet; Ukil, Abhisek; Gooi, Hoay Beng
errShare
errSave
researcher View more