arrow
Return

Enhancing reinforcement learning controllers with GAN-generated data and transfer learning

delete2025-12-31
delete0
PRE
AI
C
Chang Xu *
N
Naoki Hayashi
M
Masahiro Inuiguchi
DOI:10.1080/18824889.2025.2527471delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This study addresses the challenge of data scarcity in training reinforcement learning (RL) controllers for power system economic dispatch problems (EDP) by integrating Generative Adversarial Network (GAN)-generated synthetic data and transfer learning (TL). Traditional data collection for power systems may face limitations like privacy concerns hindering the performance of deep neural network-based controllers. To overcome this, a GAN-based framework is proposed to generate synthetic load demand data, preserving characteristics of real datasets. A TL technique is then employed to fine-tune a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent, pretrained in a synthetic environment, into a target environment with real-world data. Experiments evaluate three GAN-generated datasets, including scenarios with mode collapse, and compare results against regression-based data generation methods. Key findings demonstrate that even low-quality synthetic data, when combined with TL, significantly enhances RL performance. For instance, a mode-collapsed GAN model reduced test operation cost by 54.7% and power unbalance by 89.9% compared to a baseline TD3 agent. This work highlights the potential of synthetic data augmentation and TL in data-scarce power system applications, offering a viable pathway to improve controller performance without additional real-world data collection.
Keywords:
Economic dispatch
GAN
transfer learning
reinforcement learning
twin delayed DDPG

Journal

S
SICE Journal of Control Measurement and System Integration
IF:
0.5
Papers:
46
Citations:
0

Organization

U
university of osaka
Scholars:
1.5K
Papers: 516
Citations: 0
U
universiti malaya
Scholars:
4.2K
Papers: 1.8K
Citations: 0