arrow
Return

Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems

delete2021-01-01
delete157
delete
OA
AI
Y
Ying Zhang
X
Xinan Wang
J
Jianhui Wang *
Y
Yingchen Zhang
DOI:10.1109/TSG.2020.3010130delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper develops a model-free volt-VAR optimization (VVO) algorithm via multi-agent deep reinforcement learning (DRL) in unbalanced distribution systems. This method is novel since we cast the VVO problem in distribution networks to an intelligent deep Q-network (DQN) framework, which avoids solving a specific optimization model directly when facing time-varying operating conditions in the systems. We consider statuses/ratios of switchable capacitors, voltage regulators, and smart inverters installed at distributed generators as the action variables of the agents. A delicately designed reward function guides these agents to interact with the distribution system, in the direction of reinforcing voltage regulation and power loss reduction simultaneously. The forward-backward sweep method for radial three-phase distribution systems provides accurate power flow results within a few iterations to the DRL environment. The proposed method realizes the dual goals for VVO. We test this algorithm on the unbalanced IEEE 13-bus and 123-bus systems. Numerical simulations validate the excellent performance of this method in voltage regulation and power loss reduction.
Keywords:
Voltage control
Inverters
Load modeling
Computational modeling
Optimization
Machine learning
Adaptation models
Volt-VAR optimization
deep reinforcement learning
artificial intelligence
voltage regulation
unbalanced distribution systems
smart inverter
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Smart Grid cover
IEEE Transactions on Smart Grid
IF:
9.8
Papers:
5.7K
Citations:
4.3W

Organization

U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
S
Southern Methodist University
Scholars:
3.0K
Papers: 3.5K
Citations: 3.9K