arrow
Return

A Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement Learning

delete2020-11-01
delete204
PRE
AI
王胜一 cover
王胜一 (Shengyi Wang)
J
Jiajun Duan *
D
Di Shi
C
Chunlei Xu
李海锋 (Haifeng Li)
R
Ruisheng Diao
Z
Zhiwei Wang
DOI:10.1109/TPWRS.2020.2990179delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The complexity of modern power grids keeps increasing due to the expansion of renewable energy resources and the requirement of fast demand responses, which results in a great challenge for conventional power grid control systems. Existing autonomous control approaches for the power grid requires an accurate system model and a powerful computational platform, which is difficult to scale up for the large-scale energy system with more control options and operating conditions. Facing these challenges, this article proposes a data-driven multi-agent power grid control scheme using a deep reinforcement learning (DRL) method. Specifically, the classic autonomous voltage control (AVC) problem is taken as an example and formulated as a Markov Game with a heuristic method to partition agents. Then, a multi-agent AVC (MA-AVC) algorithm based on a multi-agent deep deterministic policy gradient (MADDPG) method that features centralized training and decentralized execution is developed to solve the AVC problem. The proposed method can learn from scratch and gradually master the system operation rules by input and output data. In order to demonstrate the effectiveness of the proposed MA-AVC algorithm, comprehensive case studies are conducted on an Illinois 200-Bus system considering load/generation changes, N-1 contingencies, and weak centralized communication environment.
Keywords:
Games
Automatic voltage control
Markov processes
Control systems
Power grids
Load modeling
Multi-agent system
autonomous voltage control
deep reinforcement learning
centralized training and decentralized executing control
data-driven
deep neural network
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Power Systems cover
IEEE Transactions on Power Systems
IF:
7.2
Papers:
1.1W
Citations:
5.0W

Organization

S
State Grid Corporation of China
Scholars:
6.5K
Papers: 5.2K
Citations: 1.7K
P
pennsylvania commonwealth system of higher education (pcshe)
Scholars:
12.9W
Papers: 11.7W
Citations: 177