arrow
返回

Graph Multi-Agent Reinforcement Learning for Inverter-Based Active Voltage Control

delete2024-03-01
delete3
PRE
AI
穆朝絮 封面图
穆朝絮 (Chaoxu Mu) *
Z
Zhaoyang Liu
J
Jun Yan
贾宏杰 封面图
贾宏杰 (Hongjie Jia)
X
Xiaoyu Zhang
DOI:10.1109/TSG.2023.3298807delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Active voltage control (AVC) is a widely-used technique to improve voltage quality essential in the emerging active distribution networks (ADNs). However, the voltage fluctuation caused by intermittent renewable energy makes it difficult for traditional voltage control methods to deal with. In this paper, the voltage control problem is formulated as a decentralized partial observable Markov decision process (Dec-POMDP), and a multi-agent reinforcement learning (MARL) algorithm is developed considering each controllable device as an agent. The new formulation aims to adjust the strategies of agents to stabilize the voltage within the specified range and reduce the network loss. To better represent the mutual interaction between the agents, a graph convolutional network (GCN) is introduced. By aggregating the information of adjacent agents, complex latent features are effectively extracted by the GCN, hence promotes the generation of voltage control strategy for the agents. Meanwhile, a barrier function is applied in MARL to ensure the system voltage within a safe operation range. Comparative studies are conducted with traditional voltage control and other MARL methods on IEEE 33-bus and 141-bus systems, which demonstrate the performance of the proposed approach.
Keyword:
Automatic voltage control
Topology
Power system stability
Training
Reinforcement learning
Distribution networks
Reactive power
Active voltage control
multi-agent reinforcement learning
graph convolutional network
barrier function
distribution network

期刊

IEEE Transactions on Smart Grid 封面图
IEEE Transactions on Smart Grid
IF:
9.8
论文数:
5.7K
被引数:
4.3W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
C
concordia university - canada
学者数:
8.0K
论文数: 8.9K
被引数: 4
A
anhui university
学者数:
1.9W
论文数: 1.2W
被引数: 24
学者 查看更多机构
引用论文

引用论文

A Fully Distributed Reactive Power Optimization and Control Method for Active Distribution Networks
err2015-01-01
err330
PREAI
errZheng, Weiye; Wu, Wenchuan; Zhang, Boming; Sun, Hongbin; Liu, Yibing
err分享
err收藏
Optimal Tap Setting of Voltage Regulation Transformers Using Batch Reinforcement Learning
err2020-05-01
err114
errOAAI
errXu, Hanchen; Dominguez-Garcia, Alejandro D.; Sauer, Peter W.
err分享
err收藏
Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
err2020-01-01
err281
PREAI
errDuan, Jiajun; Shi, Di; Diao, Ruisheng; Li, Haifeng; Wang, Zhiwei; Zhang, Bei; Bian, Desong; Yi, Zhehan
err分享
err收藏
Optimal distribution voltage control and coordination with distributed generation
err2008-04-01
err339
PREAI
errSenjyu, Tomonobu; Miyazato, Yoshitaka; Yona, Atsushi; Urasaki, Naomitsu; Funabashi, Toshihisa
err分享
err收藏
Robust-SL0 for stable sparse representation in noisy settings
err2009-04-01
err0
errOAAI
errArmin Eftekhari; Massoud Babaie-Zadeh; Christian Jutten; Hamid Abrishami Moghaddam
err分享
err收藏
学者 查看更多内容