arrow
返回

A reactive power optimization partially observable Markov decision process with data uncertainty using multi-agent actor-attention-critic algorithm

delete2023-05-01
delete6
PRE
AI
Y
Yaru Gu
X
Xueliang Huang *
DOI:10.1016/j.ijepes.2022.108848delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present an innovative partially observable Markov decision process (POMDP) modelling method for the reactive power optimization process of the active distribution network (ADN) under the high permeability of the distributed generation. This model is tolerant of the uncertainty resulting from data uncertainty. We believe that the belief state space in the POMDP model corresponds to the state space in the Markov decision process (MDP) model, and we apply the multi-agent actor-attention-critic (MAAC) reinforcement learning (RL) algorithm to the proposed model. This technique extracts the most effective information with the highest quality from the huge historical measurement database, hence enhancing the learning effectiveness of agents and the stability of the optimization strategy. We simulate reactive power optimization in a modified IEEE-33 nodes ADN and a modified IEEE-123nodes ADN. The simulation demonstrates the stability and economic superiority of the proposed approach under varying degrees of data uncertainty relative to previous RL algorithms based on the MDP model. The simulation demonstrates that the proposed POMDP model is more appropriate for the real operation of the partially observable distribution network than the MDP models. And the optimal strategy obtained by the proposed MAAC algorithm is reliable with deteriorating data quality.
Keyword:
Partially Observable Markov Decision Process (POMDP)
Reactive power dispatching optimization model
Voltage control
Data uncertainty
Multi-agent reinforcement learning algorithm

期刊

I
International Journal of Electrical Power and Energy Systems
IF:
5
论文数:
1.1W
被引数:
3.1W

机构

S
southeast university - china
学者数:
5.3W
论文数: 4.9W
被引数: 57
引用论文

引用论文

Design of rotated QAM mapper/demapper for the DVB-T2 standard
err2009-10-01
err0
PREAI
errMeng Li; Charbel Abdel Nour; Christophe Jego; Catherine Douillard
err分享
err收藏
Ezh2 loss in hematopoietic stem cells predisposes mice to develop heterogeneous malignancies in an Ezh1-dependent manner
err2015-09-03
err0
errOAAI
errMakiko Mochizuki-Kashio; Kazumasa Aoyama; Goro Sashida; Motohiko Oshima; Takahisa Tomioka; Tomoya Muto; Changshan Wang; Atsushi Iwama
err分享
err收藏
Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
err2020-01-01
err281
PREAI
errDuan, Jiajun; Shi, Di; Diao, Ruisheng; Li, Haifeng; Wang, Zhiwei; Zhang, Bei; Bian, Desong; Yi, Zhehan
err分享
err收藏
A low-complexity 2D signal space diversity solution for future broadcasting systems
err2015-06-01
err0
errOAAI
errJianxiao Yang; Kai Wan; Benoit Geller; Charbel Abdel Nour; Olivier Rioul; Catherine Douillard
err分享
err收藏
err分享
err收藏
THE [14C]DEOXYGLUCOSE METHOD FOR THE MEASUREMENT OF LOCAL CEREBRAL GLUCOSE UTILIZATION: THEORY, PROCEDURE, AND NORMAL VALUES IN THE CONSCIOUS AND ANESTHETIZED ALBINO RAT1
err2006-10-04
err0
PREAI
errL. Sokoloff; M. Reivich; C. Kennedy; M. H. Des Rosiers; C. S. Patlak; K. D. Pettigrew; O. Sakurada; M. Shinohara
err分享
err收藏
学者 查看更多内容