.png){kind=icon}
返回
A Cloud-Edge Collaboration Solution for Distribution Network Reconfiguration Using Multi-Agent Deep Reinforcement Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TPWRS.2023.3296463.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Network reconfiguration can maintain the optimal operation of distribution network with increasing penetration of distributed generations (DGs). However, network reconfiguration problems may not be solved quickly by traditional methods in large-scale distribution networks. In this context, a cloud-edge collaboration framework based on multi-agent deep reinforcement learning (MADRL) is proposed, where the MADRL model can be trained centrally in the cloud center and decentrally executed in edge servers to reduce the training cost and execution latency of MADRL. In addition, a discrete multi-agent soft actor-critic algorithm (MASAC) is introduced as the basic algorithm to address the non-stationary environment problem in MADRL. Then, online safe learning and offline safe learning are combined for the distribution network reconfiguration task in practice to update the neural networks of MADRL under constraints. Specifically, a novel offline algorithm called multi-agent constraints penalized Q-learning (MACPQ) is proposed to reduce the cost of trial-and-error process of MADRL while allowing agents to pre-train their policies from a historical dataset considering constraints. Meanwhile, a new online MADRL method called primal-dual MASAC is proposed to further improve the performance of agents by directly interacting with the physical distribution network under the safe action exploration. Finally, the superiority of the proposed methods is verified in IEEE 33-bus system and a practical 445-bus system.
Keyword:
Batch reinforcement learning
cloud-edge collaboration
distribution network reconfiguration
multi-agent deep reinforcement learning
safe reinforcement learning
期刊
IF:
7.2
论文数:
1.1W
被引数:
5.0W
机构
引用论文
CE-IoT: Cost-Effective Cloud-Edge Resource Provisioning for Heterogeneous IoT ApplicationsCe-iot: 为异构IoT应用程序提供经济高效的云边缘资源配置
PREAI
分享收藏AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic.png)
APPLIED ENERGY
OAAI
APPLIED ENERGYIF11
OAAI分享收藏分享收藏Cloud-Edge Orchestration for the Internet of Things: Architecture and AI-Powered Data Processing物联网的云边缘编排: 架构和AI支持的数据处理
PREAI
分享收藏Real-time operation of distribution network: A deep reinforcement learning-based reconfiguration approach配电网实时运行: 一种基于深度强化学习的重构方法
PREAI
分享收藏
查看更多内容