返回
Distributed Online Dispatch for Microgrids Using Hierarchical Reinforcement Learning Embedded With Operation Knowledge
DOI:10.1109/TPWRS.2021.3092220.png)
摘要
En 中文
This paper considers the problem of distributed online economic dispatch (DOED) from sequential data using reinforcement learning. Learning operation behavior in high-dimension environments with constraints is a major challenge for the DOED of networked microgrids (MGs), where insufficient exploration prevents agents from building complex policies. Therefore, this paper develops a hierarchical reinforcement learning (HRL) to handle the DOED problem, where radial basis function (RBF) approximation is incorporated to make policies in continuous space. Based on the hierarchical framework, the HRL algorithm improves learning efficiency and reduces computational cost. The online HRL achieves distributed self-adaption and better performance of real-time dispatch by a modest number of interacting variables. In addition, guided by domain knowledge, the HRL algorithm avoids baseline violation and additional learning beyond feasible action space. In the case of an actual networked MG cluster in Qingdao with real operation data, simulation is conducted to verify that the proposed hierarchical learning can reduce long-term operation costs and enhance operation stability. To explore the learning process, we also provide its convergence condition and analyze the sensitivity of the learning parameters.
Keyword:
Index Terms-Data-driven model
hierarchical reinforcement learning
knowledge guiding
distributed online economic dispatch
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.2
论文数:
1.1W
被引数:
5.0W
机构
引用论文
India's potential for integrating solar and on- and offshore wind power into its energy system
NATURE COMMUNICATIONS
IF15.7
Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids微电网多智能体分散能量管理的模糊Q学习
APPLIED ENERGY
IF11

