arrow
返回

Distributed Online Dispatch for Microgrids Using Hierarchical Reinforcement Learning Embedded With Operation Knowledge

delete2021-01-01
delete28
PRE
AI
L
Lu, Tianguang *
H
Hao, Ran
艾
艾芊 (Qian Ai)
H
Hongying He
DOI:10.1109/TPWRS.2021.3092220delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper considers the problem of distributed online economic dispatch (DOED) from sequential data using reinforcement learning. Learning operation behavior in high-dimension environments with constraints is a major challenge for the DOED of networked microgrids (MGs), where insufficient exploration prevents agents from building complex policies. Therefore, this paper develops a hierarchical reinforcement learning (HRL) to handle the DOED problem, where radial basis function (RBF) approximation is incorporated to make policies in continuous space. Based on the hierarchical framework, the HRL algorithm improves learning efficiency and reduces computational cost. The online HRL achieves distributed self-adaption and better performance of real-time dispatch by a modest number of interacting variables. In addition, guided by domain knowledge, the HRL algorithm avoids baseline violation and additional learning beyond feasible action space. In the case of an actual networked MG cluster in Qingdao with real operation data, simulation is conducted to verify that the proposed hierarchical learning can reduce long-term operation costs and enhance operation stability. To explore the learning process, we also provide its convergence condition and analyze the sensitivity of the learning parameters.
Keyword:
Index Terms-Data-driven model
hierarchical reinforcement learning
knowledge guiding
distributed online economic dispatch
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Power Systems 封面图
IEEE Transactions on Power Systems
IF:
7.2
论文数:
1.1W
被引数:
5.0W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Distributed Policy Evaluation Under Multiple Behavior Strategies
err2015-05-01
err69
errOAAI
errValcarcel Macua, Sergio; Chen, Jianshu; Zazo, Santiago; Sayed, Ali H.
err分享
err收藏
Multi-Agent Bargaining Learning for Distributed Energy Hub Economic Dispatch
err2018-01-01
err12
errOAAI
errZhang, Xiaoshun; Yu, Tao; Zhang, Zhiyi; Tang, Jianlin
err分享
err收藏
err分享
err收藏
India's potential for integrating solar and on- and offshore wind power into its energy system
err2020-09-21
err78
errOAAI
errLu, Tianguang; Sherman, Peter; Chen, Xinyu; Chen, Shi; Lu, Xi; McElroy, Michael
err分享
err收藏
Evidence for a Ubiquitous Seismic Discontinuity at the Base of the Mantle
err1999-11-12
err0
PREAI
errIgor Sidorin; Michael Gurnis; Don V. Helmberger
err分享
err收藏
A Reinforcement Learning-Based Decision System for Electricity Pricing Plan Selection by Smart Grid End Users
err2021-05-01
err33
errOAAI
errLu, Tianguang; Chen, Xinyu; McElroy, Michael B.; Nielsen, Chris P.; Wu, Qiuwei; Ai, Qian
err分享
err收藏
FMRQ-A Multiagent Reinforcement Learning Algorithm for Fully Cooperative Tasks
err2017-06-01
err62
PREAI
errZhang, Zhen; Zhao, Dongbin; Gao, Junwei; Wang, Dongqing; Dai, Yujie
err分享
err收藏
Distributed Bisection Method for Economic Power Dispatch in Smart Grid
err2015-11-01
err142
PREAI
errXing, Hao; Mou, Yuting; Fu, Minyue; Lin, Zhiyun
err分享
err收藏
学者 查看更多内容