arrow
返回

Physical Informed-Inspired Deep Reinforcement Learning Based Bi-Level Programming for Microgrid Scheduling

delete2025-01-01
delete0
PRE
AI
李阳 封面图
李阳 (Yang Li)
J
Jiankai Gao
Y
Yuanzheng Li *
C
Chen Chen
S
Sen Li
M
Mohammad Shahidehpour
陈真 封面图
陈真 (Zhe Chen)
DOI:10.1109/TIA.2024.3522486delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
To coordinate the interests of operator and users in a microgrid under complex and changeable operating conditions, this paper proposes a microgrid scheduling model considering the thermal flexibility of thermostatically controlled loads and demand response by leveraging physical informed-inspired deep reinforcement learning (DRL) based bi-level programming. To overcome the non-convex limitations of Karush-Kuhn-Tucker (KKT)-based methods, a novel optimization solution method based on DRL theory is proposed to handle the bi-level programming through alternate iterations between levels. Specifically, by combining a DRL algorithm named asynchronous advantage actor-critic (A3C) and automated machine learning-prioritized experience replay (AutoML-PER) strategy to improve the generalization performance of A3C to address the above problems, an improved A3C algorithm, called AutoML-PER-A3C, is designed to solve the upper-level problem; while the DOCPLEX optimizer is adopted to address the lower-level problem. In this solution process, AutoML is used to automatically optimize hyperparameters and PER improves learning efficiency and quality by extracting the most valuable samples. The test results demonstrate that the presented approach manages to reconcile the interests between multiple stakeholders in MG by fully exploiting various flexibility resources. Furthermore, in terms of economic viability and computational efficiency, the proposal vastly exceeds other advanced reinforcement learning methods.
Keyword:
Microgrids
Stakeholders
Optimal scheduling
Load modeling
Job shop scheduling
Programming
Renewable energy sources
Deep reinforcement learning
Switches
Iterative methods
Bi-level scheduling
deep reinforcement learning
demand response
microgrid
thermostatically controlled load

期刊

IEEE Transactions on Industry Applications 封面图
IEEE Transactions on Industry Applications
IF:
4.5
论文数:
1.1W
被引数:
3.5W

机构

I
Illinois Institute of Technology
学者数:
3.8K
论文数: 3.9K
被引数: 4.2K
X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
N
northeast electric power university
学者数:
5.8K
论文数: 3.3K
被引数: 1
A
aalborg university
学者数:
1.6W
论文数: 1.7W
被引数: 22
学者 查看更多机构
引用论文

引用论文

A Longitudinal Examination of Middle School Students' Understanding of the Equal Sign and Equivalent Equations
err2007-07-03
err0
PREAI
errMartha W. Alibali; Eric J. Knuth; Shanta Hattikudur; Nicole M. McNeil; Ana C. Stephens
err分享
err收藏
err分享
err收藏
Decarbonization efforts hindered by China's slow progress on electricity market reforms
err2023-04-27
err17
PREAI
errYu, Yang; Wang, Jianxiao; Chen, Qixin; Urpelainen, Johannes; Ding, Qingguo; Liu, Shuo; Zhang, Bing
err分享
err收藏
Reinforcement Learning-Based Microgrid Energy Trading With a Reduced Power Plant Schedule
err2019-12-01
err79
PREAI
errLu, Xiaozhen; Xiao, Xingyu; Xiao, Liang; Dai, Canhuang; Peng, Mugen; Poor, H. Vincent
err分享
err收藏
err分享
err收藏
学者 查看更多内容