arrow
返回

Optimal energy system scheduling using a constraint-aware reinforcement learning algorithm

delete2023-10-01
delete17
delete
OA
AI
S
Shengren Hou
P
Pedro P. Vergara *
E
Edgar Mauricio Salazar Duque
P
Peter Pálenský
DOI:10.1016/j.ijepes.2023.109230delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms arise as a promising solution due to their data-driven and model-free features. However, current DRL algorithms fail to enforce rigorous operational constraints (e.g., power balance, ramping up or down constraints) limiting their implementation in real systems. To overcome this, in this paper, a DRL algorithm (namely MIP-DQN) is proposed, capable of strictly enforcing all operational constraints in the action space, ensuring the feasibility of the defined schedule in real-time operation. This is done by leveraging recent optimization advances for deep neural networks (DNNs) that allow their representation as a MIP formulation, enabling further consideration of any action space constraints. Comprehensive numerical simulations show that the proposed algorithm outperforms existing state-of-the-art DRL algorithms, obtaining a lower error when compared with the optimal global solution (upper boundary) obtained after solving a mathematical programming formulation with perfect forecast information; while strictly enforcing all operational constraints (even in unseen test days).
Keyword:
Energy management systems
Distributed energy system
Safe reinforcement learning
Machine learning
Nonlinear programming
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
International Journal of Electrical Power and Energy Systems
IF:
5
论文数:
1.1W
被引数:
3.1W

机构

D
Delft University of Technology
学者数:
2.6W
论文数: 2.5W
被引数: 3.8W
E
Eindhoven University of Technology
学者数:
1.6W
论文数: 1.5W
被引数: 2.2W
引用论文

引用论文

Optimal Operation of Unbalanced Three-Phase Islanded Droop-Based Microgrids
err2019-01-01
err48
PREAI
errVergara, Pedro P.; Lopez, Juan C.; Rider, Marcos J.; da Silva, Luiz C. P.
err分享
err收藏
An Improved Two-Stage Deep Reinforcement Learning Approach for Regulation Service Disaggregation in a Virtual Power Plant
err2022-07-01
err38
PREAI
errYi, Zhongkai; Xu, Yinliang; Wang, Xue; Gu, Wei; Sun, Hongbin; Wu, Qiuwei; Wu, Chenyu
err分享
err收藏
Microgrids energy management systems: A critical review on methods, solutions, and prospects
err2018-07-01
err618
PREAI
errZia, Muhammad Fahad; Elbouchikhi, Elhoussin; Benbouzid, Mohamed
err分享
err收藏
学者 查看更多内容