arrow
返回

Deep Reinforcement Learning-Assisted Convex Programming for AC Unit Commitment and Its Variants

delete2024-07-01
delete0
PRE
AI
A
Ahmed Rabee Sayed
X
Xian Zhang *
王
王贵斌 (Guibin Wang)
Y
Yi Wang
M
Mostafa F. Shaaban
M
Mohammad Shahidehpour
DOI:10.1109/TPWRS.2023.3340674delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unit commitment (UC) is one of the core decisions in electricity markets and system planning. Existing optimization methods either use DC approximation of network constraints or decompose and relax them into subproblems, which may lead to suboptimal/infeasible decisions or require execution times longer than those for the industry. Recent advances in machine learning techniques have proven their ability to find fast near-optimal UC decisions. However, they suffer from the curses of dimensionality and/or lack feasibility guarantees. This paper proposes a new hybrid deep reinforcement learning algorithm for the UC problem with AC network constraints (AC-UC). The problem is formulated as a modified-action Markov decision process model and the fundamental soft actor-critic (SAC) algorithm is enhanced to deal with hybrid action spaces. To ensure the solution feasibility, two action filters are designed based on logic constraints of generation units and sequential convex programming for the discrete and continuous actions, respectively. The hybrid SAC is improved by embedding the two filters and a prioritized experience buffer for fast convergence and stable learning. Simulation results on four test systems verify the effectiveness of the proposed approach and the superiority over traditional methods in computational efficiency and feasibility. Moreover, the presented method is extended to solve stochastic UC and security-constraint UC problems.
Keyword:
Load flow
Generators
Uncertainty
Programming
Power systems
Computational modeling
Mathematical models
Reinforcement learning
convex programming
unit commitment
optimal power flow
uncertainty

期刊

IEEE Transactions on Power Systems 封面图
IEEE Transactions on Power Systems
IF:
7.2
论文数:
1.1W
被引数:
5.0W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
A
American University of Sharjah
学者数:
2.6K
论文数: 2.5K
被引数: 2.7K
C
Cairo University
学者数:
1.4W
论文数: 1.1W
被引数: 1.7W
S
shenzhen university
学者数:
4.6W
论文数: 3.4W
被引数: 72
学者 查看更多机构
引用论文

引用论文

Temporal Decomposition for Security-Constrained Unit Commitment
err2020-05-01
err29
PREAI
errSafdarian, Farnaz; Mohammadi, Ali; Kargarian, Amin
err分享
err收藏
A Comprehensive Review of Security-constrained Unit Commitment
err2022-01-01
err87
errOAAI
errYang, Nan; Dong, Zhenqiang; Wu, Lei; Zhang, Lei; Shen, Xun; Chen, Daojun; Zhu, Binxin; Liu, Yikui
err分享
err收藏
Global Solution Strategies for the Network-Constrained Unit Commitment Problem With AC Transmission Constraints
err2019-03-01
err30
errOAAI
errLiu, Jianfeng; Laird, Carl D.; Scott, Joseph K.; Watson, Jean-Paul; Castillo, Anya
err分享
err收藏
A Distributionally Robust AC Network-Constrained Unit Commitment
err2021-11-01
err19
PREAI
errDehghan, Shahab; Aristidou, Petros; Amjady, Nima; Conejo, Antonio J.
err分享
err收藏
Konversi Sitronelal Menjadi Senyawa Isopulegol dengan Katalis ZnBr2/β-Zeolit
err2017-10-29
err0
errOAAI
errKhoirun Nisyak; Elvina Dhiaul Iftitah; Rachmat Triandi Tjahjanto
err分享
err收藏
学者 查看更多内容