arrow
Return

Distributed Q-Learning-Based Online Optimization Algorithm for Unit Commitment and Dispatch in Smart Grid

delete2020-09-01
delete77
PRE
AI
F
Fangyuan Li
J
Jiahu Qin *
Wei Xing Zheng cover
Wei Xing Zheng (Wei Xing Zheng)
DOI:10.1109/TCYB.2019.2921475delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Economic dispatch (ED) and unit commitment (UC) problems need to be revisited in order to make a transition from a traditional power system to a smart grid. In this paper, we formulate the ED and UC problems into a unified form, which is also capable of characterizing the infinite horizon UC problem. Based on the formulation, a centralized Q-learning-based optimization algorithm is proposed. The proposed algorithm runs in an online manner and requires no prior information on the mathematical formulation of the actual cost functions, thus being capable of dealing with situations for which such cost functions are too difficult to obtain. Then, the distributed counterpart of the centralized algorithm is developed by relaxing the demand for global information and balancing exploration and exploitation cooperatively in a distributed way. Theoretical analysis of the proposed algorithms is also provided. Finally, several case studies are presented to demonstrate the effectiveness of the proposed algorithms.
Keywords:
Distributed Q-learning
online optimization
smart grid
unit commitment and dispatch (UCD)

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
7.2W

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 4.9W
C
Chinese Academy of Sciences
Scholars:
3.0W
Papers: 8.3K
Citations: 39.2W
Cited Papers

Cited Papers

Thermokinetic model establishment and numerical simulation of 2,4,6-trinitrophenol based on eco-friendly synthesis method
err2021-11-25
err0
PREAI
errYe-Cheng Liu; An-Chi Huang; Yan Tang; Xiao-Ming Ma; Ya-Ping Yang; Zhi-Hao Wu; Chi-Min Shu; Zhi-Xiang Xing; Jun-Cheng Jiang
errShare
errSave
Distributed Economic Dispatch for Smart Grids With Random Wind Power
err2016-05-01
err243
PREAI
errGuo, Fanghong; Wen, Changyun; Mao, Jianfeng; Song, Yong-Duan
errShare
errSave
errShare
errSave
errShare
errSave
Day-ahead unit commitment method considering time sequence feature of wind power forecast error
err2018-06-01
err24
PREAI
errWang, Chengfu; Li, Xijuan; Wang, Zhaoqing; Dong, Xiaoming; Liang, Zhengtang; Liu, Xiaoyi; Liang, Jun; Han, Xueshan
errShare
errSave
Consensus-Based Distributed Coordination Between Economic Dispatch and Demand Response
err2019-07-01
err88
PREAI
errQin, Jiahu; Wan, Yanni; Yu, Xinghuo; Li, Fangyuan; Li, Chaojie
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
Frequency Regulation of Source-Grid-Load Systems: A Compound Control Strategy
err2016-02-01
err104
PREAI
errWen, Guanghui; Hu, Guoqiang; Hu, Jianqiang; Shi, Xinli; Chen, Guanrong
errShare
errSave
researcher View more