arrow
Return

Virtual Synchronous Generator Control Using Twin Delayed Deep Deterministic Policy Gradient Method

delete2024-03-01
delete12
PRE
AI
O
Oroghene Oboreh-Snapps
B
Buxin She
S
Shah Fahad
H
Haotian Chen
J
Jonathan W. Kimball
F
Fangxing Li
H
Hantao Cui
R
Rui Bo *
DOI:10.1109/TEC.2023.3309955delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article presents a data-driven approach that adaptively tunes the parameters of a virtual synchronous generator to achieve optimal frequency response against disturbances. In the proposed approach, the control variables, namely, the virtual moment of inertia and damping factor, are transformed into actions of a reinforcement learning agent. Different from the state-of-the-art methods, the proposed study introduces the settling time parameter as one of the observations in addition to the frequency and rate of change of frequency (RoCoF). In the reward function, preset indices are considered to simultaneously ensure bounded frequency deviation, low RoCoF, fast response, and quick settling time. To maximize the reward, this study employs the Twin-Delayed Deep Deterministic Policy Gradient (TD3) algorithm. TD3 has an exceptional capacity for learning optimal policies and is free of overestimation bias, which may lead to suboptimal policies. Finally, numerical validation in MATLAB/Simulink and real-time simulation using RTDS confirm the superiority of the proposed method over other adaptive tuning methods.
Keywords:
Mathematical models
Damping
Frequency response
Power system stability
Microgrids
Adaptation models
Inverters
Deep reinforcement learning
frequency response
MATLAB/SIMULINK
microgrid
RTDS
virtual damping
virtual inertia
virtual synchronous generator

Journal

IEEE Transactions on Energy Conversion cover
IEEE Transactions on Energy Conversion
IF:
5.4
Papers:
6.8K
Citations:
1.5W

Organization

University of Tennessee System cover
University of Tennessee System
Scholars:
2.9W
Papers: 2.7W
Citations: 115
University of Missouri System cover
University of Missouri System
Scholars:
3.0W
Papers: 2.7W
Citations: 75
Cited Papers

Cited Papers

Fuzzy sets
err1965-06-01
err0
errOAAI
errL.A. Zadeh
errShare
errSave
Decentralized and Coordinated V-f Control for Islanded Microgrids Considering DER Inadequacy and Demand Control
err2023-09-01
err9
errOAAI
errShe, Buxin; Li, Fangxing; Cui, Hantao; Wang, Jinning; Min, Liang; Oboreh-Snapps, Oroghene; Bo, Rui
errShare
errSave
Parental smoking and respiratory illness in infancy.
err1980-05-01
err0
errOAAI
errD M Fergusson; L J Horwood; F T Shannon
errShare
errSave
Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach
err2021-01-01
err84
errOAAI
errLi, Yushuai; Gao, Wei; Yan, Weihang; Huang, Shuo; Wang, Rui; Gevorgian, Vahan; Gao, David Wenzhong
errShare
errSave
Impact of Uncertainties on Resilient Operation of Microgrids: A Data-Driven Approach
err2019-01-01
err55
errOAAI
errHussain, Akhtar; Rousis, Anastasios Oulis; Konstantelos, Ioannis; Strbac, Goran; Jeon, Jinhong; Kim, Hak-Man
errShare
errSave
A repeated cross-sectional study of sympathy for violent radicalization in Canadian college students.
err2020-01-01
err0
PREAI
errCécile Rousseau; Diana Miconi; Rochelle L. Frounfelker; Ghayda Hassan; Youssef Oulhote
errShare
errSave
researcher View more