arrow
返回

Predictive Energy Management for Microgrid Using Multi-Agent Deep Deterministic Policy Gradient With Random Sampling

delete2024-01-01
delete0
delete
OA
AI
N
Niphon Kaewdornhan
R
Rongrit Chatthaworn *
DOI:10.1109/ACCESS.2024.3416706delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In a MicroGrid (MG) equipped with a Battery Energy Storage System (BESS), an Energy Management System (EMS) plays a crucial role in predictive controlling BESS operations for optimal power flow among uncertainties from renewable energy resources and heavy loads, such as solar photovoltaic systems and electric vehicles, respectively. State-of-the-art EMS designs have integrated Deep Reinforcement Learning (DRL) for EMS development and Probabilistic Power Flow (PPF) for preventing the violation of power system constraints while accounting for all uncertainties. However, using PPF to handle uncertainties alongside training a single-agent DRL provides the optimal solution for addressing all uncertain scenarios, but not the best solution for each scenario. Moreover, employing a single-agent DRL yields a low performance in predictive controlling of BESS operations. To address these challenges, a multi-agent DRL based on Deep Deterministic Policy Gradient (DDPG) is proposed. This method divides the roles of each agent for predicting 24-hour-ahead actions in BESS control based on changing 24-hour-ahead MG behavior every hour. Furthermore, MG parameters are randomly sampled to retain MG uncertainties instead of relying on PPF for uncertainty mitigation. Consequently, multi-agent DDPG with random sampling can directly learn from the MG environment and provide the best solution for each scenario. Simulation results demonstrate that the proposed method can reduce training computational time by 92.84%, provide a higher value of the summed mean of 24-hours-ahead reward by 1.50% to 28.37%, and achieve a lower mean daily total related cost by 9.22% compared to applying the state-of-the-art method.
Keyword:
Battery energy storage
deep reinforcement learning
electric vehicle
microgrid
photovoltaics
predictive energy management
Battery energy storage
deep reinforcement learning
electric vehicle
microgrid
photovoltaics
predictive energy management

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
Khon Kaen University
学者数:
7.9K
论文数: 5.7K
被引数: 5.2K
引用论文

引用论文

err分享
err收藏
Rule-Based Inferential System for Microgrid Energy Management System
err2022-03-01
err11
PREAI
errKurukuru, Varaha Satya Bharath; Haque, Ahteshamul; Padmanaban, Sanjeevikumar; Khan, Mohammed Ali
err分享
err收藏
Adaptive energy management strategy and optimal sizing applied on a battery-supercapacitor based tramway
err2016-05-01
err150
PREAI
errHerrera, Victor; Milo, Aitor; Gaztanaga, Haizea; Etxeberria-Otadui, Ion; Villarreal, Igor; Camblong, Haritza
err分享
err收藏
Deep Reinforcement Learning for Smart Home Energy Management深度强化学习在智能家居能源管理中的应用
err2020-04-01
err278
errOAAI
errYu, Liang; Xie, Weiwei; Xie, Di; Zou, Yulong; Zhang, Dengyin; Sun, Zhixin; Zhang, Linghua; Zhang, Yue; Jiang, Tao
err分享
err收藏
err分享
err收藏
Optimization-Based Power and Energy Management System in Shipboard Microgrid: A Review基于优化的船载微电网功率与能量管理系统综述
err2022-03-01
err89
errOAAI
errXie, Peilin; Guerrero, Josep M.; Tan, Sen; Bazmohammadi, Najmeh; Vasquez, Juan C.; Mehrzadi, Mojtaba; Al-Turki, Yusuf
err分享
err收藏
学者 查看更多内容