返回
Predictive Energy Management for Microgrid Using Multi-Agent Deep Deterministic Policy Gradient With Random Sampling
DOI:10.1109/ACCESS.2024.3416706.png)
摘要
En 中文
In a MicroGrid (MG) equipped with a Battery Energy Storage System (BESS), an Energy Management System (EMS) plays a crucial role in predictive controlling BESS operations for optimal power flow among uncertainties from renewable energy resources and heavy loads, such as solar photovoltaic systems and electric vehicles, respectively. State-of-the-art EMS designs have integrated Deep Reinforcement Learning (DRL) for EMS development and Probabilistic Power Flow (PPF) for preventing the violation of power system constraints while accounting for all uncertainties. However, using PPF to handle uncertainties alongside training a single-agent DRL provides the optimal solution for addressing all uncertain scenarios, but not the best solution for each scenario. Moreover, employing a single-agent DRL yields a low performance in predictive controlling of BESS operations. To address these challenges, a multi-agent DRL based on Deep Deterministic Policy Gradient (DDPG) is proposed. This method divides the roles of each agent for predicting 24-hour-ahead actions in BESS control based on changing 24-hour-ahead MG behavior every hour. Furthermore, MG parameters are randomly sampled to retain MG uncertainties instead of relying on PPF for uncertainty mitigation. Consequently, multi-agent DDPG with random sampling can directly learn from the MG environment and provide the best solution for each scenario. Simulation results demonstrate that the proposed method can reduce training computational time by 92.84%, provide a higher value of the summed mean of 24-hours-ahead reward by 1.50% to 28.37%, and achieve a lower mean daily total related cost by 9.22% compared to applying the state-of-the-art method.
Keyword:
Battery energy storage
deep reinforcement learning
electric vehicle
microgrid
photovoltaics
predictive energy management
Battery energy storage
deep reinforcement learning
electric vehicle
microgrid
photovoltaics
predictive energy management
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning
ENERGY
IF9.4
Probabilistic optimal scheduling of networked microgrids considering time-based demand response programs under uncertainty不确定条件下考虑基于时间需求响应方案的网络微电网概率优化调度
APPLIED ENERGY
IF11
Adaptive energy management strategy and optimal sizing applied on a battery-supercapacitor based tramway
APPLIED ENERGY
IF11
Real-Time Multi-Home Energy Management with EV Charging Scheduling Using Multi-Agent Deep Reinforcement Learning Optimization基于多智能体深度强化学习优化的电动汽车充电调度实时多家庭能源管理
ENERGIES
IF3.2

