arrow
Return

A storage expansion planning framework using reinforcement learning and simulation-based optimization

delete2021-05-01
delete14
delete
OA
AI
S
Stamatis Tsianikas
N
Nooshin Yousefi
周健 (Jian Zhou)
M
Mark D. Rodgers *
D
David W. Coit
DOI:10.1016/j.apenergy.2021.116778delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In the wake of the highly electrified future ahead of us, the role of energy storage is crucial wherever distributed generation is abundant, such as in microgrid settings. Given the variety of storage options that are becoming more and more economical, determining which type of storage technology to invest in, along with the appropriate timing and capacity becomes a critical research question. It is inevitable that these problems will continue to become increasingly relevant in the future and require strategic planning and holistic and modern frameworks in order to be solved. Reinforcement Learning algorithms have already proven to be successful in problems where sequential decision-making is inherent. In the operations planning area, these algorithms are already used but mostly in short-term problems with well-defined constraints. On the contrary, we expand and tailor these techniques to long-term planning by utilizing model-free algorithms combined with simulation-based models. A model and expansion plan have been developed to optimally determine microgrid designs as they evolve to dynamically react to changing conditions and to exploit energy storage capabilities. We show that it is possible to derive better engineering solutions that would point to the types of energy storage units which could be at the core of future microgrid applications. Another key finding is that the optimal storage capacity threshold for a system depends heavily on the price movements of the available storage units. By utilizing the proposed approaches, it is possible to model inherent problem uncertainties and optimize the whole streamline of sequential investment decision-making.
Keywords:
Investment planning
Decision-making
Reinforcement learning
Microgrids
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Applied Energy cover
Applied Energy
IF:
11
Papers:
2.6W
Citations:
17.8W

Organization

R
rutgers university new brunswick
Scholars:
2.3W
Papers: 1.9W
Citations: 32
R
rutgers university system
Scholars:
4.1W
Papers: 3.7W
Citations: 53