arrow
Return

Multidimensional Parallel Dynamic Programming Algorithm Based on Spark for Large-Scale Hydropower Systems

delete2020-07-21
delete10
PRE
AI
Y
Yufei Ma
P
Ping‐an Zhong
B
Bin Xu *
F
Feilin Zhu
X
Xiao Yao
Q
Qingwen Lü
DOI:10.1007/s11269-020-02566-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The curse of dimensionality is a major problem in dynamic programming (DP) algorithms for large-scale hydropower systems. This study proposes a parallel DP algorithm based on Spark (PDPoS) to alleviate the curse of dimensionality. Parallel computing experiments are formulated by varying the number of reservoirs, the number of discrete water levels and the number of CPU cores to analyze the quality and efficiency of PDPoS. The methodologies were applied to a cascade reservoir system made up of eight reservoirs in the Yuanshui River Basin in China. The results are as follows. (1) The number of discrete water levels is the dominant factor in the solution quality, while the number of reservoirs is the dominant factor in the solving efficiency. (2) The runtime of PDPoS is markedly affected by the calculational scale (determined by the number of reservoirs and discrete water levels), and the relationship between the number of CPU cores and the runtime is triphasic with increasing calculational scale. (3) The larger the calculational scale is, the better the parallel performance (i.e., the parallel speedup and parallel efficiency). The proposed PDPoS method has strong generality, high parallel performance, and high practical value.
Keywords:
Hydropower operation
Curse of dimensionality
Multidimensional dynamic programming
Parallel computing
Spark
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Water Resources Management cover
Water Resources Management
IF:
4.7
Papers:
8.1K
Citations:
1.6W

Organization

H
Hohai University
Scholars:
2.3W
Papers: 1.8W
Citations: 2.1W