.png){kind=icon}
Return
Data reformation - A novel data processing technique enhancing machine learning applicability for predicting streamflow extremes
.png){kind=icon}
OA
AI
DOI：10.1016/j.advwatres.2023.104569.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Hydrologists have been actively exploring the utility of machine learning (ML) models for predicting streamflow. While ML methods have proven to be as accurate as conventional modeling techniques for streamflows well represented in the training set, they continue to lack satisfactory skills for extreme events. In this study, a novel 'data reformation' technique is proposed based on the Relative Strength Index (RSI) - a measure of speed and direction of changes in the time series. RSI homogenizes all observations to a constrained 0-100 range, and all 'out-of-sample' data in the testing set fall within the space of the training set. Long Short-Term Memory network with an attention mechanism is used to train three ML models using 55,055 events from the CAMELS dataset (670 basins, 1980-2014). Predictions are made for 12,424 events, of which 3,810 are significantly higher than streamflows in the training set. The ML model based on RSI-reformed data exhibits superior performance, as compared to other advanced ML models without data reformation. Peaks up to 15 times larger than those in the training events are accurately predicted, leading to an outperforming model skill for 433 out of 670 catchments. These findings indicate that incorporating a new data reformation technique into the data pre-processing step in ML modeling can enhance the utility of ML models for extreme events. This research encourages further exploration to identify better data reformation methods to enable confident ML predictions.
Keywords:
Machine learning
Extrapolation
Data reformation
Relative strength index
Streamflow predictions
Extreme events
Out-of-samples
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
4.2
Papers:
4.6K
Citations:
1.5W
Organization
Cited Papers
ShareSaveShareSaveContinuous limit, higher-order rational solutions and relevant dynamical analysis for Belov–Chaltikian lattice equation with 3$$\times $$3 Lax pair.png)
Pramana
PramanaIF0
PREAI
ShareSaveLong lead-time daily and monthly streamflow forecasting using machine learning methodsJOURNAL OF HYDROLOGY
JOURNAL OF HYDROLOGYIF6.3
PREAI
ShareSaveIncreased human and economic losses from river flooding with anthropogenic warmingNATURE CLIMATE CHANGE
NATURE CLIMATE CHANGEIF27.1
PREAI
ShareSaveShareSaveA novel attention-based LSTM cell post-processor coupled with bayesian optimization for streamflow predictionJOURNAL OF HYDROLOGY
JOURNAL OF HYDROLOGYIF6.3
PREAI
ShareSave
View more