arrow
返回

Data reformation - A novel data processing technique enhancing machine learning applicability for predicting streamflow extremes

delete2023-12-01
delete11
delete
OA
AI
V
Vinh Ngoc Tran
V
V. Y. Ivanov *
J
Jongho Kim
DOI:10.1016/j.advwatres.2023.104569delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Hydrologists have been actively exploring the utility of machine learning (ML) models for predicting streamflow. While ML methods have proven to be as accurate as conventional modeling techniques for streamflows well represented in the training set, they continue to lack satisfactory skills for extreme events. In this study, a novel 'data reformation' technique is proposed based on the Relative Strength Index (RSI) - a measure of speed and direction of changes in the time series. RSI homogenizes all observations to a constrained 0-100 range, and all 'out-of-sample' data in the testing set fall within the space of the training set. Long Short-Term Memory network with an attention mechanism is used to train three ML models using 55,055 events from the CAMELS dataset (670 basins, 1980-2014). Predictions are made for 12,424 events, of which 3,810 are significantly higher than streamflows in the training set. The ML model based on RSI-reformed data exhibits superior performance, as compared to other advanced ML models without data reformation. Peaks up to 15 times larger than those in the training events are accurately predicted, leading to an outperforming model skill for 433 out of 670 catchments. These findings indicate that incorporating a new data reformation technique into the data pre-processing step in ML modeling can enhance the utility of ML models for extreme events. This research encourages further exploration to identify better data reformation methods to enable confident ML predictions.
Keyword:
Machine learning
Extrapolation
Data reformation
Relative strength index
Streamflow predictions
Extreme events
Out-of-samples
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Advances in Water Resources 封面图
Advances in Water Resources
IF:
4.2
论文数:
4.6K
被引数:
1.5W

机构

U
University of Michigan
学者数:
6.4W
论文数: 5.3W
被引数: 124
U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
引用论文

引用论文

Urban Telemedicine Enables Equity in Access to Acute Illness Care
err2017-02-01
err0
PREAI
errSarah D. Ronis; Kenneth M. McConnochie; Hongyue Wang; Nancy E. Wood
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Increased human and economic losses from river flooding with anthropogenic warming
err2018-08-20
err437
PREAI
errDottori, Francesco; Szewczyk, Wojciech; Ciscar, Juan-Carlos; Zhao, Fang; Alfieri, Lorenzo; Hirabayashi, Yukiko; Bianchi, Alessandra; Mongelli, Ignazio; Frieler, Katja; Betts, Richard A.; Feyen, Luc
err分享
err收藏
(1919) Proposal to conserve Lactarius nom. cons. (Basidiomycota) with a conserved type
err2010-02-01
err0
errOAAI
errBart Buyck; Valérie Hofstetter; Annemieke Verbeken; Ruben Walleyn
err分享
err收藏
A novel attention-based LSTM cell post-processor coupled with bayesian optimization for streamflow prediction
err2021-10-01
err118
PREAI
errAlizadeh, Babak; Bafti, Alireza Ghaderi; Kamangir, Hamid; Zhang, Yu; Wright, Daniel B.; Franz, Kristie J.
err分享
err收藏
学者 查看更多内容