arrow
Return

Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems

delete2023-03-01
delete9
delete
OA
AI
A
Ashesh Chattopadhyay
E
Ebrahim Nabizadeh
E
Eviatar Bach
P
Pedram Hassanzadeh *
DOI:10.1016/j.jcp.2023.111918delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available from the system. Ensemble Kalman filter (EnKF) is a DA algorithm that is widely used in applications involving high-dimensional nonlinear dynamical systems. However, EnKF requires evolving large ensembles of forecasts using the dynamical model of the system. This often becomes computationally intractable, especially when the number of states of the system is very large, e.g., for weather prediction. With small ensembles, the estimated background error covariance matrix in the EnKF algorithm suffers from sampling error, leading to an erroneous estimate of the analysis state (initial condition for the next forecast cycle). In this work, we propose hybrid ensemble Kalman filter (H-EnKF), which is applied to a two-layer quasi-geostrophic turbulent flow as a test case. This framework utilizes a pre-trained deep learning-based data-driven surrogate that inexpensively generates and evolves a large data-driven ensemble of the states to accurately compute the background error covariance matrix with smaller sampling errors. The H-EnKF framework outperforms EnKF with only dynamical model or only the data-driven surrogate, and estimates a better initial condition without the need for any ad-hoc localization strategies. H-EnKF can be extended to any ensemble-based DA algorithm, e.g., particle filters, which are currently too expensive to use for high-dimensional systems. (c) 2023 Elsevier Inc. All rights reserved.
Keywords:
Data assimilation
High-dimensional systems
Ensemble Kalman filter
Deep learning
Forecasting
Turbulence
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Computational Physics cover
Journal of Computational Physics
IF:
3.8
Papers:
1.5W
Citations:
7.4W

Organization

R
Rice University
Scholars:
1.4W
Papers: 1.2W
Citations: 2.6W
U
Universite PSL
Scholars:
3.3W
Papers: 2.5W
Citations: 91