arrow
Return

A score-based filter for nonlinear data assimilation

delete2024-10-01
delete2
PRE
AI
F
Feng Bao
Z
Zezhong Zhang
G
Guannan Zhang *
DOI:10.1016/j.jcp.2024.113207delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a score -based generative sampling method for solving the nonlinear filtering problem with superior accuracy. A major drawback of existing nonlinear filtering methods, e.g., particle filters, is the low accuracy in handling high -dimensional nonlinear problems. To overcome this issue, we incorporate the score -based diffusion model into the recursive Bayesian filter framework to develop a novel score -based filter (SF). The key idea of SF is to store the information of the recursively updated filtering density function in the score function, instead of storing the information in a set of finite Monte Carlo samples (used in particle filters and ensemble Kalman filters). By leveraging the reverse -time diffusion process, SF can generate unlimited samples to characterize the filtering density. An essential aspect of SF is its analytical update step, gradually incorporating data information into the score function. This step is crucial in mitigating the degeneracy issue faced when dealing with very high -dimensional nonlinear filtering problems. Three benchmark problems are used to demonstrate the performance of our method. In particular, SF provides surprisingly impressive performance in reliably capturing/tracking the 100 -dimensional stochastic Lorenz system that is a well-known challenging problem for existing filtering methods.
Keywords:
Nonlinear filtering
Diffusion model
Score-based models
Stochastic dynamical systems
Kalman filter
Particle filter

Journal

Journal of Computational Physics cover
Journal of Computational Physics
IF:
3.8
Papers:
1.5W
Citations:
7.4W

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
F
Florida State University
Scholars:
1.1W
Papers: 8.6K
Citations: 2.0W