arrow
Return

Deep learning algorithm for data-driven simulation of noisy dynamical system

delete2019-01-01
delete85
delete
OA
AI
K
Kyongmin Yeo *
I
Igor Melnyk
DOI:10.1016/j.jcp.2018.10.024delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a deep learning model, DE-LSTM, for the simulation of a stochastic process with an underlying nonlinear dynamics. The deep learning model aims to approximate the probability density function of a stochastic process via numerical discretization and the underlying nonlinear dynamics is modeled by the Long Short-Term Memory (LSTM) network. It is shown that, when the numerical discretization is used, the function estimation problem can be solved by a multi-label classification problem. A penalized maximum log likelihood method is proposed to impose a smoothness condition in the prediction of the probability distribution. We show that the time evolution of the probability distribution can be computed by a high-dimensional integration of the transition probability of the LSTM internal states. A Monte Carlo algorithm to approximate the high-dimensional integration is outlined. The behavior of DE-LSTM is thoroughly investigated by using the Ornstein-Uhlenbeck process and noisy observations of nonlinear dynamical systems; Mackey-Glass time series and forced Van der Pol oscillator. It is shown that DE-LSTM makes a good prediction of the probability distribution without assuming any distributional properties of the stochastic process. For a multiple-step forecast of the Mackey-Glass time series, the prediction uncertainty, denoted by the 95% confidence interval, first grows, then dynamically adjusts following the evolution of the system, while in the simulation of the forced Van der Pol oscillator, the prediction uncertainty does not grow in time even for a 3,000-step forecast. (C) 2018 Elsevier Inc. All rights reserved.
Keywords:
Nonlinear dynamical system
Time series
Deep learning
Recurrent neural network
Data-driven simulation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Computational Physics cover
Journal of Computational Physics
IF:
3.8
Papers:
1.6W
Citations:
7.4W

Organization

I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
Cited Papers

Cited Papers

Deep learning in neural networks: An overview
err2015-01-01
err1.3W
errOAAI
errSchmidhuber, Juergen
errShare
errSave
Activity-Dependent Dysfunction in Visual and Olfactory Sensory Systems in Mouse Models of Down Syndrome
err2017-09-12
err0
errOAAI
errChristopher M. William; Lubna Saqran; Matthew A. Stern; Charles L. Chiang; Scott P. Herrick; Aziz Rangwala; Mark W. Albers; Matthew P. Frosch; Bradley T. Hyman
errShare
errSave
Impacts of Climate Change on Health and Wellbeing in South Africa
err2018-08-31
err0
errOAAI
errMatthew F. Chersich; Caradee Y. Wright; Francois Venter; Helen Rees; Fiona Scorgie; Barend Erasmus
errShare
errSave
researcher View more