arrow
Return

Generative modelling with jump-diffusions

delete2026-05-01
delete0
PRE
AI
A
Adrian Baule *
DOI:10.1088/1742-5468/ae5a22delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Score-based diffusion models generate samples from an unknown target distribution using a time-reversed diffusion process. While such models represent state-of-the-art approaches in industrial applications such as artificial image generation, it has recently been noted that their performance can be further improved by considering injection noise with heavy tailed characteristics. Here, I present a generalization of generative diffusion processes to a wide class of non-Gaussian noise processes. I consider forward processes driven by standard Gaussian noise with super-imposed Poisson jumps representing a finite activity L & eacute;vy process. The generative process is shown to be governed by a generalized score function that depends on the jump amplitude distribution and can be estimated by minimizing a simple MSE loss as in conventional Gaussian models. Both probability flow ordinary differential equation and stochastic differential equation formulations are derived using basic technical effort. A detailed implementation for a pure jump process with Laplace distributed amplitudes yields a generalized score function in closed analytical form and is shown to outperform the equivalent Gaussian model in specific parameter regimes.
Keywords:
machine learning

Journal

J
Journal of Statistical Mechanics-Theory and Experiment
IF:
1.9
Papers:
162
Citations:
1.0W

Organization

Q
Queen Mary University London
Scholars:
2.0W
Papers: 1.5W
Citations: 327
Cited Papers

Cited Papers

Multivariate generalized Laplace distribution and related random fields
err2013-01-01
err0
errOAAI
errTomasz J. Kozubowski; Krzysztof Podgórski; Igor Rychlik
errShare
errSave
From denoising diffusions to denoising Markov models
err2024-01-17
err1
errOAAI
errBenton, Joe; Shi, Yuyang; De Bortoli, Valentin; Deligiannidis, George; Doucet, Arnaud
errShare
errSave
Trans-Dimensional Generative Modeling via Jump Diffusion Models
err2023-01-01
err0
PREAI
errCampbell,Andrew; Harvey,William; Weilbach,Christian; Bortoli,Valentin De; Rainforth,Thomas; Doucet,Arnaud
errShare
errSave
no more