arrow
Return

Diffusion Schrodinger Bridges for Bayesian Computation

delete2024-02-01
delete1
delete
OA
AI
J
Jeremy Heng *
V
Valentin De Bortoli
D
Doucet, Arnaud
DOI:10.1214/23-STS908delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Denoising diffusion models are a novel class of generative models that have recently become extremely popular in machine learning. In this paper, we describe how such ideas can also be used to sample from posterior distributions and, more generally, any target distribution whose density is known up to a normalizing constant. The key idea is to consider a forward noising diffusion initialized at the target distribution, which transports this latter to a normal distribution for long diffusion times. The time reversal of this process, the denoising diffusion, thus transports the normal distribution to the target distribution and can be approximated so as to sample from the target. To accelerate simulation, we show how one can introduce and approximate a Schrodinger bridge between these two distributions, that is, a diffusion which transports the normal to the target in finite time.
Keywords:
Optimal transport
Schrodinger bridge
score matching
stochastic differential equation
time reversal

Journal

Statistical Science cover
Statistical Science
IF:
3.4
Papers:
1.0K
Citations:
8.7K

Organization

E
ESSEC Business School
Scholars:
440
Papers: 754
Citations: 1
E
ecole normale superieure (ens)
Scholars:
3.0K
Papers: 2.1K
Citations: 4
U
Universite PSL
Scholars:
3.3W
Papers: 2.5W
Citations: 91
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
CONTROLLED SEQUENTIAL MONTE CARLO
err2020-10-01
err28
errOAAI
errHeng, Jeremy; Bishop, Adrian N.; Deligiannidis, George; Doucet, Arnaud
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Bridging Au nanoclusters with ultrathin LDH nanosheets via ligands for enhanced charge transfer in photocatalytic CO2 reduction
err2023-08-01
err0
PREAI
errYanan Bo; Pengye Du; Hao Li; Rong Liu; Chengming Wang; Hengjie Liu; Dong Liu; Tingting Kong; Zhou Lu; Chao Gao; Yujie Xiong
errShare
errSave
Family Relations and Family Businesses: A Note From the Guest Editors
err2013-06-04
err0
PREAI
errMichael Lane Morris; Franz W. Kellermanns
errShare
errSave
A model of narrative circulation
err2004-07-01
err0
PREAI
errVilma Hänninen
errShare
errSave
researcher View more