arrow
Return

Accelerating Markov Chain Monte Carlo sampling with diffusion models ☆

delete2024-03-01
delete2
delete
OA
AI
N
N. T. Hunt-Smith *
W
Wally Melnitchouk
F
Felix Ringer
N
N. Sato
A
A. W. Thomas
M
M. J. White
DOI:10.1016/j.cpc.2023.109059delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global analysis of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalizing flows. A code implementation can be found at https://github .com /NickHunt-Smith /MCMC -diffusion.
Keywords:
Markov Chain Monte Carlo
Diffusion model
Machine learning
Statistical methods
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computer Physics Communications cover
Computer Physics Communications
IF:
3.4
Papers:
1.2W
Citations:
3.7W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W