arrow
返回

Efficient Multimodal Sampling via Tempered Distribution Flow

delete2023-05-26
delete1
delete
OA
AI
Y
Yixuan Qiu
X
Xiao Wang *
DOI:10.1080/01621459.2023.2198059delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sampling from high-dimensional distributions is a fundamental problem in statistical research and practice. However, great challenges emerge when the target density function is unnormalized and contains isolated modes. We tackle this difficulty by fitting an invertible transformation mapping, called a transport map, between a reference probability measure and the target distribution, so that sampling from the target distribution can be achieved by pushing forward a reference sample through the transport map. We theoretically analyze the limitations of existing transport-based sampling methods using the Wasserstein gradient flow theory, and propose a new method called TemperFlow that addresses the multimodality issue. TemperFlow adaptively learns a sequence of tempered distributions to progressively approach the target distribution, and we prove that it overcomes the limitations of existing methods. Various experiments demonstrate the superior performance of this novel sampler compared to traditional methods, and we show its applications in modern deep learning tasks such as image generation. The programming code for the numerical experiments is available in the supplementary material.
Keyword:
Deep neural network
Gradient flow
Markov chain Monte Carlo
Normalizing flow
Parallel tempering

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

Purdue University System 封面图
Purdue University System
学者数:
3.9W
论文数: 3.6W
被引数: 66
S
Shanghai University of Finance and Economics
学者数:
2.0K
论文数: 2.5K
被引数: 4.0K
引用论文

引用论文

Social determinants of violence against women in Panama: results from population-based cross-sectional studies and a femicide registry
err2019-12-09
err0
errOAAI
errAna Santamaría; Carmen Gerald; Fermina Chamorro; Víctor Herrera; Haydee Flores; Iris Sandoval; Beatriz Gómez; Eyra Harbar; Leoteau Liriola; Ruth G de León Richardson; Jorge Motta; Ilais Moreno Velásquez
err分享
err收藏
Low rank approximation method for efficient Green's function calculation of dissipative quantum transport
err2013-06-07
err0
errOAAI
errLang Zeng; Yu He; Michael Povolotskyi; XiaoYan Liu; Gerhard Klimeck; Tillmann Kubis
err分享
err收藏
Conserving dynamic theory for the electron gas
err1985-03-01
err0
PREAI
errF. Green; D. Neilson; J. Szymański
err分享
err收藏
err分享
err收藏
学者 查看更多内容