arrow
返回

Hamiltonian Adaptive Importance Sampling

delete2021-01-01
delete11
delete
OA
AI
A
Ali Mousavi *
R
Reza Monsefi
V
V́ıctor Elvira
DOI:10.1109/LSP.2021.3068616delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Importance sampling (IS) is a powerful Monte Carlo (MC) methodology for approximating integrals, for instance in the context of Bayesian inference. In IS, the samples are simulated from the so-called proposal distribution, and the choice of this proposal is key for achieving a high performance. In adaptive IS (AIS) methods, a set of proposals is iteratively improved. AIS is a relevant and timely methodology although many limitations remain yet to be overcome, e.g., the curse of dimensionality in high-dimensional and multi-modal problems. Moreover, the Hamiltonian Monte Carlo (HMC) algorithm has become increasingly popular in machine learning and statistics. HMC has several appealing features such as its exploratory behavior, especially in high-dimensional targets, when other methods suffer. In this letter, we introduce the novel Hamiltonian adaptive importance sampling (HAIS) method. HAIS implements a two-step adaptive process with parallel HMC chains that cooperate at each iteration. The proposed HAIS efficiently adapts a population of proposals, extracting the advantages of HMC. HAIS can be understood as a particular instance of the generic layered AIS family with an additional resampling step. HAIS achieves a significant performance improvement in high-dimensional problems w.r.t. state-of-the-art algorithms. We discuss the statistical properties of HAIS and show its high performance in two challenging examples.
Keyword:
Proposals
Monte Carlo methods
Artificial intelligence
Signal processing algorithms
Markov processes
Heuristic algorithms
Convergence
Adaptive importance sampling
hamiltonian monte carlo
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

F
Ferdowsi University Mashhad
学者数:
8.0K
论文数: 7.4K
被引数: 44
U
University of Edinburgh
学者数:
5.2W
论文数: 4.6W
被引数: 71
引用论文

引用论文

Stochastic Gradient Population Monte Carlo
err2020-01-01
err6
errOAAI
errEl-Laham, Yousef; Bugallo, Monica F.
err分享
err收藏
5HTR3A‐driven GFP labels immature olfactory sensory neurons
err2017-02-27
err0
errOAAI
errThomas E. Finger; Dianna L. Bartel; Nicole Shultz; Noah B. Goodson; Charles A. Greer
err分享
err收藏
Generalized Multiple Importance Sampling
err2019-02-01
err82
errOAAI
errElvira, Victor; Martino, Luca; Luengo, David; Bugallo, Monica F.
err分享
err收藏
Heretical Multiple Importance Sampling
err2016-10-01
err28
errOAAI
errElvira, Victor; Martino, Luca; Luengo, David; Bugallo, Monica F.
err分享
err收藏
Robust Covariance Adaptation in Adaptive Importance Sampling
err2018-07-01
err11
errOAAI
errEl-Laham, Yousef; Elvira, Victor; Bugallo, Monica F.
err分享
err收藏
学者 查看更多内容