返回
Hamiltonian Adaptive Importance Sampling
DOI:10.1109/LSP.2021.3068616.png)
摘要
En 中文
Importance sampling (IS) is a powerful Monte Carlo (MC) methodology for approximating integrals, for instance in the context of Bayesian inference. In IS, the samples are simulated from the so-called proposal distribution, and the choice of this proposal is key for achieving a high performance. In adaptive IS (AIS) methods, a set of proposals is iteratively improved. AIS is a relevant and timely methodology although many limitations remain yet to be overcome, e.g., the curse of dimensionality in high-dimensional and multi-modal problems. Moreover, the Hamiltonian Monte Carlo (HMC) algorithm has become increasingly popular in machine learning and statistics. HMC has several appealing features such as its exploratory behavior, especially in high-dimensional targets, when other methods suffer. In this letter, we introduce the novel Hamiltonian adaptive importance sampling (HAIS) method. HAIS implements a two-step adaptive process with parallel HMC chains that cooperate at each iteration. The proposed HAIS efficiently adapts a population of proposals, extracting the advantages of HMC. HAIS can be understood as a particular instance of the generic layered AIS family with an additional resampling step. HAIS achieves a significant performance improvement in high-dimensional problems w.r.t. state-of-the-art algorithms. We discuss the statistical properties of HAIS and show its high performance in two challenging examples.
Keyword:
Proposals
Monte Carlo methods
Artificial intelligence
Signal processing algorithms
Markov processes
Heuristic algorithms
Convergence
Adaptive importance sampling
hamiltonian monte carlo
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.6
论文数:
1.1W
被引数:
1.7W
机构
引用论文
An Approach to BI-RADS Uncertainty Levels Classification Via Deep Learning with Transfer Learning Technique基于迁移学习技术通过深度学习对BI-RADS不确定性水平进行分类的方法
Assessment and rehabilitation of acquired visuospatial and proprioceptive deficits associated with visuospatial neglect对与视空间忽略相关的获得性视空间和本体感觉障碍的评估与康复

