arrow
Return

CONDITIONAL SEQUENTIAL MONTE CARLO IN HIGH DIMENSIONS

delete2023-04-01
delete0
delete
OA
AI
A
Axel Finke *
A
Alexandre H. Thiéry
DOI:10.1214/22-AOS2252delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The iterated conditional sequential Monte Carlo (i-CSMC) algorithm from Andrieu, Doucet and Holenstein (J. R. Stat. Soc. Ser. B Stat. Methodol. 72 (2010) 269-342) is an MCMC approach for efficiently sampling from the joint posterior distribution of the T latent states in challenging time-series models, for example, in nonlinear or non-Gaussian state-space models. It is also the main ingredient in particle Gibbs samplers which infer unknown model parameters alongside the latent states. In this work, we first prove that the i-CSMC algorithm suffers from a curse of dimension in the dimension of the states, D: it breaks down unless the number of samples ('particles'), N, proposed by the algorithm grows exponentially with D. Then we present a novel 'local' version of the algorithm which proposes particles using Gaus-sian random-walk moves that are suitably scaled with D. We prove that this it-erated random-walk conditional sequential Monte Carlo (i-RW-CSMC) algo-rithm avoids the curse of dimension: for arbitrary N, its acceptance rates and expected squared jumping distance converge to nontrivial limits as D & RARR; & INFIN;. If T = N = 1, our proposed algorithm reduces to a Metropolis-Hastings or Barker's algorithm with Gaussian random-walk moves and we recover the well-known scaling limits for such algorithms.
Keywords:
High dimensions
curse of dimension
Markov chain Monte Carlo
particle filter
state-space model

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

L
Loughborough University
Scholars:
9.8K
Papers: 1.0W
Citations: 1.3W