arrow
Return

Efficient hyperparameter estimation in Bayesian inverse problems using sample average approximation

delete2025-09-25
delete0
PRE
AI
J
Julianne Chung
S
Scot M. Miller
M
Malena Sabaté Landman
A
Arvind K. Saibaba *
DOI:10.1098/rsta.2024.0046delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In Bayesian inverse problems, it is common to consider several hyperparameters that define the prior and the noise model that must be estimated from the data. In particular, we are interested in linear inverse problems with additive Gaussian noise and Gaussian priors defined using Mat & eacute;rn covariance models. In this case, we estimate the hyperparameters using the maximum a posteriori (MAP) estimate of the marginalized posterior distribution. However, this is a computationally intensive task since it involves computing log determinants. To address this challenge, we consider a stochastic average approximation (SAA) of the objective function and use the preconditioned Lanczos method to compute efficient approximations of the function and gradient evaluations. We propose a new preconditioner that can be updated cheaply for new values of the hyperparameters and an approach to compute approximations of the gradient evaluations, by reutilizing information from the function evaluations. We demonstrate the performance of our approach on static and dynamic seismic tomography problems.This article is part of the theme issue 'Frontiers of applied inverse problems in science and engineering'.
Keywords:
Monte Carlo
preconditioning
inverse problems

Journal

P
Philosophical Transactions of the Royal Society A-Mathematical Physical and Engineering Sciences
IF:
3.7
Papers:
7.8K
Citations:
2.8W

Organization

J
Johns Hopkins University
Scholars:
10.2W
Papers: 8.8W
Citations: 13.0W
U
university of oxford
Scholars:
9.8W
Papers: 8.6W
Citations: 137
E
Emory University
Scholars:
5.0W
Papers: 4.2W
Citations: 5.7W
N
North Carolina State University
Scholars:
2.6W
Papers: 2.3W
Citations: 3.7W
researcher View more organizations
Cited Papers

Cited Papers

Bayesian inversion with α-stable priors
err2023-08-31
err0
errOAAI
errJarkko Suuronen; Tomás Soto; Neil K Chada; Lassi Roininen
errShare
errSave
Fast Direct Methods for Gaussian Processes
err2016-02-01
err0
errOAAI
errSivaram Ambikasaran; Daniel Foreman-Mackey; Leslie Greengard; David W. Hogg; Michael O'Neil
errShare
errSave
errShare
errSave
Efficient iterative methods for hyperparameter estimation in large-scale linear inverse problems
err2024-12-01
err0
PREAI
errHall-Hooper,Khalil A.; Saibaba,Arvind K.; Chung,Julianne; Miller,Scot M.
errShare
errSave
researcher View more