Variational Inference Aided Variable Selection For Spatially Structured High Dimensional Covariates

Siddhartha Nandy

doi:10.1080/10618600.2025.2549110

Variational Inference Aided Variable Selection For Spatially Structured High Dimensional Covariates

2025-10-01

0

OA

AI

Shrijita Bhattacharya *

T

Tapabrata Maiti

DOI：10.1080/10618600.2025.2549110

Original

Original request for help

Save

Abstract

En 中文

We consider the problem of Bayesian high dimensional variable selection in linear regression when a spatial structure exists among the covariates. We use an Ising prior to model the structural connectivity of the covariates with an undirected graph and the connectivity strength with Ising distribution parameters. Ising models, which originated in statistical physics, are widely used in computer vision and spatial data modeling. Although a Gibbs solution to this problem exists, the solution involves the computation of determinants and inverses of high dimensional matrices, rendering it unscalable to higher dimensions. Furthermore, the lack of theoretical support limits this important tool's use for the broader community. This article proposes a variational inference-aided Gibbs approach that enjoys the same variable recovery power as the standard Gibbs solution while being computationally scalable to higher dimensions. We establish strong selection consistency for our proposed approach, along with its competitive numerical performance under varying simulation scenarios. Supplementary materials for this article are available online.

Keywords:

Bayesian variable selection

High-dimensional

Ising distribution

Structured covariates

Variational bayes

Variational Inference Aided Variable Selection For Spatially Structured High Dimensional Covariates

Abstract

Journal

Organization