Bayesian Model Selection in High-Dimensional Settings

Valen E. Johnson

doi:10.1080/01621459.2012.682536

Bayesian Model Selection in High-Dimensional Settings

2012-06-01

204

OA

AI

DOI：10.1080/01621459.2012.682536

Original

Original request for help

Save

Abstract

En 中文

Standard assumptions incorporated into Bayesian model selection procedures result in procedures that are not competitive with commonly used penalized likelihood methods. We propose modifications of these methods by imposing nonlocal prior densities on model parameters. We show that the resulting model selection procedures are consistent in linear model settings when the number of possible covariates p is bounded by the number of observations n, a property that has not been extended to other model selection procedures. In addition to consistently identifying the true model, the proposed procedures provide accurate estimates of the posterior probability that each identified model is correct. Through simulation studies, we demonstrate that these model selection procedures perform as well or better than commonly used penalized likelihood methods in a range of simulation settings. Proofs of the primary theorems are provided in the Supplementary Material that is available online.

Keywords:

Adaptive LASSO

Dantzig selector

Elastic net

g-prior

Intrinsic Bayes factor

Intrinsic prior

Nonlocal prior

Nonnegative garrote

Oracle

Bayesian Model Selection in High-Dimensional Settings

Abstract

Journal

Organization