arrow
Return

Bayesian Compressed Regression

delete2016-01-15
delete43
delete
OA
AI
R
Rajarshi Guhaniyogi *
D
David B. Dunson
DOI:10.1080/01621459.2014.969425delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
As an alternative to variable selection or shrinkage in high-dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the predictors can be projected to a low-dimensional linear subspace with minimal loss of information about the response. As opposed to existing Bayesian dimensionality reduction approaches, the exact posterior distribution conditional on the compressed data is available analytically, speeding up computation by many orders of magnitude while also bypassing robustness issues due to convergence and mixing problems with MCMC. Model averaging is used to reduce sensitivity to the random projectionmatrix, while accommodating uncertainty in the subspace dimension. Strong theoretical support is provided for the approach by showing near parametric convergence rates for the predictive density in the large p small n asymptotic paradigm. Practical performance relative to competitors is illustrated in simulations and real data applications.
Keywords:
Compressed sensing
Data compression
Dimensionality reduction
Large p
small n
Random projection
Sparsity
Sufficient dimension reduction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.2K
Citations:
4.8W

Organization

U
university of california santa cruz
Scholars:
8.7K
Papers: 6.8K
Citations: 32
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
Cited Papers

Cited Papers

Convergence rates of posterior distributions for noniid observations
err2007-02-01
err224
errOAAI
errGhosal, Subhashis; Van Der Vaart, Aad
errShare
errSave
Single-Contrast CT for Detecting Bowel Injuries in Penetrating Abdominopelvic Trauma
err2018-04-01
err0
PREAI
errHamza Jawad; Constantine Raptis; Aaron Mintz; Douglas Schuerer; Vincent Mellnick
errShare
errSave
The Bayesian Lasso
err2012-01-01
err2.4K
PREAI
errPark, Trevor; Casella, George
errShare
errSave
Short telomeres are associated with genetic complexity, high-risk genomic aberrations, and short survival in chronic lymphocytic leukemia
err2008-02-15
err0
errOAAI
errGöran Roos; Alexander Kröber; Pawel Grabowski; Dirk Kienle; Andreas Bühler; Hartmut Döhner; Richard Rosenquist; Stephan Stilgenbauer
errShare
errSave
researcher View more