arrow
返回

A GENERAL FRAMEWORK FOR BAYES STRUCTURED LINEAR MODELS

delete2020-10-01
delete24
delete
OA
AI
C
Chao Gao *
A
Aad van der Vaart
H
Harrison H. Zhou
DOI:10.1214/19-AOS1909delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with a large number of frequentist methodologies, there are rather few theoretically optimal Bayes methods for high dimensional models. This paper provides a unified approach to both Bayes high dimensional statistics and Bayes nonparametrics in a general framework of structured linear models. With a proposed two-step prior, we prove a general oracle inequality for posterior contraction under an abstract setting that allows model misspecification. The general result can be used to derive new results on optimal posterior contraction under many complex model settings including recent works for stochastic block model, graphon estimation and dictionary learning. It can also be used to improve upon posterior contraction results in literature including sparse linear regression and nonparametric aggregation. The key of the success lies in the novel two-step prior distribution: one for model structure, that is, model selection, and the other one for model parameters. The prior on the parameters of a model is an elliptical Laplace distribution that is capable of modeling signals with large magnitude, and the prior on the model structure involves a factor that compensates the effect of the normalizing constant of the elliptical Laplace distribution, which is important to attain rate-optimal posterior contraction.
Keyword:
Oracle inequality
stochastic block model
graphon
sparse linear regression
aggregation
dictionary learning
posterior contraction

期刊

Annals of Statistics 封面图
Annals of Statistics
IF:
3.7
论文数:
2.8K
被引数:
2.9W

机构

L
leiden university - excl lumc
学者数:
3.5W
论文数: 2.9W
被引数: 46
U
university of chicago
学者数:
4.5W
论文数: 3.7W
被引数: 80
L
Leiden University
学者数:
4.0W
论文数: 3.3W
被引数: 3.8W
学者 查看更多机构
引用论文

引用论文

Data collection, simulation and design of a waste heat energy conversion system
err2009-10-01
err0
PREAI
errJ. Mikael Eklund; Ian Spencer; Jinfu Zheng; Neil Yhap; Ryan Naughton; David Mercy; Charles Elliot; Ian Marnoch
err分享
err收藏
SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
err分享
err收藏
Mechanism of SiN x  H  y Deposition from  NH 3 ‐ SiH4 Plasma
err2019-12-07
err0
PREAI
errDonald L. Smith; Andrew S. Alimonda; Chau‐Chen Chen; Steven E. Ready; Barbara Wacker
err分享
err收藏
学者 查看更多内容