返回
A GENERAL FRAMEWORK FOR BAYES STRUCTURED LINEAR MODELS
DOI:10.1214/19-AOS1909.png)
摘要
En 中文
High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with a large number of frequentist methodologies, there are rather few theoretically optimal Bayes methods for high dimensional models. This paper provides a unified approach to both Bayes high dimensional statistics and Bayes nonparametrics in a general framework of structured linear models. With a proposed two-step prior, we prove a general oracle inequality for posterior contraction under an abstract setting that allows model misspecification. The general result can be used to derive new results on optimal posterior contraction under many complex model settings including recent works for stochastic block model, graphon estimation and dictionary learning. It can also be used to improve upon posterior contraction results in literature including sparse linear regression and nonparametric aggregation. The key of the success lies in the novel two-step prior distribution: one for model structure, that is, model selection, and the other one for model parameters. The prior on the parameters of a model is an elliptical Laplace distribution that is capable of modeling signals with large magnitude, and the prior on the model structure involves a factor that compensates the effect of the normalizing constant of the elliptical Laplace distribution, which is important to attain rate-optimal posterior contraction.
Keyword:
Oracle inequality
stochastic block model
graphon
sparse linear regression
aggregation
dictionary learning
posterior contraction
期刊
IF:
3.7
论文数:
2.8K
被引数:
2.9W
机构
引用论文
NEEDLES AND STRAW IN A HAYSTACK: POSTERIOR CONCENTRATION FOR POSSIBLY SPARSE SEQUENCES
ANNALS OF STATISTICS
IF3.7
Influence of Different Electrodes and Tissues on the Impedance Spectra of Scots Pine Shoots不同电极和组织对苏格兰松树芽阻抗谱的影响
Gene Expression Analyses Implicate an Alternative Splicing Program in Regulating Contractile Gene Expression and Serum Response Factor Activity in Mice
PLoS ONE
IF0

