arrow
Return

A Variational View on Statistical Multiscale Estimation

delete2022-03-07
delete2
delete
OA
AI
M
Markus Haltmeier *
H
Housen Li
A
Axel Munk
DOI:10.1146/annurev-statistics-040120-030531delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a unifying view on various statistical estimation techniques including penalization, variational, and thresholding methods. These estimators are analyzed in the context of statistical linear inverse problems including nonparametric and change point regression, and high-dimensional linear models as examples. Our approach reveals many seemingly unrelated estimation schemes as special instances of a general class of variational multiscale estimators, called MIND (multiscale Nemirovskii-Dantzig). These estimators result from minimizing certain regularization functionals under convex constraints that can be seen as multiple statistical tests for local hypotheses. For computational purposes, we recast MIND in terms of simpler unconstraint optimization problems via Lagrangian penalization as well as Fenchel duality. Performance of several MINDs is demonstrated on numerical examples.
Keywords:
Fenchel duality
Lagrangian formulation
nonparametric regression
statistical imaging
change points
wavelets
high-dimensional linear models
variational estimation

Journal

Annual Review of Statistics and Its Application cover
Annual Review of Statistics and Its Application
IF:
8.7
Papers:
211
Citations:
2.4K

Organization

U
University of Innsbruck
Scholars:
9.8K
Papers: 8.6K
Citations: 8
U
University of Gottingen
Scholars:
2.5W
Papers: 2.1W
Citations: 36