arrow
Return

ESTIMATING MINIMUM EFFECT WITH OUTLIER SELECTION

delete2021-02-01
delete5
delete
OA
AI
A
Alexandra Carpentier *
S
Sylvain Delattre
É
Étienne Roquain
N
Nicolas Verzélen
DOI:10.1214/20-AOS1956delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We introduce one-sided versions of Huber's contamination model, in which corrupted samples tend to take larger values than uncorrupted ones. Two intertwined problems are addressed: estimation of the mean of the uncorrupted samples (minimum effect) and selection of the corrupted samples (outliers). Regarding estimation of the minimum effect, we derive the minimax risks and introduce estimators that are adaptive with respect to the unknown number of contaminations. The optimal convergence rates differ from the ones in the classical Huber contamination model. This fact uncovers the effect of the one-sided structural assumption of the contaminations. As for the problem of selecting the outliers, we formulate the problem in a multiple testing framework for which the location and scaling of the null hypotheses are unknown. We rigorously prove that estimating the null hypothesis while maintaining a theoretical guarantee on the amount of the falsely selected outliers is possible, both through false discovery rate (FDR) and through post hoc bounds. As a by-product, we address a long-standing open issue on FDR control under equi-correlation, which reinforces the interest of removing dependency in such a setting.
Keywords:
Contamination
equicorrelation
false discovery rate
Hermite polynomials
minimax rate
moment matching
multiple testing
post hoc
selective inference
sparsity

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

O
Otto von Guericke University
Scholars:
8.5K
Papers: 6.7K
Citations: 54
C
centre national de la recherche scientifique (cnrs)
Scholars:
24.5W
Papers: 18.2W
Citations: 279
U
Universite Paris Cite
Scholars:
8.9W
Papers: 6.3W
Citations: 604
researcher View more organizations