arrow
Return

ROBUST HIGH-DIMENSIONAL TUNING FREE MULTIPLE TESTING

delete2023-10-01
delete0
delete
OA
AI
J
Jianqing Fan *
Z
Zhipeng Lou
M
Mengxin Yu
DOI:10.1214/23-AOS2322delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A stylized feature of high-dimensional data is that many variables have heavy tails, and robust statistical inference is critical for valid large-scale statistical inference. Yet, the existing developments such as Winsorization, Huberization and median of means require the bounded second moments and involve variable-dependent tuning parameters, which hamper their fidelity in applications to large-scale problems. To liberate these constraints, this paper revisits the celebrated Hodges-Lehmann (HL) estimator for estimating location parameters in both the one- and two-sample problems, from a nonasymptotic perspective. Our study develops Berry-Esseen inequality and Cramer-type moderate deviation for the HL estimator based on newly developed nonasymptotic Bahadur representation and builds data-driven confidence intervals via a weighted bootstrap approach. These results allow us to extend the HL estimator to large-scale studies and propose tuning-free and moment-free high-dimensional inference procedures for testing global null and for large-scale multiple testing with false discovery proportion control. It is convincingly shown that the resulting tuning-free and moment-free methods control false discovery proportion at a prescribed level. The simulation studies lend further support to our developed theory.
Keywords:
Key words and phrases. Robust statistical inference
heavy -tailed data
tuning free
weighted bootstrap
large
scale multiple testing

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
U
University of Pittsburgh
Scholars:
4.5W
Papers: 3.6W
Citations: 7.1W
P
pennsylvania commonwealth system of higher education (pcshe)
Scholars:
12.9W
Papers: 11.7W
Citations: 177
researcher View more organizations