arrow
Return

Extremal Random Forests

delete2024-02-14
delete7
PRE
AI
N
Nicola Gnecco *
E
Edossa Merga Terefe
S
Sebastian Engelke
DOI:10.1080/01621459.2023.2300522delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Classical methods for quantile regression fail in cases where the quantile of interest is extreme and only few or no training data points exceed it. Asymptotic results from extreme value theory can be used to extrapolate beyond the range of the data, and several approaches exist that use linear regression, kernel methods or generalized additive models. Most of these methods break down if the predictor space has more than a few dimensions or if the regression function of extreme quantiles is complex. We propose a method for extreme quantile regression that combines the flexibility of random forests with the theory of extrapolation. Our extremal random forest (ERF) estimates the parameters of a generalized Pareto distribution, conditional on the predictor vector, by maximizing a local likelihood with weights extracted from a quantile random forest. We penalize the shape parameter in this likelihood to regularize its variability in the predictor space. Under general domain of attraction conditions, we show consistency of the estimated parameters in both the unpenalized and penalized case. Simulation studies show that our ERF outperforms both classical quantile regression methods and existing regression approaches from extreme value theory. We apply our methodology to extreme quantile prediction for U.S. wage data. Supplementary materials for this article are available online.
Keywords:
Extreme quantiles
Local likelihood estimation
Quantile regression
Random forests
Threshold exceedances

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.2K
Citations:
4.8W

Organization

U
University of Copenhagen
Scholars:
7.6W
Papers: 6.6W
Citations: 86
U
university of geneva
Scholars:
3.6W
Papers: 2.9W
Citations: 35
Cited Papers

Cited Papers

errShare
errSave
Solid solution region of the Bi2Sr2CaCu2Oy superconductor
err1993-11-01
err0
PREAI
errT.G. Holesinger; D.J. Miller; L.S. Chumbley
errShare
errSave
Microsurgical treatment of injury to peripheral nerves in upper and lower limbs: A critical review of the last 8 years
err2007-06-27
err0
PREAI
errA. Portincasa; G. Gozzo; D. Parisi; L. Annacontini; A. Campanale; G. Basso; A. Maiorella
errShare
errSave
errShare
errSave
errShare
errSave
Single Molecule Photocatalysis on TiO2 Surfaces
err2019-09-10
err0
PREAI
errQing Guo; Zhibo Ma; Chuanyao Zhou; Zefeng Ren; Xueming Yang
errShare
errSave
researcher View more