arrow
Return

ROBUST RANK CORRELATION BASED SCREENING

delete2012-06-01
delete290
delete
OA
AI
G
Gaorong Li *
H
Heng Peng
J
Jun Zhang
Z
Zhu, Lixing
DOI:10.1214/12-AOS1024delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Independence screening is a variable selection method that uses a ranking criterion to select significant variables, particularly for statistical models with nonpolynomial dimensionality or large p, small n paradigms when p can be as large as an exponential of the sample size n. In this paper we propose a robust rank correlation screening (RRCS) method to deal with ultra-high dimensional data. The new procedure is based on the Kendall tau correlation coefficient between response and predictor variables rather than the Pearson correlation of existing methods. The new method has four desirable features compared with existing independence screening methods. First, the sure independence screening property can hold only under the existence of a second order moment of predictor variables, rather than exponential tails or alikeness, even when the number of predictor variables grows as fast as exponentially of the sample size. Second, it can be used to deal with semiparametric models such as transformation regression models and single-index models under monotonic constraint to the link function without involving nonparametric estimation even when there are nonparametric functions in the models. Third, the procedure can be largely used against outliers and influence points in the observations. Last, the use of indicator functions in rank correlation screening greatly simplifies the theoretical derivation due to the boundedness of the resulting statistics, compared with previous studies on variable screening. Simulations are carried out for comparisons with existing methods and a real data example is analyzed.
Keywords:
Variable selection
rank correlation screening
dimensionality reduction
semiparametric models
large p small n
SIS
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

H
Hong Kong Baptist University
Scholars:
6.3K
Papers: 7.5K
Citations: 1.3W
S
shenzhen university
Scholars:
4.6W
Papers: 3.4W
Citations: 72
B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Taste dysfunction in patients receiving radiotherapy
err2006-01-01
err0
errOAAI
errHideomi Yamashita; Keiichi Nakagawa; Masao Tago; Naoki Nakamura; Kenshiro Shiraishi; Momoe Eda; Hiroki Nakata; Nami Nagamatsu; Rika Yokoyama; Mayuko Onimura; Kuni Ohtomo
errShare
errSave
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
errShare
errSave
errShare
errSave
researcher View more