arrow
Return

High-dimensional correlation matrix estimation for general continuous data with Bagging technique

delete2022-03-18
delete4
delete
OA
AI
C
Chaojie Wang
J
Jin Du
X
Xiaodan Fan *
DOI:10.1007/s10994-022-06138-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
High-dimensional covariance matrix estimation plays a central role in multivariate statistical analysis. It is well-known that the sample covariance matrix is singular when the sample size is smaller than the dimension of the variable, but the covariance estimate must be positive-definite. This motivates some modifications of the sample covariance matrix to preserve its efficient estimation of pairwise covariance. In this paper, we modify the sample correlation matrix using the Bagging technique. The proposed Bagging estimator is flexible for general continuous data. Under some mild conditions, we show theoretically that the Bagging estimator can ensure positive-definiteness with probability one in finite samples. We also prove the consistency of the bootstrap estimator of Pearson correlation and the consistency of our Bagging estimator when the dimension p is fixed. Simulation results and a real application are provided to demonstrate that our method strikes a better balance between RMSE and likelihood, and is more robust, than other existing estimators.
Keywords:
Bagging technique
Random matrix
Sample correlation matrix
Positive-definiteness

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

J
Jiangsu University
Scholars:
4.0W
Papers: 2.8W
Citations: 5.5W
C
Chinese University of Hong Kong
Scholars:
3.4W
Papers: 3.2W
Citations: 5.6W
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Longitudinal trends in substance use and mental health service needs in child welfare
err2017-02-01
err0
PREAI
errOrion Mowbray; Joseph P. Ryan; Bryan G. Victor; Gregory Bushman; Clayton Yochum; Brian E. Perron
errShare
errSave
Increased oxidative stress and apoptosis in acute puromycin aminonucleoside nephrosis
err2004-04-26
err0
errOAAI
errJaimar Rincon; Maritza Romero; Ninoska Viera; Adriana Pedrean˜ez; Jesus Mosquera
errShare
errSave
OPTIMAL RATES OF CONVERGENCE FOR COVARIANCE MATRIX ESTIMATION
err2010-08-01
err378
errOAAI
errCai, T. Tony; Zhang, Cun-Hui; Zhou, Harrison H.
errShare
errSave
researcher View more